\HeaderA{lda}{Linear Discriminant Analysis}{lda}
\aliasA{coef.lda}{lda}{coef.lda}
\methaliasA{lda.data.frame}{lda}{lda.data.frame}
\methaliasA{lda.default}{lda}{lda.default}
\methaliasA{lda.formula}{lda}{lda.formula}
\methaliasA{lda.matrix}{lda}{lda.matrix}
\aliasA{model.frame.lda}{lda}{model.frame.lda}
\aliasA{print.lda}{lda}{print.lda}
\keyword{multivariate}{lda}
\begin{Description}\relax
Linear discriminant analysis.
\end{Description}
\begin{Usage}
\begin{verbatim}
lda(x, ...)

## S3 method for class 'formula':
lda(formula, data, ..., subset, na.action)

## Default S3 method:
lda(x, grouping, prior = proportions, tol = 1.0e-4,
    method, CV = FALSE, nu, ...)

## S3 method for class 'data.frame':
lda(x, ...)

## S3 method for class 'matrix':
lda(x, grouping, ..., subset, na.action)
\end{verbatim}
\end{Usage}
\begin{Arguments}
\begin{ldescription}
\item[\code{formula}] A formula of the form \code{groups \textasciitilde{} x1 + x2 + ...}  That is, the
response is the grouping factor and the right hand side specifies
the (non-factor) discriminators.

\item[\code{data}] Data frame from which variables specified in \code{formula} are
preferentially to be taken.

\item[\code{x}] (required if no formula is given as the principal argument.)
a matrix or data frame or Matrix containing the explanatory variables.

\item[\code{grouping}] (required if no formula principal argument is given.)
a factor specifying the class for each observation.

\item[\code{prior}] the prior probabilities of class membership.  If unspecified, the
class proportions for the training set are used.  If present, the
probabilities should be specified in the order of the factor
levels.

\item[\code{tol}] A tolerance to decide if a matrix is singular; it will reject variables
and linear combinations of unit-variance variables whose variance is
less than \code{tol\textasciicircum{}2}.

\item[\code{subset}] An index vector specifying the cases to be used in the training
sample.  (NOTE: If given, this argument must be named.)

\item[\code{na.action}] A function to specify the action to be taken if \code{NA}s are found.
The default action is for the procedure to fail.  An alternative is
\code{na.omit}, which leads to rejection of cases with missing values on
any required variable.  (NOTE: If given, this argument must be named.)

\item[\code{method}] \code{"moment"} for standard estimators of the mean and variance,
\code{"mle"} for MLEs, \code{"mve"} to use \code{\LinkA{cov.mve}{cov.mve}}, or
\code{"t"} for robust estimates based on a \eqn{t}{} distribution.

\item[\code{CV}] If true, returns results (classes and posterior probabilities) for
leave-one-out cross-validation. Note that if the prior is estimated,
the proportions in the whole dataset are used.

\item[\code{nu}] degrees of freedom for \code{method = "t"}.

\item[\code{...}] arguments passed to or from other methods.

\end{ldescription}
\end{Arguments}
\begin{Details}\relax
The function
tries hard to detect if the within-class covariance matrix is
singular. If any variable has within-group variance less than
\code{tol\textasciicircum{}2} it will stop and report the variable as constant.  This
could result from poor scaling of the problem, but is more
likely to result from constant variables.

Specifying the \code{prior} will affect the classification unless
over-ridden in \code{predict.lda}.  Unlike in most statistical packages, it
will also affect the rotation of the linear discriminants within their
space, as a weighted between-groups covariance matrix is used. Thus
the first few linear discriminants emphasize the differences between
groups with the weights given by the prior, which may differ from
their prevalence in the dataset.

If one or more groups is missing in the supplied data, they are dropped
with a warning, but the classifications produced are with respect to the
original set of levels.
\end{Details}
\begin{Value}
If \code{CV = TRUE} the return value is a list with components
\code{class}, the MAP classification (a factor), and \code{posterior},
posterior probabilities for the classes.

Otherwise it is an object of class \code{"lda"} containing the
following components:
\begin{ldescription}
\item[\code{prior}] the prior probabilities used.

\item[\code{means}] the group means.

\item[\code{scaling}] a matrix which transforms observations to discriminant functions,
normalized so that within groups covariance matrix is spherical.

\item[\code{svd}] the singular values, which give the ratio of the between- and
within-group standard deviations on the linear discriminant
variables.  Their squares are the canonical F-statistics.

\item[\code{N}] The number of observations used.

\item[\code{call}] The (matched) function call.

\end{ldescription}
\end{Value}
\begin{Note}\relax
This function may be called giving either a formula and
optional data frame, or a matrix and grouping factor as the first
two arguments.  All other arguments are optional, but \code{subset=} and
\code{na.action=}, if required, must be fully named.

If a formula is given as the principal argument the object may be
modified using \code{update()} in the usual way.
\end{Note}
\begin{References}\relax
Venables, W. N. and Ripley, B. D. (2002)
\emph{Modern Applied Statistics with S.} Fourth edition.  Springer.

Ripley, B. D. (1996)
\emph{Pattern Recognition and Neural Networks}. Cambridge University Press.
\end{References}
\begin{SeeAlso}\relax
\code{\LinkA{predict.lda}{predict.lda}}, \code{\LinkA{qda}{qda}}, \code{\LinkA{predict.qda}{predict.qda}}
\end{SeeAlso}
\begin{Examples}
\begin{ExampleCode}
Iris <- data.frame(rbind(iris3[,,1], iris3[,,2], iris3[,,3]),
                   Sp = rep(c("s","c","v"), rep(50,3)))
train <- sample(1:150, 75)
table(Iris$Sp[train])
## your answer may differ
##  c  s  v
## 22 23 30
z <- lda(Sp ~ ., Iris, prior = c(1,1,1)/3, subset = train)
predict(z, Iris[-train, ])$class
##  [1] s s s s s s s s s s s s s s s s s s s s s s s s s s s c c c
## [31] c c c c c c c v c c c c v c c c c c c c c c c c c v v v v v
## [61] v v v v v v v v v v v v v v v
(z1 <- update(z, . ~ . - Petal.W.))
\end{ExampleCode}
\end{Examples}

