factor analysis

(redirected from Multi-factorial)
Also found in: Dictionary, Thesaurus, Financial.
Related to Multi-factorial: multifactorial inheritance, multifactorial disease

factor analysis

[′fak·tər ə‚nal·ə·səs]
Given sets of variables which are related linearly, factor analysis studies techniques of approximating each set relative to the others; usually the variables denote numbers.

factor analysis

a MULTIVARIATE statistical technique in which the covariances (or CORRELATIONS) between a large set of observed VARIABLES are explained in terms of a small number of new variables called factors. The ideas originated in the work on correlation by Galton and Spearman, and were developed primarily in studies of intelligence. Most applications are found in psychology and sociology.

The technique is ‘variable directed’, with no distinction between INDEPENDENT and DEPENDENT VARIABLES in the data set. There are four steps to the analysis. The first is to derive a correlation matrix in which each variable in the data set is correlated with all the other variables. The next step is to extract the factors. The aim of this stage is to determine the minimum number of factors that can account adequately for the observed correlations between the original variables. If the number of factors identified is close to the number of original variables, there is little point to the factor analysis. Sometimes it is difficult to assign a meaningful name to the factors. The purpose of the third (optional) step, rotation, is to find simpler and more easily interpretable factors. If a satisfactory model has been derived, the fourth step is to compute scores for each factor for each case in the data set. The factor scores can then be used in subsequent analyses.

Factor analysis attracts a lot of criticism (Chatfield and Collins, 1980). The observed correlation matrix is generally assumed to have been constructed using product moment correlations. Hence, the usual assumptions of an interval measurement, normal distributions and homogeneity of variance are needed. Against this, it is argued the technique is fairly robust. Another problem is that the different methods of extraction and rotation tend to produce different solutions. Further, although factors may be clearly identified from the analysis, it may be difficult to give them a meaningful interpretation. Despite the need for so many judgmental decisions in its use, factor analysis remains a useful exploratory tool.

Factor Analysis


a branch of multivariate analysis embracing methods for estimating the dimensions of a set of observed variables by studying the structure of the covariance or correlation matrices.

The basic assumption underlying factor analysis is that the correlations between a large number of observable variables are determined by the existence of a smaller number of hypothetical unobservable variables, or factors. A general model for factor analysis is provided in terms of the random variables X1 . . .,Xn, which are the observation results, by the following linear model:

Here, the random variables fj are common factors, the random variables Ui are factors specific to the variables Xi and are not correlated with the fj, and the εj, are random errors. It is assumed that k < n, that the random variables ej are independent of each other and of the fj and Ui, and that E∊i = 0 and D∊i = Factor Analysis The constant coefficients aij are called loadings (weights): aij is the loading of the ith variable on the jth factor. The quantities aij, bi, and Factor Analysis are taken as unknown parameters that have to be estimated.

In the form given above, the model for factor analysis is characterized by some indeterminacy, since n variables are expressed in terms of n + k other variables. Equations (*), however, imply a hypothesis, regarding the covariance matrix, that can be tested. For example, if the factors fj are uncorrelated, Dfi = 1, Bi = 0, and cij are the elements of the matrix of covariances between the Xi, then there follows from equation (*) an expression for the cij in terms of the loadings and the variances of the errors:

The general model for factor analysis is thus equivalent to a hypothesis regarding the covariance matrix: the covariance matrix can be represented as the sum of the matrix A A’ and the diagonal matrix with elements Factor Analysis, where

A = {aij}

The estimation procedure in factor analysis consists of two steps. First, the factor structure (that is, the number of factors required to account for the correlations between the Xi) is determined, and the loadings are estimated. Second, the factors are estimated on the basis of the observation results. The fundamental obstacle to the interpretation of the set of factors is that for k > 1 neither the loadings nor the factors can be determined uniquely, since the factors fj in equations (*) can be replaced by means of any orthogonal transformation. This property of the model is made use of to transform (rotate) the factors; the transformation is chosen so that the observed variables have the maximum possible loadings on one factor and minimum possible loadings on the remaining factors.

Various practical methods are known for estimating loadings. The methods assume that X1,. . ., Xn obey a multivariate normal distribution with covariance matrix C = {cij}. The maximum likelihood method is noteworthy. It leads to a unique set of estimates of the cij, but for the estimates of the aij it yields equations that are satisfied by an infinite set of solutions with equally good statistical properties.

Factor analysis is regarded as dating from 1904. Although it was originally developed for problems in psychology, the range of its applications is much broader, and it is now used to solve various practical problems in such fields as medicine, economics, and chemistry. A rigorous theoretical grounding, however, has not yet been provided for many results and methods of factor analysis that are widely used in practice. The mathematical description of modern factor analysis in a rigorous manner is an extremely difficult task and remains uncompleted.


Lawley, D., and A. Maxwell. Faktornyi analiz kak statisticheskii metod. Moscow, 1967. (Translated from English.)
Harman, H. Sovremennyi faktornyi analiz. Moscow, 1972. (Translated from English.)


References in periodicals archive ?
I would agree with the author that many of the more complicated diseases that we have to deal with in medical practice and in life, including cancer, autoimmune disease, and mental illness, are multi-factorial and can be tragically dismissed as "I don't know, go see a specialist" by some primary-care physicians.
Sexual dysfunction is multi-factorial, and it remains important to discuss With patients the uncertainty of the cause.
Dear Editor, Whilst the National Nurses Nutrition Group (NNNG) agree that nurses have an important part to play in nutritional care, it must be understood that malnutrition is multi-factorial.
WHILE the National Nurses Nutrition Group (NNNG) agrees that nurses have an important part to play in nutritional care, it must be understood that malnutrition is multi-factorial.
That is why most public health endeavors require multi-factorial approaches.
Combining the benefits of bivalent, avid binding of disease targets with the ability to modulate two targets at once shows the clear development potential of the Duocalin technology to treat multi-factorial diseases".
1) Endothelial abnormalities in DM have been shown to be only partially influenced by contemporary, intensified multi-factorial cardiovascular risk intervention, suggesting the need for earlier and more aggressive risk factor intervention.
Boost radiologist softcopy reading: RadStream includes a patent pending Acuity Index which utilizes a multi-factorial algorithm that prioritizes imaging exams based on a "most likely to interrupt" method that was fully tested and validated by the Cincinnati School of Business.
We should not use the term 'apology' because most of the time the cause of an error is multi-factorial and most often due to procedural/system problems," one physician responding to the ACPE survey says.
They discuss basic statistical procedures with one and two samples, multi-factorial designs, alternative estimate procedures and missing data, and other aspects.
As Part I of an agenda seeking global implementation of the "Declaration of Olympia on Nutrition and Fitness," a multi-factorial approach is also taken in regard to coronary heart disease and cancer risk.
Further epidemiologic and biologic studies are needed to explain, in a multi-factorial model, which factors (genetic and/or environmental) interact and influence the etiology of this congenital abnormality.

Full browser ?