Hostname: page-component-74656f9884-npj9w Total loading time: 0 Render date: 2026-11-09T19:22:36.581Z Has data issue: false hasContentIssue false
  • English
  • Français

Clustered Common Factor Exploration in Factor Analysis

Published online by Cambridge University Press:  01 January 2025

Kohei Uno Open the ORCID record for Kohei Uno [Opens in a new window] ,
Kohei Adachi  and
Nickolay T. Trendafilov Open the ORCID record for Nickolay T. Trendafilov [Opens in a new window]
Kohei Uno*
Affiliation:
Osaka University
Kohei Adachi
Affiliation:
Osaka University
Nickolay T. Trendafilov
Affiliation:
Open University
*
Correspondence should be made to Kohei Uno, Graduate School of Human Sciences, Osaka University, 1-2 Yamadaoka, Suita, Osaka 565-0871, Japan. Email: kohei.uno.stat@gmail.com
Get access Rights & Permissions [Opens in a new window]

Abstract

The factor analysis (FA) model does not permit unique estimation of the common and unique factor scores. This weakness is notorious as the factor indeterminacy in FA. Luckily, some part of the factor scores can be uniquely determined. Thus, as a whole, they can be viewed as a sum of determined and undetermined parts. The paper proposes to select the undetermined part, such that the resulting common factor scores have the following feature: the rows (i.e., individuals) of the common factor score matrix are as well classified as possible into few clusters. The clear benefit is that we can easily interpret the factor scores simply by focusing on the clusters. The procedure is called clustered common factor exploration (CCFE). An alternating least squares algorithm is developed for CCFE. It is illustrated with real data examples. The proposed approach can be viewed as a parallel to the rotation techniques in FA. They exploit another FA indeterminacy, the rotation indeterminacy, which is resolved by choosing the rotation that transforms the loading matrix into the ‘most’ interpretable one according to a pre-specified criterion. In contrast to the rotational indeterminacy, the factor indeterminacy is utilized to achieve well-clustered factor scores by CCFE. To the best of our knowledge, such an approach to the FA interpretation has not been studied yet.

Keywords

exploratory factor analysisfactor indeterminacyclustered common factor scoresfactor identificationmatrix decomposition solution

Information

Type
Original Paper
Information
Psychometrika , Volume 84 , Issue 4 , December 2019 , pp. 1048 - 1067
Copyright
Copyright © 2019 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Adachi, K..(2012). Some contributions to data-fitting factor analysis with empirical comparisons to covariance-fitting factor analysis. Journal of the Japanese Society of Computational Statistics, 25 25– 38. CrossRefGoogle Scholar
Adachi, K..(2016). Matrix-based introduction to multivariate data analysis, Singapore: Springer. CrossRefGoogle Scholar
Adachi, K., &Trendafilov, N. T..(2018). Some mathematical properties of the matrix decomposition solution in factor analysis. Psychometrika, 83 407– 424. CrossRefGoogle ScholarPubMed
Anderberg, M..(1973). Cluster analysis for applications, New York: Academic Press. Google Scholar
Anderson, MT. W., & Rubin, H.. (1956). Statistical inference in factor analysis. In J. Neyman (Ed.), Proceedings of the third Berkeley Symposium on Mathematical Statistics and Probability., vol. 5. (pp. 111-150). Berkeley, CA: University of California Press. Google Scholar
Bartlett, M. S..(1937). The statistical conception of mental factors. British Journal of Psychology, 28 97– 104. Google Scholar
Bezdek, J. C..(1980). A convergence theorem for the fuzzy ISODATA clustering algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2 1– 8. CrossRefGoogle Scholar
Browne, M..(2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Researches, 36 111– 150. CrossRefGoogle Scholar
de Leeuw, J.,van Montfort, K.,Oud, J., &Satorra, A..(2004). Least squares optimal scaling of partially observed linear systems. Recent Developments of Structural Equation Models: Theory and Applications, Dordrecht: Kluwer Academic. 121– 134. CrossRefGoogle Scholar
Calinski, R. B., &Harabasz, J..(1974). A dendrite method for cluster analysis. Communications in Statistics, 3 1– 27. CrossRefGoogle Scholar
Committee for Guiding Psychological Experiments (1985). Experiments and tests: The foundations of psychology (Explanation version), Tokyo: Bifukan(in Japanese). Google Scholar
Gan, G.,Ma, C., &Wu, J..(2007). Data clustering: Theory, algorithms, and applications, Philadelphia, PA: Society of Industrial and Applied Mathematics (SIAM). CrossRefGoogle Scholar
Guttman, L..(1955). The determinacy of factor score matrices with implications for five other basic problems of common factor theory. British Journal of Statistical Psychology, 8 65– 81. CrossRefGoogle Scholar
Guttman, L..(1988). ETA, DISCO, ODISCO, and $F$. Psychometrika, 53 393– 405. CrossRefGoogle Scholar
Harman, H. H..(1976). Modern factor analysis, 3 Chicago: The University of Chicago Press. Google Scholar
Hastie, T.,Tibshirani, R., &Wainwright, M..(2015). Statistical learning with sparsity: The lasso and generalizations, Boca Raton: CRC Press. CrossRefGoogle Scholar
Hubert, L., &Arabie, P..(1985). Comparing Partitions. Journal of Classification, 2 193– 218. CrossRefGoogle Scholar
Izenman, A. J..(2008). Modern multivariate statistical techniques, New York, NY: Springer. CrossRefGoogle Scholar
Krijnen, W. P.,Wansbeek, T.J., &ten Berge, J.M.F..(1996). Best linear predictors for factor scores. Communications in Statistics: Theory and Methods, 25 3013– 3025. CrossRefGoogle Scholar
Lütkepohl, H..(1996). Handbook of matrices, Chichester: Wiley. Google Scholar
MacQueen, J. B..(1967). Some methods for classification and analysis of multivariate observations. Proceedings of the 5th Berkeley Symposium, 1 281– 297. Google Scholar
Milligan, G. W., &Cooper, M. C..(1985). An examination of procedures for determining the number of clusters in a data set. Psychometrika, 50 159– 179. CrossRefGoogle Scholar
Mulaik, S. A..(1976). Comments on “The measurement of factorial indeterminacy”. Psychometrika, 41 249– 262. CrossRefGoogle Scholar
Mulaik, S. A..(2010). Foundations of factor analysis, 2 Boca Raton: CRC Press. Google Scholar
Sočan, G. (2003). The incremental value of minimum rank factor analysis. Ph.D Thesis, University of Groningen: Groningen.Google Scholar
Stegeman, A..(2016). A new method for simultaneous estimation of the factor model parameters, factor scores, and unique parts. Computational Statistics and Data Analysis, 99 189– 203. CrossRefGoogle Scholar
ten Berge, J.M.F..(1983). A generalization of Kristof’s theorem on the trace of certain matrix products. Psychometrika, 48 519– 523. 10.1007/BF02293876 CrossRefGoogle Scholar
ten Berge, J.M.F..(1993). Least squares optimization in multivariate analysis, Leiden: DSWO Press. Google Scholar
Thurstone, L. L..(1935). Vector of mind, Chicago: The University of Chicago Press. Google Scholar
Trendafilov, N. T., &Unkel, S..(2011). Exploratory factor analysis of data matrices with more variables than observations. Journal of Computational and Graphical Statistics, 20 874– 891. CrossRefGoogle Scholar
Unkel, S., &Trendafilov, N. T..(2010). Simultaneous parameter estimation in exploratory factor analysis: An expository review. International Statistical Review, 78 363– 382. CrossRefGoogle Scholar