Dimensional approaches assume that all individuals within hierarchical units (e.g., organizations or countries) share the same measurement model. However, such models are less applicable when researchers are interested in obtaining classes of individuals who share the same measurement model across hierarchical units and to obtain hierarchical latent classes (LCs). The authors present the multilevel mixed-measurement item response theory (MMM-IRT) model as an alternative. This model yields classes of individuals with a common measurement model that spans across hierarchical units. In addition, hierarchical units are classified together to the extent that they share similar proportions of individual-level classes. The authors illustrate the MMM-IRT model with data on self-reported emotions from 121,740 individuals across 116 countries where four individual classes and five country classes were found. Theoretical and methodological implications concerning cross-cultural, multilevel, and measurement equivalence research are discussed.
Adler, N.J. ( 1983). Cross-cultural management research: The ostrich and the trend. Academy of Management Review, 8, 226-232.
2.
Akaike, H. ( 1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716-723.
3.
Allenby, G.M., & Rossi, P.E. ( 1999). Marketing models of consumer heterogeneity. Journal of Econometrics, 89, 57-78.
4.
Allport, G.W. ( 1962). The general and the unique in psychological science. Journal of Personality, 30, 405-422.
5.
Bijmolt, T.H., Paas, L.J., & Vermunt, J.K. ( 2004). Country and consumer segmentation: Multi-level latent class analysis of financial product ownership. International Journal of Research in Marketing, 21, 323-340.
6.
Bozdogan, H. ( 1987). Model selection for Akaike’s information criteria . Psychometrika, 53, 345-370.
7.
Bozdogan, H. ( 1993). Choosing the number of component clusters in the mixture-model using a new informational complexity criterion of the inverse-Fisher information matrix. In O. Opitz, B. Lausen, & R. Klar (Eds.), Studies in classification, data analysis, and knowledge organization. Heidelberg, Germany: Springer-Verlag.
8.
Cantril, H. ( 1965). The pattern of human concerns. New Brunswick, NJ: Rutgers University Press.
9.
Chan, D. ( 1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83, 234-246.
10.
Chao, G.T., & Moon, H. ( 2005). The cultural mosaic: A metatheory for understanding the complexity of culture. Journal of Applied Psychology, 90, 1128-1140.
11.
Cheung, F.M., Leung, K., Zhang, J.X., Sun, H.F., Gan, Y.Q., Song, W.Z., & Xie, D. ( 2001). Indigenous Chinese personality constructs: Is the five factor model complete? Journal of Cross-Cultural Psychology , 32, 407-433.
12.
Cheung, G.W., & Rensvold, R.W. (1999). Testing factorial invariance across groups: A reconceptualization and proposed new method. Journal of Management, 25, 1-27.
13.
Cho, S.-J., & Cohen, A.S. ( 2010). A multilevel mixture IRT model with applications to DIF . Journal of Educational and Behavioral Statistics, 35, 336-370.
14.
Church, A.T., Katigbak, M.S., Reyes, J.A.S., & Jensen, S.M. ( 1999). The structure of affect in a non-Western culture: Evidence for cross-cultural comparability. Journal of Personality, 67, 505-534.
15.
Cooke, R.A., & Szumal, J.L. ( 2000). Using the Organizational Culture Inventory to understand the operating cultures of organizations. In N. M. Ashkanasy, C. P. M. Wilderom , & M. F. Peterson (Eds.), Handbook of organizational culture and climate (pp. 147-162). Thousand Oaks, CA: SAGE.
16.
Cortina, L.M., & Wasti, S.A. ( 2005). Profiles in coping: Responses to sexual harassment across persons, organizations, and cultures. Journal of Applied Psychology , 90, 182-192.
De Ayala, R.J., Kim, S.-H., Stapleton, L.M., & Dayton, C.M. ( 2002). Differential item functioning: A mixture distribution conceptualization. International Journal of Testing, 2, 243-276.
19.
De Fruyt, F. ( 2002). A person-centered approach to P-E fit questions using a multiple-trait model. Journal of Vocational Behavior, 60, 73-90.
20.
Drasgow, F. ( 1984). Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables. Psychological Bulletin, 95, 134-135.
21.
Drasgow, F. ( 1987). Study of measurement bias of two standardized psychological tests. Journal of Applied Psychology, 72, 19-29.
22.
Eid, M., & Diener, E. ( 2001). Norms for experiencing emotions in different cultures: Inter- and intranational differences. Journal of Personality and Social Psychology, 81, 869-885.
23.
Eid, M., & Rauber, M. ( 2000). Detecting measurement invariance in organizational surveys . European Journal of Psychological Assessment, 16, 20-30.
24.
Fox, J.-P., & Glas, C.A.W. ( 2001). Bayesian estimation of a multilevel IRT model using Gibbs sampling. Psychometrika, 66, 269-286.
25.
Gelfand, M.J. ( 2000). Cross-cultural industrial and organizational psychology: Introduction to the special issue. Applied Psychology: An International Review, 49, 29-31.
26.
Gelfand, M.J., Raver, J.L., & Holcombe Ehrhart, K. (2002). Methodological issues in cross-cultural organizational research. In S. Rogelberg (Ed.), Handbook of industrial and organizational psychology research methods (pp. 216-246). New York, NY: Blackwell.
27.
Glick, W.H. ( 1985). Conceptualizing and measuring organizational and psychological climate: Pitfalls in multilevel research. Academy of Management Review, 10, 601-616.
28.
Green, D.P., Goldman, S.L., & Salovey, P. ( 1993). Measurement error masks bipolarity in affect ratings . Journal of Personality and Social Psychology, 64, 1029-1041.
29.
Hagenaars, J.A., & McCutcheon, A.L. (2002). Applied latent class analysis . Cambridge, UK: Cambridge University Press.
30.
Hannerz, U. ( 1992). Cultural complexity: Studies in the social organization of meaning. New York, NY: Columbia University Press.
31.
Harrison, D.A., Price, K.H., & Bell, M.P. ( 1998). Beyond relational demography: Time and the effects of surface- and deep-level diversity on work group cohesion. Academy of Management Journal, 41, 96-107.
32.
Hermans, H.J.M., & Kempen, H.J.G. (1998). Moving cultures: The perilous problems of cultural dichotomies in a globalizing society. American Psychologist, 53, 1111-1120.
33.
Hernandez, A., Drasgow, F., & Gonzalez-Roma, V. (2004). Investigating the functioning of a middle category by means of a mixed-measurement model. Journal of Applied Psychology, 89, 687-699.
34.
Hofstede, G.H. ( 1984). Culture’s consequences: International differences in work-related values (abridged ed.). Beverly Hills, CA : SAGE.
Klein, K.J., Dansereau, F., & Hall, R.J. ( 1994). Levels issues in theory development, data collection, and analysis. Academy of Management Review, 19, 195-229.
37.
Klein, K.J., & Kozlowski, S.W.J. (2000). From micro to meso: Critical steps in conceptualizing and conducting multilevel research. Organizational Research Methods, 3, 211-236.
38.
Kozlowski, S.W.J., & Klein, K.J. ( 2000). A multilevel approach to theory and research in organizations . In K. J. Klein, & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 3-90). San Francisco, CA: Jossey-Bass.
39.
Kruskal, J.B., & Wish, M. ( 1978). Multidimensional scaling. Beverly Hills, CA: SAGE.
40.
Larsen, R.J., & Diener, E. ( 1985). A multitrait-multimethod examination of affect structure: Hedonic level and emotional intensity. Personality and Individual Differences, 6, 631-636.
41.
Lord, F.M., & Novick, M.R. ( 1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
42.
Lubke, G.H., & Muthén, B. (2005). Investigating population heterogeneity with factor mixture models. Psychological Methods , 10, 21-39.
43.
Lukociene, O., Varriale, R., & Vermunt, J.K. ( 2010). The simultaneous decision about the number of lower-and higher-level classes in multilevel latent class analysis. Sociological Methodology, 40, in press.
44.
Lukociene, O., & Vermunt, J.K. ( 2010). Determining the number of components in mixture models for hierarchical data. In A. Fink, L. Berthold, W. Seidel, & A. Ultsch (Eds.), Advances in data analysis, data handling and business intelligence. Berlin, Germany: Heidelberg.
45.
Magidson, J., & Vermunt, J.K. ( 2004). Latent class models. In D. Kaplan (Ed.), Handbook of quantitative methodology for the social sciences (pp. 175-198). Newbury Park, CA: SAGE.
46.
Maij-de Meij, A.M., Kelderman, H., & van der Flier, H. (2005). Latent-trait latent-class anlaysis of self-disclosure in the work environment. Multivariate Behavioral Research, 40, 435-459.
47.
Maij-de Meij, A.M., Kelderman, H., & van der Flier, H. (2008). Fitting a mixture item response theory model to personality questionnaire data: Characterizing latent classes and investigating possibilities for improving prediction. Applied Psychological Measurement, 32, 611-631.
48.
Markus, H.R., & Kitayama, S. ( 1991). Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review, 98, 224-253.
49.
Matsumoto, D., & Yoo, S.H. ( 2006). Toward a new generation of cross-cultural research. Perspectives on Psychological Science, 1, 234-250.
50.
McCrae, R.R., & Costa, J.P.T. ( 1987). Validation of the five-factor model of personality across instruments and observers. Journal of Personality and Social Psychology, 52, 81-90.
51.
Meade, A.W., & Kroustalis, C.M. (2006). Problems with item parceling for confirmatory factor analytic tests of measurement invariance. Organizational Research Methods, 9, 369-403.
52.
Meehl, P.E. ( 1992). Factors and taxa, traits and types, differences of degree and differences in kind. Journal of Personality, 60, 117-174.
53.
Mesquita, B., & Walker, R. ( 2003). Cultural differences in emotions: A context for interpreting emotional experiences. Behavioral Research and Therapy, 41, 777-793.
54.
Miller, J.G. ( 1997). Theoretical issues in cultural psychology. In J. W. Berry, Y. H. Poortinga , & J. Pandey (Eds.), Handbook of cross-cultural psychology (Vol. 1, pp. 85-128). Boston, MA: Allyn & Bacon.
55.
Morgeson, F.P., & Hofmann, D.A. ( 1999). The structure and function of collective constructs: Implications for multilevel research and theory development. Academy of Management Journal, 24, 249-265.
56.
Muthén, B., & Muthén, L.K. (2000). Integrating person-centered and variable-centered analyses: Growth mixture modeling with latent trajectory classes. Alcoholism: Clinical and Experimental Research, 24, 882-891.
57.
Muthén, B., & Muthén, L.K. (2007). Mplus version 5.2 [Computer Program]. Los Angeles, CA: Muthén & Muthén.
58.
Muthén, L.K., & Muthén, B. (1998-2007). Mplus user’s guide (5th ed.). Los Angeles, CA: Muthén & Muthén .
59.
Newman, D.A., Hanges, P.J., Duan, L., & Ramesh, A. ( 2008). A network model of organizational climate: Friendship clusters, subgroup agreement, and climate schemas. In D. B. Smith (Ed.), The people make the place: A festschrift for Benjamin Schneider (pp. 101-126). New York, NY: Lawrence Erlbaum.
60.
O’Reilly, C.A. III. , Chatman, J., & Caldwell , D. (1991). People and organizational culture: A profile comparison approach to assessing person-organization fit. Academy of Management Journal, 34, 487-516.
61.
Poortinga, Y.H., & Van Hemert, D.A. (2001). Personality and culture: Demarcating between the common and the unique. Journal of Personality, 69, 1033-1060.
62.
Rabe-Hesketh, S., Pickles, A., & Skrondal, A. ( 2001). GLLAMM: A general class of multilevel models and a Stata program. Multilevel Modelling Newsletter, 13, 17-23.
63.
Raudenbush, S.W., & Bryk, A.S. ( 2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: SAGE.
64.
Riordan, C.M., & Vandenberg, R.J. (1994). A central question in cross-cultural research: Do employees of different cultures interpret work-related measures in an equivalent manner? Journal of Management, 20, 643-671.
65.
Roberts, K.H., Hulin, C.L., & Rousseau, D.M. (1978). Developing an interdisciplinary science of organizations. San Francisco, CA: Jossey-Bass.
66.
Rost, J. ( 1990). Rasch model in latent classes: An integration of two approaches to item analysis. Applied Psychological Measurement , 14, 271-282.
67.
Rost, J. ( 1991). A logistic mixture distribution model for polychotomous item responses. British Journal of Mathematical and Statistical Psychology, 44, 75-92.
68.
Rost, J., Carstensen, C., & von Davier, M. (1997). Applying the mixed Rasch model to personality questionnaires. In J. Rost, & R. Langeheine (Eds.), Applications of latent trait and latent class models in the social sciences . Munster, Germany: Waxman.
Russell, J.A. ( 1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39, 1161-1178.
71.
Russell, J.A. ( 1983). Pancultural aspects of the human conceptual organization of emotions. Journal of Personality and Social Psychology , 45, 1281-1288.
72.
Russell, J.A. ( 1991). Culture and the categorization of emotions. Psychological Bulletin, 110, 426-450.
73.
Russell, J.A., & Feldman Barrett, L. (1999). Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant . Journal of Personality and Social Psychology, 76, 805-819.
74.
Russell, J.A., Lewicka, M., & Niit, T. ( 1989). A cross-cultural study of a circumplex model of affect . Journal of Personality and Social Psychology, 57, 848-856.
75.
Schein, E.H. ( 1992). Organizational culture and leadership: A dynamic view . San Francisco, CA: Jossey-Bass .
76.
Schmitt, N., Oswald, F.L., Kim, B.H., Imus, A., Merritt, S., Friede, A., & Shivpuri, S. ( 2007). The use of background and ability profiles to predict college student outcomes. Journal of Applied Psychology, 92, 165-179.
77.
Schwarz, G.E. ( 1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464.
78.
Skrondal, A., & Rabe-Hesketh, S. (2004). Generalized latent variable modeling: Multilevel, longitudinal and structural equation models. London, England: Chapman & Hall.
79.
Smit, J.A., Kelderman, H., & Van der Flier, H. (2000). The mixed Birnbaum model: Estimation using collateral information. Methods of Psychological Research, 5, 1-13.
80.
Spearman, C. ( 1904). General intelligence, objectively determined and measured . American Journal of Psychology, 15, 201-293.
81.
Steenkamp, J.-B.E.M., & Ter Hofstede, F. (2002). International market segmentation: Issues and perspectives. International Journal of Research in Marketing, 19, 185-213.
82.
Tay, L., Newman, D.A., & Vermunt, J.K.Using mixed-measurement item response theory with covariates (MM-IRT-C) to ascertain observed and unobserved measurement equivalence. Organizational Research Methods. Prepublished April 29, 2010, DOI:10.1177/1094428110366037
83.
Tay, L., Woo, S.E., Klafehn, J., & Chiu, C.-Y. ( 2009). Conceptualizing and measuring culture: Problems and solutions . In E. Tucker, M. Viswanathan, & G. Walford (Eds.), The handbook of measurement: How social scientists generate, modify, and validate indicators and scales. Thousand Oaks, CA: SAGE.
84.
Thayer, R.E. ( 1978). Toward a psychological theory of multidimensional activation (arousal). Motivation and Emotion, 2, 1-34.
85.
The Gallup Organization. (2009, August 28). Gallup world poll: Methodology. Retrieved August 28, 2009, from http://www.gallup.com/consulting/worldpoll/108079/Methodological-Design.aspx
86.
Vandenberg, R.J. ( 2002). Toward a further understanding of and improvement in measurement invariance methods and procedures. Organizational Research Methods, 5, 139-158.
87.
Vandenberg, R.J., & Lance, C.E. ( 2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-70.
Vermunt, J.K. ( 2008a). Latent class and finite mixture models for multilevel data sets. Statistical Methods in Medical Research, 17, 33-51.
90.
Vermunt, J.K. ( 2008b). Multilevel latent variable modeling: An application in education testing. Austrian Journal of Statistics, 37, 285-299.
91.
Vermunt, J.K., & Magidson, J. ( 2005a). Latent GOLD 4.0 [Computer Program]. Belmont, MA: Statistical Innovations Inc.
92.
Vermunt, J.K., & Magidson, J. ( 2005b). Technical guide for Latent GOLD 4.0: Basic and advanced . Belmont, MA: Statistical Innovations Inc.
93.
Vermunt, J.K., & Magidson, J. ( 2000). Latent GOLD 4.0 user manual. Belmont, MA: Statistical Innovations Inc.
94.
Vermunt, J.K., & Magidson, J. ( 2008). LG-Syntax user’s guide: Manual for Latent GOLD 4.5 syntax module. Belmont, MA: Statistical Innovations Inc.
95.
Wasti, S.A., Bergman, M.E., Glomb, T.M., & Drasgow, F. ( 2000). Test of the cross-cultural generalizability of a model of sexual harassment. Journal of Applied Psychology, 85, 766-778.
96.
Watson, D., & Tellegen, A. ( 1985). Toward a consensual structure of mood. Psychological Bulletin, 98, 219-235.
97.
Wedel, M. ( 2002). Introduction to the special issue on market segmentation . International Journal of Research in Marketing, 19, 181-183.
98.
Wedel, M., & Kamakura, W. ( 2000). Market segmentation: Conceptual and methodological foundations (2nd ed.). Dordrecht, The Netherlands: Kluwer.
99.
Wedel, M., Kamakura, W., Arora, N., Bemmaor, A., Chiang, J., & Elrod, T. . . . Carsten, S. ( 1999). Discrete and continuous representations of unobserved heterogeneity in choice modeling. Marketing Letters, 10, 219-232.
100.
Weiss, H.M., & Cropanzano, R. (1996). Affective events theory: A theoretical discussion of the structure, causes and consequences of affective experiences at work. Research in Organizational Behavior, 19, 1-74.
101.
Yammarino, F.J., & Bass, B.M. ( 1991). Person and situation views of leadership: A multiple levels of analysis approach. Leadership Quarterly, 2, 121-139.
102.
Yik, M.S.M., & Russell, J.A. ( 2003). Chinese affect circumplex: I. Structure of recalled momentary affect. Asian Journal of Social Psychology, 6, 185-200.
103.
Zickar, M.J., Gibby, R.E., & Robie, C. ( 2004). Uncovering faking samples in applicant, incumbent, and experimental data sets: An application of mixed-model item response theory . Organizational Research Methods, 7, 168-190.
