Recent developments in the literature provide us with a better understanding of the importance of and procedures for testing measurement equivalence in organizational research. However, whereas many constructs in organizational research are multidimensional and multifaceted, procedures for testing the measurement equivalence of higher-order constructs are not commonly known. This study first discusses the importance of examining the measurement equivalence of higher-order constructs from a theoretical perspective, and then demonstrates that importance with a small-scale simulation. Finally, the procedures for testing various forms of measurement equivalence with structural equation modeling for both firstand second-order constructs are clarified and illustrated with a numerical example.
Avolio, B.J., Bass, B.M., & Jung, D.I. (1999). Re-examining the components of transformational and transactional leadership using the Multifactor Leadership Questionnaire . Journal of Occupational and Organizational Psychology, 72, 441-462.
2.
Bagozzi, R.P., & Heatherton, T.F. (1994). A general approach to representing multifaceted personality constructs: Applications to state self-esteem. Structural Equation Modeling, 1, 35-67.
3.
Bies, R.J., & Moag, J.S. (1986). Interactional justice: Communication criteria of fairness. In R. J. Lewicki, B. H. Sheppard, & M. H. Bazerman (Eds.), Research on negotiation in organizations (Vol. 1, pp. 43-55). Greenwich, CT : JAI.
4.
Bollen, K.A. (1989). Structural equations with latent variables. New York: John Wiley & Sons.
5.
Brislin, R.W., Lonner, W., & Thorndike, R.M. (1973). Cross-cultural research methods. New York: John Wiley & Sons.
6.
Byrne, B.M. (1994). Testing for the factorial validity, replication, and invariance of a measurement instrument: A paradigmatic application based on the Maslach Burnout Inventory. Multivariate Behavioral Research, 29, 289-311.
7.
Byrne, B.M., & Baron, P., & Campbell, T.L. (1993). Measuring adolescent depression: Factorial validity and invariance of the Beck Depression Inventory across gender. Journal of Research on Adolescence, 3, 127-143.
8.
Byrne, B.M., & Campbell, T.L. (1999). Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface. Journal of Cross-Cultural Psychology , 30, 555-574.
9.
Byrne, B.M., Shavelson, R.J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466.
Cheung, G.W., & Rensvold, R.B. (1999). Testing factorial invariance across groups: A reconceptualization and proposed new method. Journal of Management, 25, 1-27.
12.
Cheung, G.W., & Rensvold, R.B. (2002). Evaluating goodness-of-fit indices for testing measurement equivalence. Structural Equation Modeling, 9, 233-255.
13.
Cui C. C., & Adams, E.I. (2002). National identity and NATID: An assessment in Yemen. International Marketing Review, 19, 637-662.
14.
Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
15.
Cronbach, L.J., Gleser, G.C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability scores and profiles. New York: John Wiley.
16.
Drasgow, F., & Kanfer, R. (1985). Equivalence of psychological measurement in heterogeneous populations. Journal of Applied Psychology, 70, 662-680.
17.
Edwards, J.R. (2001). Multidimensional constructs in organizational behavior research: An integrative analytical framework. Organizational Research Methods, 4, 144-192.
18.
Fiedler, F.E., & Garcia, J.E. (1987). New approaches to effective leadership. New York: Wiley.
19.
Jackson, P., Wall, T., Martin, R., & Davids, K. (1993). New measures of job control, cognitive demand, and production responsibility. Journal of Applied Psychology , 78, 753-762.
20.
Hackman, J.R., & Oldham, G.R. (1980). Work redesign. Reading, MA : Addison-Wesley.
21.
Horn, J.L., & McArdle, J.J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research , 18, 117-144.
22.
Houghton, J.D., Bonham, T.W., Neck, C.P., & Singh, K. (2004). The relationship between self-leadership and personality: A comparison of hierarchical factor structures. Journal of Managerial Psychology, 19, 427-441.
23.
Janssens, M., Brett, J.M., & Smith, F.J. (1995). Confirmatory cross-cultural research: Testing the viability of a corporation-wide safety policy. Academy of Management Journal, 38, 364-382.
24.
Jöreskog, K., & Sörbom, D. (1996). LISREL 8: User's reference guide. Chicago: Scientific Software International.
25.
Laroche, M., Kalamas, M., Cheikhrouhou, S., & Cézard, A. (2004). An assessment of the dimensionality of should and will service expectations. Canadian Journal of Administrative Sciences, 21, 361-375.
26.
Laroche, M., Kim, C., Tomiuk, M.A., & Bélisle, D. (2005). Similarities in Italian and Greek multidimensional ethnic identity: Some implications for food consumption. Canadian Journal of Administrative Sciences, 22, 143-167.
27.
Law, K.S., Wong, C., & Mobley, W.H. (1998). Toward a taxonomy of multidimensional constructs . Academy of Management Review, 23, 741-755.
28.
Liden, R.C., & Maslyn, J.M. (1998). Multidimensionality of leader-member exchange: An empirical assessment through scale development. Journal of Management, 24, 43-72.
29.
Little, T.D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76.
30.
Maitland, S.B., Herlitz, A., Nyberg, L., Bäckman, L., & Nilsson, L. (2004). Selective sex differences in declarative memory . Memory and Cognition, 32, 1160-1169.
31.
Marsh, H.W. (1993). The multidimensional structure of academic self-concept: Invariance over gender and age. American Educational Research Journal, 30, 41-860.
32.
Marsh, H.W., & Hocevar, D. (1985). Application of confirmatory factor analysis to the study of self-concept: First- and higher-order factor models and their invariance across groups. Psychological Bulletin, 97, 562-582.
33.
Meade, A.W., & Lautenschlager, G.J. (2004). A comparison of IRT and CFA methodologies for establishing measurement equivalence. Organizational Research Methods, 7, 361-388.
34.
Meredith, W. (1993). Measurement equivalence, factor analysis and factorial equivalence. Psychometrika, 58, 525-543.
35.
Meyer, J., Allen, N., & Smith, C. (1993). Commitment to organizations and occupations: Extension and test of a three-component conceptualization. Journal of Applied Psychology, 78, 538-551.
36.
Moorman, R.H. (1991). Relationship between organizational justice and organizational citizenship behaviors: Do fairness perceptions influence employee citizenship? Journal of Applied Psychology, 76, 845-855.
37.
Mullen, M.R. (1995). Diagnosing measurement equivalence in cross-national research. Journal of International Business Studies, 26, 573-596.
38.
Pentz, M.A., & Chou, C. (1994). Measurement invariance in longitudinal clinical research assuming change from development and intervention. Journal of Consulting and Clinical Psychology, 62, 450-462.
39.
Reise, S.P., Widaman, K.F., & Pugh, R.H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552-566.
40.
Rensvold, R.B., & Cheung, G.W. (2001). Testing for metric invariance using structural equation models: Solving the standardization problem. In Schriesheim, C. A., & Neider, L. L. (Eds.), Equivalence in measurement (Ch. 3). Greenwich, CT: Information Age Publishing.
41.
Rosen, M. (1995). Gender differences in structure, means, and variances of hierarchically ordered ability dimensions. Learning and Instruction, 5, 37-62.
42.
Schneider, R.J., Hough, L.M., & Dunnette, M.D. (1996). Broadsided by broad traits: How to sink science in five dimensions or less. Journal of Organizational Behavior, 17, 639-655.
43.
Shemwell, D.J., & Yavas, U. (1999). Measuring service quality in hospitals: Scale development and managerial applications. Journal of Marketing Theory and Practice, 7, 65-75.
44.
Singh, J. (1995). Measurement issues in cross-national research . Journal of International Business Studies, 26, 597-619.
45.
Steenkamp, J.E.M., & Baumgartner, H. (1998). Assessing measurement equivalence in cross-national consumer research. Journal of Consumer Research , 25, 78-90.
46.
Vandenberg, R.J. (2002). Toward a further understanding of and improvement in measurement equivalence methods and procedures. Organizational Research Methods, 5, 139-158.
47.
Vandenberg, R.J., & Lance, C.E. (2000). A review and synthesis of the measurement equivalence literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-69.
48.
Williams, L.J., & Anderson, S.E. (1991). Job satisfaction and organizational commitment as predictors of organizational citizenship and in-role behaviors . Journal of Management, 17, 601-617.
