Sage Journals: Discover world-class research

Abstract

The study of measurement equivalence has important implications for organizational research. Nonequivalence across groups or over time can affect the results of a study and the conclusions that are drawn from it. As a result, the review paper by Vandenberg & Lance (2000) has been highly cited and has played an important role in understanding the measurement of organizational constructs. However, that paper is now 20 years old, and a number of advances have been made in the application and interpretation of measurement equivalence (ME) since its publication. Therefore, the goal of the present paper is to provide an updated review of ME techniques that describes recent advances in testing for ME and proposes a taxonomy of potential sources of nonequivalence. Finally, we articulate recommendations for applying these newer methods and consider future directions for measurement equivalence research in the organizational literature.

Keywords

measurement equivalence invariance MIMIC MGCFA mixture model alignment bayesian

Get full access to this article

View all access options for this article.

References

Abrams

M. D.

Omarsdottir

A. O.

Björnsdóttir

M. D.

Einarsdottir

Martin

Carr

Brown

S. D.

Rector

, (2013). Measurement invariance of the career indecision profile: United States and Iceland. Journal of Career Assessment, 21(3), 469-482. https://doi.org/10.1177/1069072712475181

American Psychological Association. (2010). Publication manual of the APA (6th ed.). American Psychological Association.

Asparouhov

Muthén

(2014). Multiple-group factor analysis alignment. Structural Equation Modeling: A Multidisciplinary Journal, 21(4), 495-508. https://doi.org/10.1080/10705511.2014.919210

Baranik

L. E.

Lau

A. R.

Stanley

L. J.

Barron

K. E.

Lance

C. E.

(2013). Achievement goals in organizations: Is there support for mastery-avoidance? Journal of Managerial Issues, 25(1), 46-61. http://ezproxy.msu.edu/login?url=https://www.proquest.com/scholarly-journals/achievement-goals-organizations-is-there-support/docview/1504165275/se-2?accountid=12598

Belzak

W. C. M.

Bauer

D. J.

(2020). Improving the assessment of measurement invariance: Using regularization to select anchor items and identify differential item functioning. Psychological Methods. Advance online publication. https://doi.org/10.1037/met0000253.

Beus

J. M.

Jarrett

S. M.

Bergman

M. E.

Payne

S. C.

(2012). Perceptual equivalence of psychological climates within groups: When agreement indices do not agree Journal of Occupational and Organizational Psychology, 85(3), 454-471. https://doi.org/10.1111/j.2044-8325.2011.02049

Bobko

Roth

P. L.

Bobko

(2001). Correcting the effect size of d for range restriction and unreliability. Organizational Research Methods, 4(1), 46-61. https://doi.org/10.1177/109442810141003

Bollen

K. A.

(1989). Structural equations with latent variables. John Wiley.

Buyukgoze-Kavas

Autin

K. L.

(2019). Decent work in Turkey: Context, conceptualization, and assessment. Journal of Vocational Behavior, 112(1), 64-76. https://doi.org/10.1016/j.jvb.2019.01.006

10.

Bynum

B. H.

Hoffman

B. J.

Meade

A. W.

Gentry

W. A.

(2013). Reconsidering the equivalence of multisource performance ratings: Evidence for the importance and meaning of rater factors. Journal of Business and Psychology, 28(2), 203-219. https://doi.org/10.1007/s10869-012-9272-7

11.

Byrne

B. M.

(1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Erlbaum.

12.

Byrne

B. M.

Shavelson

R. J.

Muthén

(1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456-466. https://doi.org/10.1037/0033-2909.105.3.456

13.

Campbell

D. T.

Stanley

J. C.

(1963). Experimental and quasi-experimental designs for research. Houghton Mifflin Company.

14.

Cardon

M. S.

Stevens

C. E.

(2004). Managing human resources in small organizations: What do we know? Human Resource Management Review, 14(3), 295-323. https://doi.org/10.1016/j.hrmr.2004.06.001

15.

Chan

K. Y.

Drasgow

Sawin

L. L.

(1999). What is the shelf life of a test? The effect of time on the psychometrics of a cognitive ability test battery. Journal of Applied Psychology, 84(4), 610-619. https://doi.org/10.1037/0021-9010.84.4.610

16.

Chen

C. W.

(2014). Are workers more likely to be deviant than managers? A cross-national analysis. Journal of Business Ethics, 123(2), 221-233. https://doi.org/10.1007/s10551-013-1810-3

17.

Cheung

G. W.

Rensvold

R. B.

(1999). Testing factorial invariance across groups: A reconceptualization and proposed new method. Journal of Management, 25(1), 1-27. https://doi.org/10.1177/014920639902500101

18.

Cheung

G. W.

Rensvold

R. B.

(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255. https://doi.org/10.1207/S15328007SEM0902_5

19.

Chun

Stark

Kim

E. S.

Chernyshenko

O. S.

(2016). MIMIC Methods for detecting DIF among multiple groups: Exploring a new sequential-free baseline procedure. Applied Psychological Measurement, 40(7), 486-499. https://doi.org/10.1177/0146621616659738

20.

DeShon

R. P.

(2004). Measures are not invariant across groups without error variance homogeneity. Psychology Science, 46(1), 137-149.

21.

Detienne

K. B.

Detienne

D. H.

Joshi

S. A.

(2003). Neural networks as statistical tools for business researchers. Organizational Research Methods, 6(2), 236-265. https://doi.org/10.1177/1094428103251907

22.

Dheer

R. J.

Lenartowicz

Peterson

M. F.

(2015). Mapping India's Regional subcultures: Implications for international management. Journal of International Business Studies, 46(4), 443-467. https://doi.org/10.1057/jibs.2014.70

23.

Drasgow

(1984). Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables are the central issues. Psychological Bulletin, 95(1), 134-135. https://doi.org/10.1037/0033-2909.95.1.134

24.

Drasgow

Kang

(1984). Statistical power of differential validity and differential prediction analyses for detecting measurement nonequivalence. Journal of Applied Psychology, 69(3), 498-508. https://doi.org/10.1037/0021-9010.69.3.498

25.

Eagly

A. H.

Makhijani

M. G.

Klonsky

B. G.

(1992). Gender and the evaluation of leaders: A meta-analysis. Psychological Bulletin, 111(1), 3-22. https://doi.org/10.1037/0033-2909.111.1.3

26.

Feeney

J. R.

McCarthy

J. M.

Goffin

(2015). Applicant anxiety: Examining the sex-linked anxiety coping theory in job interview contexts. International Journal of Selection and Assessment, 23(3), 295-305. https://doi.org/10.1111/ijsa.12115

27.

Funk

C. A.

Arthurs

J. D.

Treviño

L. J.

Joireman

(2010). Consumer animosity in the global value chain: The effect of international production shifts on willingness to purchase hybrid products. Journal of International Business Studies, 41(4), 639-651. https://doi.org/10.1057/jibs.2009.29

28.

Gill

(2002). Bayesian Methods: A social and behavioral sciences approach. CRC press.

29.

González-Romá

Hernández

Gómez-Benito

(2006). Power and type I error of the mean and covariance structure analysis model for detecting differential item functioning in graded response items. Multivariate Behavioral Research, 41(1), 29-53. https://doi.org/10.1207/s15327906mbr4101_3

30.

Gunn

H. J.

Grimm

K. J.

Edwards

M. C.

(2020). Evaluation of six effect size measures of measurement: Non-invariance for continuous outcomes. Structural Equation Modeling: A Multidisciplinary Journal, 27(4), 503-514. https://doi.org/10.1080/10705511.2019.1689507

31.

Guo

Spina

(2019). Cross-cultural variations in extreme rejecting and extreme affirming response styles. Journal of Cross-Cultural Psychology, 50(8), 955-971. https://doi.org/10.1177/0022022119873072

32.

Harari

M. B.

Naemi

Viswesvaran

(2019). Is the validity of conscientiousness stable across time? Testing the role of trait bandwidth. Journal of Occupational and Organizational Psychology, 92(1), 212-220. https://doi.org/10.1111/joop.12241

33.

Heine

S. J.

(2015). Cultural psychology: Third international student edition. WW Norton & company.

34.

Heine

S. J.

Lehman

D. R.

Peng

Greenholtz

(2002). What's wrong with cross-cultural comparisons of subjective Likert scales?: The reference-group effect. Journal of Personality and Social Psychology, 82(6), 903-918. https://doi.org/10.1037/0022-3514.82.6.903

35.

Hirst

Budhwar

Cooper

B. K.

West

Long

Chongyuan

Shipton

(2008). Cross-cultural variations in climate for autonomy, stress and organizational productivity relationships: A comparison of Chinese and UK manufacturing organizations. Journal of International Business Studies, 39(8), 1343-1358. https://doi.org/10.1057/jibs.2008.50

36.

Hofmann

D. A.

Burke

M. J.

Zohar

(2017). 100 Years of occupational safety research: From basic protections and work analysis to a multilevel view of workplace safety and risk. Journal of Applied Psychology, 102(3), 375-388. https://doi.org/10.1037/apl0000114

37.

Hopwood

C. J.

Donnellan

M. B.

(2010). How should the internal structure of personality inventories be evaluated? Personality and Social Psychology Review, 14(3), 332-346. https://doi.org/10.1177/1088868310361240

38.

Horn

J. L.

McArdle

J. J.

(1992). A practical and theoretical guide to measurement invariance in aging research. Experimental aging research, 18(3), 117-144. https://doi.org/10.1080/03610739208253916

39.

Houkes

Winants

Y. H.

Twellaar

(2008). Specific determinants of burnout among male and female general practitioners: A cross-lagged panel analysis. Journal of Occupational and organizational Psychology, 81(2), 249-276. https://doi.org/10.1348/096317907X218197

40.

Pellegrini

E. K.

Scandura

T. A.

(2011). Measurement invariance in mentoring research: A cross-cultural examination across Taiwan and the US. Journal of Vocational Behavior, 78(2), 274-282. https://doi.org/10.1016/j.jvb.2010.10.003

41.

Hult

G. T. M.

Ketchen

D. J.

Griffith

D. A.

Finnegan

C. A.

Gonzalez-Padron

Harmancioglu

Huang

Talay

M. B.

Cavusgil

S. T.

(2008). Data equivalence in cross-cultural international business research: Assessment and guidelines. Journal of International Business Studies, 39(6), 1027-1044. https://doi.org/10.1057/palgrave.jibs.8400396

42.

Johnston

C. S.

Broonen

J. P.

Stauffer

S. D.

Hamtiaux

Pouyaud

Zecca

Houssemand

Rossier

(2013). Validation of an adapted French form of the Career Adapt-Abilities Scale in four Francophone countries. Journal of Vocational Behavior, 83(1), 1-10. https://doi.org/10.1016/j.jvb.2013.02.002

43.

Jang

Shen

Allen

T. D.

Zhang

(2018). Societal individualism-collectivism and uncertainty avoidance as cultural moderators of relationships between job resources and strain. Journal of Organizational Behavior, 39(4), 507-524. https://doi.org/10.1002/job.2253

44.

Johnson

E. C.

Meade

A. W.

DuVernet

A. M.

(2009). The role of referent indicators in tests of measurement invariance. Structural Equation Modeling, 16(4), 642-657. https://doi.org/10.1080/10705510903206014

45.

Kaplan

(2008). Structural equation modeling: Foundations and extensions (Vol. 10). Sage Publications.

46.

Keiser

H. N.

Sackett

P. R.

Kuncel

N. R.

Brothen

(2016). Why women perform better in college than admission scores would predict: Exploring the roles of conscientiousness and course-taking patterns. Journal of Applied Psychology, 101(4), 569-581. https://doi.org/10.1037/apl0000069

47.

Kim

E. S.

Cao

Wang

Nguyen

D. T.

(2017). Measurement invariance testing with many groups: A comparison of five approaches. Structural Equation Modeling: A Multidisciplinary Journal, 24(4), 524-544. https://doi.org/10.1080/10705511.2017.1304822

48.

Kim

E. S.

Joo

S.-H.

Lee

Wang

Stark

(2016). Measurement invariance testing across between-latent classes using multilevel factor mixture modeling. Structural Equation Modeling: A Multidisciplinary Journal, 23(6), 870-887. https://doi.org/10.1080/10705511.2016.1196108

49.

Kim

E. S.

Yoon

(2011). Testing measurement invariance: A comparison of multiple-group categorical CFA and IRT. Structural Equation Modeling, 18(2), 212-228. https://doi.org/10.1080/10705511.2011.557337

50.

King

D. D.

Ryan

A. M.

Kantrowitz

Grelle

Dainis

(2015). Mobile internet testing: An analysis of equivalence, individual differences, and reactions. International Journal of Selection and Assessment, 23(4), 382-394. https://doi.org/10.1111/ijsa.12122

51.

Kline

R. B.

(2016). Principles and practice of structural equation modeling (4th ed). The Guilford Press.

52.

Laguna

Mielniczuk

Razmus

Moriano

J. A.

Gorgievski

(2017). Cross-culture and gender invariance of the Warr (1990) job-related well-being measure. Journal of Occupational and Organizational Psychology, 90(1), 117-125. https://doi.org/10.1111/joop.12166

53.

Lakshman

Ramaswami

Alas

Kabongo

J. F.

Pandian

J. R.

(2014). Ethics trumps culture? A cross-national study of business leader responsibility for downsizing and CSR perceptions. Journal of Business Ethics, 125(1), 101-119. https://doi.org/10.1007/s10551-013-1907-8

54.

Lee

Connelly

B. S.

Goff

Hazucha

J. F.

(2017). Are assessment center behaviors’ meanings consistent across exercises? A measurement invariance approach. International Journal of Selection and Assessment, 25(4), 317-332. https://doi.org/10.1111/ijsa.12187

55.

Lee

Joo

S. H.

Stark

(2021). Detecting DIF in multidimensional forced choice measures using the Thurstonian item response theory model. Organizational Research Methods 24(4), 739–771. https://doi.org/10.1177/1094428120959822

56.

Leong

F. T.

(2016). Mapping cross-cultural psychology models and methods onto societal challenges: Focus on psychological mechanisms across levels of analysis. Journal of Cross-Cultural Psychology, 47(1), 28-32. https://doi.org/10.1177/0022022115618026

57.

W. D.

Schaubroeck

J. M.

Xie

J. L.

Keller

A. C.

(2018). Is being a leader a mixed blessing? A dual-pathway model linking leadership role occupancy to well-being. Journal of organizational Behavior, 39(8), 971-989. https://doi.org/10.1002/job.2273

58.

Lopez Rivas

G. E.

Stark

Chernyshenko

O. S.

(2009). The effects of referent item parameters on differential item functioning detection using the free baseline likelihood ratio test. Applied Psychological Measurement, 33(4), 251-265. https://doi.org/10.1177/0146621608321760

59.

Lubke

G. H.

Dolan

C. V.

(2003). Can unequal residual variances across groups mask differences in residual means in the common factor model? Structural Equation Modeling, 10(2), 175-192. https://doi.org/10.1207/S15328007SEM1002_1

60.

Lubke

G. H.

Muthén

(2005). Investigating population heterogeneity with factor mixture models. Psychological Methods, 10(1), 21-39. https://doi.org/10.1037/1082-989X.10.1.21

61.

MacCallum

R. C.

Browne

M. W.

Sugawara

H. M.

(1996). Power analysis and determination of sample size for covariance structure modeling. Psychological methods, 1(2), 130-149.

62.

MacCallum

R. C.

Zhang

Preacher

K. J.

Rucker

D. D.

(2002). On the practice of dichotomization of quantitative variables. Psychological methods, 7(1), 19-40. https://doi.org/10.1037/1082-989X.7.1.19

63.

Marais

Mostert

Rothmann

(2009). The psychometrical properties of translated versions of the maslach burnout inventory-general survey. SA Journal of Industrial Psychology, 35(1), 175-182.

64.

Marsh

H. W.

Guo

Parker

P. D.

Nagengast

Asparouhov

Muthén

Dicke

(2018). What to do when scalar invariance fails: The extended alignment method for multi-group factor analysis comparison of latent means across many groups. Psychological Methods, 23(3), 524-545. https://doi.org/10.1037/met0000113

65.

Marsh

H. W.

Muthén

Asparouhov

Lüdtke

Robitzsch

Morin

A. J.

Trautwein

(2009). Exploratory structural equation modeling, integrating CFA and EFA: Application to students’ evaluations of university teaching. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 439-476. https://doi.org/10.1080/10705510903008220

66.

Meade

A. W.

Johnson

E. C.

Braddy

P. W.

(2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93(3), 568-592. https://doi.org/10.1037/0021-9010.93.3.568

67.

Meade

A. W.

Wright

N. A.

(2012). Solving the measurement invariance anchor item problem in item response theory. Journal of Applied Psychology, 97(5), 1016-1031. https://doi.org/10.1037/a0027934

68.

Meng

X. L.

(1994). Posterior predictive p-values. The Annals of Statistics, 22(3), 1142-1160. https://doi.org/10.1214/aos/1176325622

69.

Meredith

(1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525-543. https://doi.org/10.1007/BF02294825

70.

Merritt

S. M.

(2012). The two-factor solution to allen and Meyer's (1990) affective commitment scale: Effects of negatively worded items. Journal of Business and Psychology, 27(4), 421-436. https://doi.org/10.1007/s10869-011-9252-3

71.

Millsap

R. E.

Kwok

O. M.

(2004). Evaluating the impact of partial factorial invariance on selection in two populations. Psychological Methods, 9(1), 93-115. https://doi.org/10.1037/1082-989X.9.1.93

72.

Morelli

N. A.

Mahan

R. P.

Illingworth

A. J.

(2014). Establishing the measurement equivalence of online selection assessments delivered on mobile versus nonmobile devices. International Journal of Selection and Assessment, 22(2), 124-138. https://doi.org/10.1111/ijsa.12063

73.

Mueller

Hattrup

Straatmann

(2011). Globally surveying in English: Investigation of the measurement equivalence of a job satisfaction measure across bilingual and native English speakers. Journal of Occupational and Organizational Psychology, 84(3), 618-624. https://doi.org/10.1348/096317910X493585

74.

Murphy

K. R.

(1997). What constitutes applied psychology? Journal of Applied Psychology, 82(1), 3-5. https://doi.org/10.1037/h0092448

75.

Murphy

K. R.

(2000). Impact of assessments of validity generalization and situational specificity on the science and practice of personnel selection. International Journal of Selection and Assessment, 8(4), 194-206. https://doi.org/10.1111/1468-2389.00149

76.

Muthén

Asparouhov

(2013). BSEM measurement invariance analysis. Mplus web notes, 17, 1-48. http://www.statmodel.com/examples/webnote.shtml

77.

Muthén

Asparouhov

(2018). Recent methods for the study of measurement invariance with many groups: Alignment and random effects. Sociological Methods & Research, 47(4), 637-664. https://doi.org/10.1177/0049124117701488

78.

Muthén

L. K.

Muthén

B. O.

(2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 9(4), 599-620. https://doi.org/10.1207/S15328007SEM0904_8

79.

Nguyen

H. H. D.

Ryan

A. M.

(2008). Does stereotype threat affect test performance of minorities and women? A meta-analysis of experimental evidence. Journal of Applied Psychology, 93(6), 1314-1334. https://doi.org/10.1037/a0012702

80.

Egri

Lin

C. Y. Y.

(2015). Patterns of corporate responsibility practices for high financial performance: Evidence from three Chinese societies. Journal of Business Ethics, 126(2), 169-183. https://doi.org/10.1007/s10551-013-1947-0

81.

Niranjan

Gupta

Goktan

B. A.

Cheung

Y. H.

Gunay

Pareek

(2013). Cultural value orientation: Measurement invariance in a multi-country sample. Journal of Managerial Issues, 25(3), 264-283. https://www.jstor.org/stable/43488821

82.

Nikolova

Van Ruysseveldt

De Witte

Syroit

(2014). Work-based learning: Development and validation of a scale measuring the learning potential of the workplace (LPW). Journal of Vocational Behavior, 84(1), 1-10. https://doi.org/10.1016/j.jvb.2013.09.004

83.

Nye

C. D.

Bradburn

Olenick

Bialko

Drasgow

(2019). How big are my effects? Examining the magnitude of effect sizes in studies of measurement equivalence. Organizational Research Methods, 22(3), 678-709. https://doi.org/10.1177/1094428118761122

84.

Nye

C. D.

Brummel

B. J.

Drasgow

(2010). Too good to be true? Understanding change in organizational outcomes. Journal of Management, 36(6), 1555-1577. https://doi.org/10.1177/0149206310376326

85.

Nye

C. D.

Drasgow

(2011a). Effect size indices for analyses of measurement equivalence: Understanding the practical importance of differences between groups. Journal of Applied Psychology, 96(5), 966-980. https://doi.org/10.1037/a0022955

86.

Nye

C. D.

Drasgow

(2011b). Assessing goodness of fit: Simple rules of thumb simply do not work. Organizational Research Methods, 14(3), 548-570. https://doi.org/10.1177/1094428110368562

87.

Nye

C. D.

Joo

S. H.

Zhang

Stark

(2020). Advancing and evaluating IRT model data fit indices in organizational research. Organizational Research Methods, 23(3), 457-486. https://doi.org/10.1177/1094428119833158

88.

Nye

C. D.

Newman

D. A.

Joseph

D. L.

(2010). Never say “always”? extreme item wording effects on scalar invariance and item response curves. Organizational Research Methods, 13(4), 806-830. https://doi.org/10.1177/1094428109349512

89.

Nylund

K. L.

Asparouhov

Muthén

B. O.

(2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling: A Multidisciplinary Journal, 14(4), 535-569. https://doi.org/10.1080/10705510701575396

90.

Maia

L. G.

Bastos

A. V. B.

Solinger

O. N.

(2016). Which factors make the difference for explaining growth in newcomer organizational commitment? A latent growth modeling approach. Journal of Organizational Behavior, 37(4), 537-557. https://doi.org/10.1002/job.2096

91.

Palocsay

S. W.

White

M. M.

(2004). Neural network modeling in cross-cultural research: A comparison with multiple regression. Organizational Research Methods, 7(4), 389-399. https://doi.org/10.1177/1094428104268030

92.

Pitariu

A. H.

Ployhart

R. E.

(2010). Explaining change: Theorizing and testing dynamic mediated longitudinal relationships. Journal of Management, 36(2), 405-429. https://doi.org/10.1177/0149206308331096

93.

Ployhart

R. E.

Oswald

F. L.

(2004). Applications of mean and covariance structure analysis: Integrating correlational and experimental approaches. Organizational Research Methods, 7(1), 27-65. https://doi.org/10.1177/1094428103259554

94.

Porfeli

E. J.

Lee

Weigold

I. K.

(2012). A multidimensional measure of work valences. Journal of Vocational Behavior, 80(2), 340-350. https://doi.org/10.1016/j.jvb.2011.09.004

95.

Pouliasi

Verkuyten

(2007). Networks of meaning and the bicultural mind: A structural equation modeling approach. Journal of Experimental Social Psychology, 43(6), 955-963. https://doi.org/10.1016/j.jesp.2006.10.005

96.

Powell

D. A.

Schafer

W. D.

(2001). The robustness of the likelihood ratio chi-square test for structural equation models: A meta-analysis. Journal of Educational and Behavioral Statistics, 26(1), 105-132. https://doi.org/10.3102/10769986026001105

97.

Preacher

K. J.

Coffman

D. L.

(2006, May). Computing power and minimum sample size for RMSEA [Computer software]. Available from http://quantpsy.org/.

98.

Presti

A. L.

Pace

Mondo

Nota

Casarubia

Ferrari

Betz

N. E.

(2013). An examination of the structure of the career decision self-efficacy scale (short form) among Italian high school students. Journal of Career Assessment, 21(2), 337-347. https://doi.org/10.1177/1069072712471506

99.

Putka

D. J.

Beatty

A. S.

Reeder

M. C.

(2018). Modern prediction methods: New perspectives on a common problem. Organizational Research Methods, 21(3), 689-732. https://doi.org/10.1177/1094428117697041

100.

Putnick

D. L.

Bornstein

M. H.

(2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71-90. https://doi.org/10.1016/j.dr.2016.06.004

101.

Raftery

A. E.

(1995). Bayesian model selection in social research. Sociological Methodology, 25, 111-163. https://www.jstor.org/stable/271063

102.

Raju

N. S.

Laffitte

L. J.

Byrne

B. M.

(2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87(3), 517-529. https://doi.org/10.1037/0021-9010.87.3.517

103.

Ralston, D. A., Egri, C. P., Furrer, O., Kuo, M. H., Li, Y., Wangenheim, F., Dabic, M., Naomova, I., Shimizu, K., de la Garza Xarranza M. T., Fu, P. P., Potocan, V. V., Pekerti, A., Lenartowicz, T., Srinivasan, N., Casado, T., Rossi, A. M., Szabo, E., Butt, A., … & M. Weber (2014). Societal-level versus individual-level predictions of ethical behavior: A 48-society study of collectivism and individualism. Journal of Business Ethics, 122(2), 283-306. https://doi.org/10.1007/s10551-013-1744-9

104.

Riordan

C. M.

Vandenberg

R. J.

(1994). A central question in cross-cultural research: Do employees of different cultures interpret work-related measures in an equivalent manner? Journal of Management, 20(3), 643-671. https://doi.org/10.1016/0149-2063(94)90007-8

105.

Rivas

Stark

G. E.

& Chernyshenko

(2009). The effects of referent item parameters on differential item functioning detection using the free baseline likelihood ratio test. Applied Psychological Measurement, 33(4), 251-265.

106.

Robert

Lee

W. C.

Chan

K. Y.

(2006). An empirical analysis of measurement equivalence with the indcol measure of individualism and collectivism: Implications for valid cross-cultural inference. Personnel Psychology, 59(1), 65-99. https://doi.org/10.1111/j.1744-6570.2006.00804.x

107.

Roche

M. K.

Carr

A. L.

Lee

I. H.

Wen

Brown

S. D.

(2017). Career indecision in China: Measurement equivalence with the United States and South Korea Journal of Career Assessment, 25(3), 526-536. https://doi.org/10.1177/1069072716651623

108.

Roth

P. L.

I. S.

Van Iddekinge

C. H.

Buster

M. A.

Robbins

S. B.

Campion

M. A.

(2014). Differential validity for cognitive ability tests in employment and educational settings: Not much more than range restriction? Journal of Applied Psychology, 99(1), 1-20. https://doi.org/10.1037/a0034377

109.

Rutkowski

Svetina

(2014). Assessing the hypothesis of measurement invariance in the context of large-scale international surveys. Educational and Psychological Measurement, 74(1), 31-57. https://doi.org/10.1177/0013164413498257

110.

Sackett

P. R.

Laczo

R. M.

Lippe

Z. P.

(2003). Differential prediction and the use of multiple predictors: The omitted variables problem. Journal of Applied Psychology, 88(6), 1046-1056. https://doi.org/10.1037/0021-9010.88.6.1046

111.

Sackett

P. R.

Yang

(2000). Correction for range restriction: An expanded typology. Journal of Applied Psychology, 85(1), 112-118. https://doi.org/10.1037/0021-9010.85.1.112

112.

Sajjadiani

Sojourner

A. J.

Kammeyer-Mueller

J. D.

Mykerezi

(2019). Using machine learning to translate applicant work history into predictors of performance and turnover. Journal of Applied Psychology, 104(10), 1207-1225. https://doi.org/10.1037/apl0000405

113.

Saris

W. E.

Satorra

(1993). Power evaluations in structural equation models. In Bollen

K. A.

Long

J. S.

(Eds.), Testing structural equation models (pp. 181-204. Sage.

114.

Sass

D. A.

Schmitt

T. A.

Marsh

H. W.

(2014). Evaluating model fit with ordered categorical data within a measurement invariance framework: A comparison of estimators. Structural Equation Modeling: A Multidisciplinary Journal, 21(2), 167-180. https://doi.org/10.1080/10705511.2014.882658

115.

Satorra

Bentler

P. M.

(2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75(2), 243-248. https://doi.org/10.1007/S11336-009-9135-Y

116.

Sánchez-Oliva

Morin

A. J.

Teixeira

P. J.

Carraça

E. V.

Palmeira

A. L.

Silva

M. N.

(2017). A bifactor exploratory structural equation modeling representation of the structure of the basic psychological needs at work scale. Journal of Vocational Behavior, 98, 173-187. https://doi.org/10.1016/j.jvb.2016.12.001

117.

Schmit

M. J.

Ryan

A. M.

(1993). The Big five in personnel selection: Factor structure in applicant and nonapplicant populations. Journal of Applied Psychology, 78(6), 966-974. https://doi.org/10.1037/0021-9010.78.6.966

118.

Schmitt

Ali

(2015). The practical importance of measurement invariance. In Lance

C. E.

Vandenberg

R. J.

(Eds.), More statistical and methodological myths and urban legends (pp. 327-346). Routledge.

119.

Schmitt

Kuljanin

(2008). Measurement invariance: Review of practice and implications. Human Resource Management Review, 18(4), 210-222. https://doi.org/10.1016/j.hrmr.2008.03.003

120.

Society for Industrial and Organizational Psychology, Inc. (2003). Principles for the validation and use of personnel selection procedures (4th ed.). Society for Industrial and Organizational Psychology, Inc.

121.

Spiegelhalter

D. J.

Best

N. G.

Carlin

B. P.

Van Der Linde

(2002). Bayesian Measures of model complexity and fit. Journal of the royal statistical society: Series b (statistical methodology), 64(4), 583-639. https://doi.org/10.1111/1467-9868.00353

122.

Stark

Chernyshenko

O. S.

Chan

K. Y.

Lee

W. C.

Drasgow

(2001). Effects of the testing situation on item responding: Cause for concern. Journal of Applied Psychology, 86(5), 943-953. https://doi.org/10.1037/0021-9010.86.5.943

123.

Stark

Chernyshenko

O. S.

Drasgow

(2006). Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified strategy. Journal of Applied Psychology, 91(6), 1292-1306. https://doi.org/10.1037/0021-9010.91.6.1292

124.

Stark

Chernyshenko

O. S.

Drasgow

Williams

B. A.

(2006). Examining assumptions about item responding in personality assessment: Should ideal point methods be considered for scale development and scoring? Journal of Applied Psychology, 91(1), 25-39. https://doi.org/10.1037/0021-9010.91.1.25

125.

Steele

C. M.

(1997). A threat in the air: How stereotypes shape intellectual identity and performance. American Psychologist, 52(6), 613-629. https://doi.org/10.1037/0003-066X.52.6.613

126.

Steenkamp

J. B. E.

Baumgartner

(1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25(1), 78-90. https://doi.org/10.1086/209528

127.

Tay

Liao

H.-Y.

Zhang

Rounds

(2019). Toward a dimensional model of vocational interests. Journal of Applied Psychology, 104(5), 690-714. https://doi.org/10.1037/apl0000373

128.

Tay

Drasgow

Rounds

Williams

B. A.

(2009). Fitting measurement models to vocational interest data: Are dominance models ideal? Journal of Applied Psychology, 94(5), 1287-1304. https://doi.org/10.1037/a0015899

129.

Tay

Meade

A. W.

Cao

(2015). An overview and practical guide to IRT measurement equivalence analysis. Organizational Research Methods, 18(1), 3-46. https://doi.org/10.1177/1094428114553062

130.

Tay

Newman

D. A.

Vermunt

J. K.

(2011). Using mixed-measurement item response theory with covariates (MM-IRT-C) to ascertain observed and unobserved measurement equivalence. Organizational Research Methods, 14(1), 147-176. https://doi.org/10.1177/1094428110366037

131.

Tay

Woo

S. E.

Vermunt

J. K.

(2014). A conceptual and methodological framework for psychometric isomorphism: Validation of multilevel construct measures. Organizational Research Methods, 17(1), 77-106. https://doi.org/10.1177/1094428113517008

132.

Thompson

(1994). Guidelines for authors. Educational and Psychological Measurement, 54, 837-847.

133.

Trongmateerut

Sweeney

J. T.

(2013). The influence of subjective norms on whistle-blowing: A cross-cultural investigation. Journal of Business Ethics, 112(3), 437-451. https://doi.org/10.1007/s10551-012-1270-1

134.

Valentova

(2013). Age and sex differences in gender role attitudes in Luxembourg between 1999 and 2008. Work, employment and society, 27(4), 639-657. https://doi.org/10.1177/0950017013481638

135.

Van Ruysseveldt

Proost

Verboon

(2011). The role of work-home interference and workplace learning in the energy-depletion process. Management Revue, 151-168. http://dx.doi.org/10.1688/1861-9908_mrev_2011_02_Ruysseveldt

136.

Vandenberg

R. J.

(2002). Toward a further understanding of and improvement in measurement invariance methods and procedures. Organizational research methods, 5(2), 139-158. https://doi.org/10.1177/1094428102005002001

137.

Vandenberg

R. J.

Lance

C. E.

(2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4-70. https://doi.org/10.1177/109442810031002

138.

Vandenberg

R. J.

Morelli

N. A.

(2016). A contemporary update on testing for measurement equivalence and invariance. In Meyer

J. P.

(Ed.), The handbook of employee commitment (pp. 449-461). Edward Elgar.

139.

Vecchione

Alessandri

Barbaranelli

(2013). Measurement and application of egoistic and moralistic self-enhancement. International Journal of Selection and Assessment, 21(2), 170-182. https://doi.org/10.1111/ijsa.12027

140.

West

S. G.

Taylor

A. B.

(2012). Model fit and model selection in structural equation modeling. In R. H. Hoyle (Ed.), Handbook of structural equation modeling (pp. 209-231). Guilford.

141.

Wilkinson

, & Task Force on Statistical Inference, American Psychological Association, Science Directorate (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54(8), 594-604. https://doi.org/10.1037/0003-066X.54.8.594

142.

Woods

C. M.

Cai

Wang

(2013). The Langer-improved Wald test for DIF testing with multiple groups: Evaluation and comparison to two-group IRT. Educational and Psychological Measurement, 73(3), 532-547. https://doi.org/10.1177/0013164412464875

143.

Woods

C. M.

Grimm

K. J.

(2011). Testing for nonuniform differential item functioning with multiple indicator multiple cause models. Applied Psychological Measurement, 35(5), 339-361. https://doi.org/10.1177/0146621611405984

144.

Wright

N. A.

Kutschenko

Bush

B. A.

Hannum

K. M.

Braddy

P. W.

(2015). Measurement and predictive invariance of a work–life boundary measure across gender. International Journal of Selection and Assessment, 23(2), 131-148. https://doi.org/10.1111/ijsa.12102

145.

Hou

Z.-J.

Tracey

T. J.

Zhang

(2016). Variations of career decision ambiguity tolerance between China and the United States and between high school and college. Journal of Vocational Behavior, 93, 120-128. https://doi.org/10.1016/j.jvb.2016.01.007

146.

Yang

(2014). Does ethical leadership lead to happy workers? A study on the impact of ethical leadership, subjective well-being, and life happiness in the Chinese culture. Journal of Business Ethics, 123(3), 513-525.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.24 MB

A Review of Measurement Equivalence in Organizational Research: What's Old,What's New,What's Next?

Abstract

Keywords

Get full access to this article

References

Supplementary Material