This article describes how a multilevel logistic regression (MLR) approach to assessing person fit can be used to test hypotheses concerning faking on personality assessments. Item difficulty and person trait estimates obtained from a two-parameter logistic item response theory model are used to predict the probability of endorsing an item in a MLR equation. The regression slope for item difficulty reflects the extent to which the probability of endorsement decreases as item difficulty increases. Less negative slopes may indicate faking, and slope variance may be modeled with person-level variables using MLR. Two examples are presented. Example 1 models faking on a personality assessment with dichotomous items. Example 2 extends the approach to scales using polytomous items.
Anderson, C.D., Warner, J.L., & Spector, C.E. (1984). Inflation bias in self-assessment examination: Implications for valid employee selection. Journal of Applied Psychology, 69, 574-580.
2.
Barrick, M.R., & Mount, M.K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
3.
Bliese, P.D. (2002). Multilevel random coefficient modeling in organizational research: Examples using SAS and S-PLUS. In F. Drazgow & N. Schmitt (Eds.), Measuring and analyzing behavior in organizations: Advances in measurement and data analysis (pp. 401-445). San Francisco : Jossey-Bass.
4.
Bliese, P.D., & Ployhart, R.E. (2002). Growth modeling using random coefficient models: Model building, testing, and illustrations. Organizational Research Methods, 5, 362-387.
5.
Chernyshenko, O.S., Stark, S., Chan, K.Y., Drasgow, F., & Williams, B. (2001). Fitting item response theory models to two personality inventories: Issues and insights. Multivariate Behavioral Research, 36, 523-562.
6.
Douglas, E.F., McDaniel, M.A., & Snell, A.F. (1996). The validity of non-cognitive measures decays when applicants fake. In J. B. Keyes & L. N. Dosier (Eds.), Proceedings of the Academy of Management (pp. 127-131). Madison, WI : Omnipress.
7.
Drasgow, F., Levine, M.V., Tsien, S., Williams, B.A., & Mead, A.D. (1995). Fitting polytomous items response theory models to multiple-choice tests. Applied Psychological Measurement , 19, 143-165.
8.
Drasgow, F., Levine, M.V., & Zickar, M.J. (1996). Optimal detection of mismeasured individuals. Applied Measurement in Education, 9, 47-64.
9.
Goldberg, L.R. (1999, March 17). IPIP. Retrieved May 4, 2003, from http://ipip.ori.org/lew
10.
Levine, M.V. (1984). An introduction to multilinear formula score theory (Personnel and Training Research Programs, Office of Naval Research, Measurement Series No. 84-4). Arlington, VA: Personnel and Training Research Programs.
11.
McFarland, L.A., & Ryan, A.M. (2000). Variance in faking across noncognitive measures . Journal of Applied Psychology, 85, 812-821.
Ones, D.S., Viswesvaran, C., & Reiss, A.D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679.
14.
Raudenbush, S.W., & Bryk, A.S. (2002). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage.
Reise, S.P. (2000). Using multilevel regression to evaluate person-fit in IRT models. Multivariate Behavioral Research, 35, 543-568.
17.
Rosse, J.G., Stecher, M.D., Miller, J.L., & Levin, R.A. (1998). The impact of response distortion on preemployment personality testing and hiring decisions. Journal of Applied Psychology, 83, 634-644.
18.
Salgado, J.F. (1997). The five-factor model of personality and job performance in theEuropean community. Journal of Applied Psychology, 82, 30-43.
19.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement , 34(4), 100-114.
20.
Schmitt, N., Chan, D., Sacco, J.M., McFarland, L.A., & Jennings, D. (1999). Correlates of person fit and effect of person fit on test validity. Applied Psychological Measurement, 23, 41-53.
21.
Snijders, T.A.B., & Bosker, R.J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Thousand Oaks, CA: Sage.
22.
Tett, R.P., Jackson, D.N., & Rothstein, M. (1991). Personality measures as predictors of job performance: A meta-analytic review. Personnel Psychology, 44, 703-742.
Zickar, M.J. (2000). Modeling faking on personality tests. In D. R. Ilgen & C. L. Hulin (Eds.), Computational modeling of behavior in organizations: The third scientific discipline (pp. 95-113). Washington, DC : American Psychological Association.
25.
Zickar, M.J., & Drasgow, F. (1996). Detecting faking on a personality instrument using appropriate measurement. Applied Psychological Measurement , 20, 71-87.
26.
Zickar, M.J., & Robie, C. (1999). Modeling faking good on personality items: An item level analysis. Journal of Applied Psychology, 84, 551-563.
