This article presents a psychometric approach for extracting normative information from multidimensional forced-choice (MFC) formats while retaining the method's faking-resistant property. The approach draws on concepts from Coombs's unfolding models and modern item response theory to develop a theoretical model of the judgment process used to answer MFC items, which is then used to develop a scoring system that provides estimates of normative trait standings.
Anderson, C. D., Warner, J. L.,& Spencer, C. C. (1984). Inflation bias in self-assessment examinations: Implications for valid employee selection. Journal of Applied Psychology, 69, 574-580.
2.
Andrich, D. (1996). A general hyperbolic cosine latent trait model for unfolding polytomous responses: Reconciling Thurstone and Likert methodologies. British Journal of Mathematical and Statistical Psychology, 49, 347-365.
3.
Barrick, M. R., & Mount, M. K. (1991). The Big-Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
4.
Barrick, M. R., & Mount, M. K. (1996). Effects of impression management and self-deception on the predictive validity of personality constructs. Journal of Applied Psychology, 81, 261-272.
5.
Bartram, D. (1996). The relationship between ipsatized and normative measures of personality. Journal of Occupational and Organizational Psychology, 69, 25-39.
6.
Block, J. (1957). A comparison between ipsative and normative ratings of personality. Journal of Abnormal & Social Psychology, 54, 50-54.
7.
Bennett, J. F., & Hays, W. L. (1960). Multidimensional unfolding: Determining the dimensionality of ranked preference data. Psychometrika, 25, 27-43.
8.
Boudreau, J. W.,& Rynes, S. L. (1985). Role of recruitment in staffing utility analysis. Journal of Applied Psychology, 70, 354-366.
9.
Christiansen, N. D., Edelstein, S., & Flemming, B. (1998, April). Reconsidering forced-choice formats for applicant personality assessment. Paper presented at the 13th Annual Conference of the Society of Industrial and Organizational Psychology, Dallas, TX.
10.
Closs, S. J. (1996). On the factoring and interpretation of ipsative data. Journal of Occupational and Organizational Psychology, 69, 41-47.
11.
Coombs, C. H. (1950). Psychological scaling without a unit of measurement. Psychological Review, 57, 145-158.
12.
Coombs, C. H. (1964). A theory of data. New York: Wiley.
13.
Cornwell, J. M., & Dunlop, W. P. (1994). On the questionable soundness of factoring ipsative data: A response to Saville & Wilson. Journal of Occupational and Organizational Psychology, 67, 89-100.
14.
Costa, P. T.,& McCrae, R. R. (1992). Revised NEO Personality Inventory (NEO-PI-R) and NEO Five Factor Inventory (NEO-FFI) professional manual. Odessa, FL: Psychological Assessment Resources.
15.
Digman, J. M., & Inouye, J. (1986). Further specification of the five robust factors of personality. Journal of Personality and Social Psychology, 50, 116-123.
16.
Douglas, E. F., McDaniel, M. A., & Snell, A. F. (1996, August). The validity of non-cognitive measures decays when applicants fake. Paper presented at the annual meeting of the Academy of Management, Cincinnati, OH.
17.
Drasgow, F., Levine, M. V.,& Zickar, M. J. (1996). Optimal identification of mismeasured individuals. Applied Measurement in Education, 9, 47-64.
18.
Ellingson, J. E., Sackett, P. R.,& Hough, L. (1999). Social desirability corrections in personality measurement: Issues of applicant comparison and construct validity. Journal of Applied Psychology, 84, 155-166.
19.
Ghiselli, E. E.,& Barthol, R. P. (1953). The validity of personality inventories in the selection of employees. Journal of Applied Psychology, 37, 18-20.
20.
Goldberg, L. R. (1990). An alternative description of personality: The Big-Five factor structure. Journal of Personality and Social Psychology, 59, 1216-1229.
21.
Gordon, L. V. (1951). Validities of the forced-choice and questionnaire methods of personality measurement. Journal of Applied Psychology, 35, 407-412.
22.
Guion, R. M., & Gottier, R. F. (1965). Validity of personality measures in personnel selection. Personnel Psychology, 18, 135-164.
23.
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
24.
Hays, W. L., & Bennett, J. F. (1961). Multidimensional unfolding: Determining configuration from complete rank order preference data. Psychometrika, 26, 221-238.
25.
Heggestad, E. D., Morrison, M., Reeve, C. L., & McCloy, R. A. (2004). Forced-choice assessments for selection: Evaluating issues of normative assessment and faking resistance. Unpublished manuscript.
26.
Hicks, L. E. (1970). Some properties of ipsative, normative, and forced-choice normative measures. Psychological Bulletin, 74, 167-184.
27.
Hogan, R., & Hogan, J. (1992). Hogan Personality Inventory manual. Tulsa, OK: Hogan Assessment Systems.
28.
Hogan, R., Hogan, J.,& Roberts, B. W. (1996). Personality measurement and employment decisions. American Psychologist, 51, 469-477.
29.
Hough, L. M. (1996, April). Personality measurement and personnel selection: Implementation issues. Paper presented at the 11th Annual Meeting of the Society of Industrial and Organizational Psychology, San Diego, CA.
30.
Hough, L. M. (1997, April). Issues and evidence: Use of personality variables for predicting job performance. Paper presented at the 12th Annual Meeting of the Society of Industrial and Organizational Psychology, St. Louis, MO.
31.
Hough, L. M. (1998). Effects of intentional distortion in personality measurement and evaluation of suggested palliatives. Human Performance, 11, 209-244.
32.
Hough, L. M., Eaton, N. K., Dunnette, M. D., Kamp, J. D., & McCloy, R. A. (1990). Criterionrelated validities of personality constructs and the effect of response distortion on those validities. Journal of Applied Psychology, 75, 581-595.
33.
Hough, L. M., & Oswald, F. L. (2000). Personnel selection: Looking toward the future— Remembering the past. Annual Review of Psychology, 51, 631-664.
34.
Hough, L. M.,& Schneider, R. J. (1996). Personality traits, taxonomies, and applications in organizations. In K. R. Murphy (Ed.), Individual differences and behavior in organizations(pp. 31-38). San Francisco: Jossey-Bass.
35.
Jackson, D. N., Wrobleski, V. R.,& Ashton, M. C. (2000). The impact of faking on employment tests: Does forced-choice offer a solution?Human Performance, 13, 371-388.
36.
Johnson, C. E., Wood, R., & Blinkhorn, S. F. (1988). Spuriouser and spuriouser: The use of ipsative personality tests. Journal of Occupational Psychology, 61, 153-162.
37.
Mueller-Hanson, R., Heggestad, E. D., & Thornton, G. C., III. (2003). Faking and selection: Considering the use of personality from a select-in and a select-out perspective. Journal of Applied Psychology, 88, 348-355.
38.
Murphy, K. R. (1986). When your top choice turns you down: Effects of rejected offers on utility of selection tests. Psychological Bulletin, 99, 133-138.
39.
Ones, D. S., Viswesvaran, C., & Korbin, W. P. (1995, May). Meta-analyses of fakability estimates: Between-subjects versus within-subjects designs. Paper presented at the 10th Annual Meeting of the Society of Industrial and Organizational Psychology, Orlando, FL.
40.
Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679.
41.
Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance [Monograph]. Journal of Applied Psychology, 78, 679-703.
42.
Pannone, R. D. (1984). Predicting test performance: A content valid approach to screening applicants. Personnel Psychology, 37, 507-514.
43.
Perry, D. K. (1955). Forced-choice vs. L-I-D response items in vocational interest measurement. Journal of Applied Psychology, 39, 256-262.
44.
Roberts, J. S., Donoghue, J. R.,& Laughlin, J. E. (2000). A general item response theory model for unfolding unidimensional polytomous responses. Applied Psychological Measurement, 24, 3-32.
45.
Roberts, J. S., Laughlin, J. E., & Wedell, D. H. (1999). Validity issues in the Likert and Thurstone approaches to attitude measurement. Educational and Psychological Measurement, 59, 211-233.
46.
Rosse, J. G., Stecher, M. D., Miller, J. L.,& Levin, R. (1998). The impact of response distortion on preemployment personality testing and hiring decisions. Journal of Applied Psychology, 83, 634-644.
47.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34, 100-100.
48.
Sisson, D. (1948). Forced-choice: The new Army rating. Personnel Psychology, 1, 365-381.
49.
Smith, D. B.,& Ellingson, J. E. (2002). Substance versus style: Anewlook at social desirability in motivating contexts. Journal of Applied Psychology, 87, 211-219.
50.
Smith, D. B., Hanges, P. J., & Dickson, M. W. (2001). Personnel selection and the five-factor model: Reexamining the effects of applicant's frame of reference. Journal of Applied Psychology, 86, 304-315.
51.
Tett, R. P., Jackson, D. N.,& Rothstein, M. (1991). Personality measures as predictors of job performance: A meta-analytic review. Personnel Psychology, 44, 703-742.
52.
Thurstone, L. L. (1927). Alawof comparative judgement. Psychological Review, 34, 273-286.
53.
Tupes, E. C.,& Christal, R. E. (1992). Recurrent personality factors based on trait ratings. Journal of Personality, 60, 225-251.
54.
Villanova, P., Bernardin, H. J., Johnson, D. L., & Dahmus, S. A. (1994). The validity of a measure of job compatibility in the prediction of job performance and turnover of motion picture theater personnel. Personnel Psychology, 47, 73-90.
55.
White, L. A.,& Young, M. C. (1998, August). Development and validation of the Assessment of Individual Motivation (AIM).Paper presented at the annual meeting of the American Psychological Association, San Francisco, CA.
56.
Worthington, D. L., & Schlottmann, R. S. (1986). The predictive validity of subtle and obvious empirically derived psychology test items under faking conditions. Journal of Personality Assessment, 50, 171-181.
57.
Wright, S. S.,& Miederhoff, P. A. (1999). Selecting students with personal characteristics relevant to pharmaceutical care. American Journal of Pharmaceutical Education, 63, 132-138.
58.
Zerbe, W. J.,& Paulhus, D. L. (1987). Socially desirable responding in organizational behavior: A reconception. Academy of Management Review, 12, 250-264.
59.
Zickar, M. J. (2000). Modeling faking on personality tests. In D. Ilgen & C. L. Hulin (Eds.), Computational modeling of behavioral processes in organizations(pp. 95-108). Washington, DC: American Psychological Association.
60.
Zickar, M. J., & Drasgow, F. (1996). Detecting faking on a personality instrument using appropriateness measurement. Applied Psychological Measurement, 20, 71-87.
61.
Zickar, M. J., Rosse, J. G., Levin, R. A.,& Hulin, C. L. (1996, April). Modeling the effects of faking on personality tests. Paper presented at the 11th Annual Meeting of the Society for Industrial and Organizational Psychology, San Diego, CA.
