Retesting Personality in Employee Selection: Implications of the Context,Sample,and Setting

Abstract

The present study sought to assess when and how actual job applicants change their responses when filling out an unproctored personality selection assessment for a second time. It was predicted feedback would be a key contextual motivator associated with how much applicants change their answers during the second administration. Mediation results showed that individuals receiving feedback that showed a low score on the personality assessment was the reason they did not get the job were more likely to employ faking response strategies in the second testing session, predicting the highest change in scores between the first and second testing sessions. Individuals receiving no feedback and those not experimentally motivated to fake (i.e., a comparison group of students) showed less change in responses across administrations.

Get full access to this article

View all access options for this article.

References

Arthur

W. R.

Glaze

R. M.

Villado

A. J.

Taylor

J. E.

(2009) Unproctored Internet-based tests of cognitive ability and personality: magnitude of cheating and response distortion. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2(1), 39–45.

Barrick

M. R.

Mount

M. K.

(1991) The Big-five personality dimensions and job performance: a meta-analysis. Personnel Psychology, 44, 1–26.

Barrick

M. R.

Mount

M. K.

Judge

T. A.

(2001) Personality and performance at the beginning of the new millennium: what do we know and where do we go next? Personality and Performance, 9, 9–30.

Bartram

Brown

(2004) Information exchange article: online testing: mode of administration and the stability of OPQ 32i scores. International Journal of Selection and Assessment, 12(3), 278–284.

Bauer

T. N.

Maertz

C. P.

Jr. Dolen

M. R.

Campion

M. A.

(1998) Longitudinal assessment of applicant reactions to employment testing and test outcome feedback. Journal of Applied Psychology, 83(6), 892–903.

Berry

C. M.

Sackett

P. R.

(2009) Faking in personnel selection: tradeoffs in performance versus fairness resulting from two cut-score strategies. Personnel Psychology, 62(4), 835–863.

Birkeland

S. A.

Manson

T. M.

Kisamore

J. L.

Brannick

M. T.

Smith

M. A.

(2006) A meta-analytic investigation of job applicant faking on personality measures. International Journal of Selection and Assessment, 14(4), 317–335.

Brown

Bartram

Holtzhausen

Carstairs

Mylonis

(2005, April) Online personality and motivation testing: is unsupervised administration an issue? Paper presented at the 20th annual conference of the Society for Industrial and Organizational Psychology, Los Angeles, CA.

Chapman

D. S.

Webster

(2003) The use of technologies in the recruiting, screening, and selection processes for job candidates. International Journal of Selection and Assessment, 11(2-3), 113–120.

10.

Chmielewski

Watson

(2009) What is being assessed and why it matters: the impact of transient error on trait research. Journal of Personality & Social Psychology, 97(1), 186–202.

11.

Christiansen

N. D.

Burns

G. N.

Montgomery

G. E.

(2005) Reconsidering forced-choice item formats for applicant personality assessment. Human Performance, 18(3), 267–307.

12.

Ellingson

J. E.

Sackett

P. R.

Connelly

B. S.

(2007) Personality assessment across selection and development contexts: insights into response distortion. Journal of Applied Psychology, 92(2), 386–395.

13.

Ellingson

J. E.

Sackett

P. R.

Hough

L. M.

(1999) Social desirability corrections in personality measurement: issues of applicant comparison and construct validity. Journal of Applied Psychology, 84, 155–166.

14.

Ellingson

J. E.

Smith

Sackett

P. R.

(2001) Investigating the influence of social desirability on personality factor structure. Journal of Applied Psychology, 86(1), 122–133.

15.

Goldberg

L. R.

(1999) A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models. In Mervielde

Deary

Fruyt

F. D.

Ostendorf

(Eds.), Personality Psychology in Europe. Tilburg, The Netherlands: University Press. Pp. 7–28.

16.

Gray

C. D.

Kinnear

P. R.

(2012) IBM SPSS Statistics 19 Made Simple. Psychology Press: New York.

17.

Griffin

Hesketh

Grayson

(2004) Applicants faking good: evidence of item bias in the NEO PI–R. Personality and Individual Differences, 36(7), 1545–1558.

18.

Guion

R. M.

Gottier

R. F.

(1965) Validity of personality measures in personnel selection. Personnel Psychology, 18, 135–164.

19.

Guo

Drasgow

(2010) Identifying cheating on unproctored Internet tests: the Z-test and the Likelihood Ratio Test. International Journal of Selection and Assessment, 18(4), 351–364.

20.

Hampson

S. E.

Goldberg

L. R.

(2006) A first large cohort study of personality trait stability over the 40 years between elementary school and midlife. Journal of Personality & Social Psychology, 91(4), 763–779.

21.

Hartman

N. S.

Grubb

(2011) Deliberate faking on personality and emotional intelligence measures. Psychological Reports, 108(1), 120–138.

22.

Hausknecht

J. P.

(2010) Candidate persistence and personality test practice effects: implications for staffing system management. Personnel Psychology, 63(2), 299–324.

23.

Hogan

Barrett

Hogan

(2007) Personality measurement, faking, and employment selection. Journal of Applied Psychology, 92(5), 1270–1285.

24.

Holden

R. R.

Hibbs

(1995) Incremental validity of response latencies for detecting fakers on a personality test. Journal of Research in Personality, 29(3), 362–372.

25.

Holden

R. R.

Kroner

D. G.

Fekken

Popham

S. M.

(1992) A model of personality test item response dissimulation. Journal of Personality and Social Psychology, 63(2), 272–279.

26.

Hough

L. M.

(1998) The millennium for personality psychology: new horizons or good ole daze. Applied Psychology: An International Review, 47(2), 233–261.

27.

Jackson

D. N.

Wroblewski

V. R.

Ashton

M. C.

(2000) The impact of faking on employment tests: does forced choice offer a solution? Human Performance, 13(4), 371–388.

28.

Johnsen

Eid

Pallesen

Bartone

P. T.

Nissestad

O. A.

(2009) Predicting transformational leadership in Naval cadets: effects of personality hardiness and training. Journal of Applied Social Psychology, 39(9), 2213–2235.

29.

Komar

Brown

D. J.

Komar

J. A.

Robie

(2008) Faking and the validity of conscientiousness: a Monte Carlo investigation. Journal of Applied Psychology, 93(1), 140–154.

30.

Landers

R. N.

Sackett

P. R.

Tuzinski

K. A.

(2011) Retesting after initial failure, coaching rumors, and warnings against faking in online personality measures for selection. Journal of Applied Psychology, 96(1), 202–210.

31.

Leary

M. R.

Kowalski

R. M.

(1990) Impression management: a literature review and two-component model. Psychological Bulletin, 107(1), 34–47.

32.

Levy

P. E.

Thompson

D. J.

(in press) The role of feedback in organizations. In Sutton

Hornsey

Douglas

(Eds.), Feedback: the handbook of praise, criticism, and advice. New York: Peter Lang.

33.

Lönnqvist

Paunonen

Tuulio-Henriksson

Lönnqvist

Verkasalo

(2007) Substance and style in socially desirable responding. Journal of Personality, 75(2), 291–322.

34.

MacKinnon

D. P.

Lockwood

C. M.

Williams

(2004) Confidence limits for the indirect effect: distribution of the product and resampling methods. Multivariate Behavioral Research, 39(1), 99–128.

35.

McCrae

R. R.

Costa

P. T.

(1994) The stability of personality: observation and evaluations. Current Directions in Psychological Science, 3(6), 173–175.

36.

McFarland

L. A.

Ryan

(2000) Variance in faking across noncognitive measures. Journal of Applied Psychology, 85(5), 812–821.

37.

McFarland

L. A.

Ryan

Ellis

(2002) Item placement on a personality measure: effects on faking behavior and test measurement properties. Journal of Personality Assessment, 78(2), 348–369.

38.

Miller

C. E.

Barrett

G. V.

(2008) The coachability and fakability of personality-based selection tests used for police selection. Public Personnel Management, 37(3), 339–351.

39.

Morgeson

F. P.

Campion

M. A.

Dipboye

R. L.

Hollenbeck

J. R.

Murphy

Schmitt

(2007) Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60(3), 683–729.

40.

Mueller-Hanson

Heggestad

E. D.

Thornton

(2003) Faking and selection: considering the use of personality from select-in and select-out perspectives. Journal of Applied Psychology, 88(2), 348–355.

41.

Nunnally

J. C.

(1978) Psychometric theory. (2nd ed.) New York: McGraw Hill.

42.

Nye

C. D.

Drasgow

Fine

(2008) Two-step testing in employee selection: is score inflation a problem? International Journal of Selection and Assessment, 16(2), 112–120.

43.

Oldham

P. D.

(1962) A note on the analysis of repeated measurements of the same subjects. Journal of Chronic Diseases, 15(10), 969–977.

44.

Ones

D. S.

Dilchert

Viswesvaran

Judge

T. A.

(2007) In support of personality assessment in organizational settings. Personnel Psychology, 60(4), 995–1027.

45.

Ones

D. S.

Viswesvaran

Reiss

A. D.

(1996) Role of social desirability in personality testing for personnel selection: the red herring. Journal of Applied Psychology, 81(6), 660–679.

46.

Pauls

C. A.

Crost

N. W.

(2005) Effects of different instructional sets on the construct validity of the NEO-PI–R. Personality and Individual Differences, 39(2), 297–308.

47.

Peterson

M. H.

Griffith

R. L.

Converse

P. D.

(2009) Examining the role of applicant faking in hiring decisions: percentage of fakers hired and hiring discrepancies in single- and multiple-predictor selection. Journal of Business and Psychology, 24(4), 373–386.

48.

Preacher

K. J.

Hayes

A. F.

(2008) Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40, 879–891.

49.

Roberts

B. W.

DelVecchio

W. F.

(2000) The rank-order consistency of personality traits from childhood to old age: a quantitative review of longitudinal studies. Psychological Bulletin, 126(1), 3–25.

50.

Roberts

B. W.

Walton

K. E.

Viechtbauer

(2006) Patterns of mean-level change in personality traits across the life course: a meta-analysis of longitudinal studies. Psychological Bulletin, 132(1), 1–25.

51.

Robie

Brown

D. J.

Beaty

J. C.

(2007) Do people fake on personality inventories? A verbal protocol analysis. Journal of Business and Psychology, 21(4), 489–509.

52.

Robie

Komar

Brown

D. J.

(2010) The effects of coaching and speeding on Big-five and Impression Management Scale scores. Human Performance, 23(5), 446–467.

53.

Robie

Taggar

Brown

D. J.

(2009) The effects of warnings and speeding on scale scores and convergent validity of conscientiousness. Human Performance, 22(4), 340–354.

54.

Robinson

J. P.

Shaver

P. R.

Wrightsman

L. S.

(Eds.) (1991) Measures of personality and social psychological attitudes. San Diego: Academic Press.

55.

Rosse

J. G.

Stecher

M. D.

Miller

J. L.

Levin

R. A.

(1998) The impact of response distortion on pre-employment personality testing and hiring decisions. Journal of Applied Psychology, 83(4), 634–644.

56.

Schmit

M. J.

Ryan

A. M.

(1993) The Big-five in personnel selection: factor structure in applicant and nonapplicant populations. Journal of Applied Psychology, 78(6), 966–974.

57.

Sisco

Reilly

R. R.

(2007) Five-factor Biodata Inventory: resistance to faking. Psychological Reports, 101(1), 3–17.

58.

Templer

K. J.

Lange

S. R.

(2008) Internet testing: equivalence between proctored lab and unproctored field conditions. Computers in Human Behavior, 24(3), 1216–1228.

59.

Tippins

N. T.

Beaty

Drasgow

Gibson

W. M.

Pearlman

Segall

D. O.

Shepherd

(2006) Unproctored Internet testing in employment settings. Personnel Psychology, 59(1), 189–225.

60.

Vasilopoulos

N. L.

Cucina

J. M.

McElreath

J. M.

(2005) Do warnings of response verification moderate the relationship between personality and cognitive ability? Journal of Applied Psychology, 90(2), 306–322.

61.

Vasilopoulos

N. L.

Reilly

R. R.

Leaman

J. A.

(2000) The influence of job familiarity and impression management on self-report measure scale scores and response latencies. Journal of Applied Psychology, 85(1), 50–64.

62.

Viswesvaran

Ones

D. S.

(1999) Meta-analyses of fakability estimates: implications for personality measurement. Educational and Psychological Measurement, 59(2), 197–210.

63.

Young

M. C.

(2003) Effects of retesting on a new army measure of motivational attributes: implications for response distortion, test validity, and operational use. Paper presented at Annual Meeting of the International Public Management Association Assessment Council, Baltimore, MD.

64.

Zickar

M. J.

Robie

(1999) Modeling faking good on personality items: an item-level analysis. Journal of Applied Psychology, 84(4), 551–563.