Integrating Implicit and Explicit Social Cognitions for Enhanced Personality Assessment: A General Framework for Choosing Measurement and Statistical Methods
Restricted accessResearch articleFirst published online January, 2007
Integrating Implicit and Explicit Social Cognitions for Enhanced Personality Assessment: A General Framework for Choosing Measurement and Statistical Methods
The current article advocates integrating implicit and explicit social cognitions for enhanced personality assessment in organizational contexts (e.g., personnel selection settings). Several methods for measuring implicit cognitions are reviewed, and their strengths and limitations are discussed. The most widely used method for measuring explicit cognitions, the self-report questionnaire, also is described along with its strengths and limitations. Implicit and explicit cognitions then are integrated to form a general model of personality prototypes. The authors describe several mechanisms by which implicit and explicit cognitions may operate (e.g., coact, interact) to predict criteria, depending on the nature of the personality construct assessed and the outcome of interest. These different operations implicate different statistical methodologies. The authors then present specific examples of this integrative procedure for enhancing personality assessment using the construct of achievement motivation. They conclude by discussing how future research could extend and apply this general framework for use with other personality constructs.
Abramson, L. Y., Seligman, M. E., & Teasdale, J. D. (1978). Learned helplessness in humans: Critique and reformulation. Journal of Abnormal Psychology, 87, 49-74.
2.
Ackerman, P. L., & Heggestad, E. D. (1997). Intelligence, personality, and interests: Evidence for overlapping traits. Psychological Bulletin, 121, 219-245.
3.
Aguinis, H., Beaty, J. C., Boik, R. J., & Pierce, C. A. (2005). Effect size and power in assessing moderating effects of categorical variables using multiple regression: A 30-year review. Journal of Applied Psychology, 90, 94-107.
4.
Aiken, L. R. (1985). Psychological testing and assessment (5th ed.). Boston: Allyn & Bacon.
5.
Aiken, L. S., & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
6.
Arkes, H. R., & Tetlock, P. E. (2004). Attributions of implicit prejudice, or “Would Jesse Jackson ‘fail’ the implicit association test?”Psychological Inquiry, 15, 257-278.
7.
Atkinson, J. W. (1957). Motivational determinants of risk-taking behavior. Psychological Review, 64, 359-372.
8.
Atkinson, J. W. (1964). An introduction to motivation. Princeton, NJ: Van Nostrand.
9.
Atkinson, J. W., & Feather, N. T. (Eds.). (1966). A theory of achievement motivation. New York, NY: John Wiley & Sons.
10.
Bandura, A. (1982). Self-efficacy mechanism in human agency. American Psychologist, 37, 122-147.
11.
Bandura, A. (1986). Fearful expectations and avoidant actions as coeffects of perceived self-inefficacy. American Psychologist, 41, 1389-1391.
12.
Baron, R. M. & Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182.
13.
Barrick, M. R., & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta analysis. Personnel Psychology, 44, 1-26.
14.
Bedeian, A. G., & Mossholder, K. W. (1994). Simple question, not so simple answer: Interpreting interaction terms in moderated multiple regression. Journal of Management, 20, 159-165.
15.
Bentler, P. M., & Chou, C. P. (1987). Practical issues in structural modeling. Sociological Methods and Research, 16, 78-117.
16.
Bing, M. N., & Burroughs, S. M. (1999, April). The integrative model of personality assessment for aggression: Integrating self-reports with the conditional reasoning methodology. In S. Burroughs and L. Williams, New developments using conditional reasoning to measure human reliability. Symposium at the 14th annual SIOP conference, Atlanta, GA.
17.
Bing, M. N., Burroughs, S. M., Whanger, J. C., Green, P. D., & James, L. R. (2000, August). The integrative model of personality assessment for aggression: Implications for personnel selection and predicting deviant workplace behavior. In J. LeBreton and J. Binning, Recent issues and innovations in personality assessment. Symposium at the 108th annual conference of the American Psychological Association, Washington, DC.
18.
Bing, M. N., Davison, H. K., LeBreton, D. L., & LeBreton, J. M. (2002, April). Issues and improvements in tests of mediation. Seventeenth annual conference of the Society for Industrial and Organizational Psychology, Toronto, Ontario, Canada.
19.
Bing, M. N., & LeBreton, J. M. (2004, June). Distinguishing clinical depression from malingering: A feasibility study. Presentation to the Navy Research and Development Core Capabilities Program Review Panel for the Office of Naval Research and the Bureau of Medicine and Surgery.
20.
Bing, M. N., LeBreton, J. M., Migetz, D. Z., Vermillion, D. B., Davison, H. K., & James, L. R. (2001, April). The integrative model of personality assessment for achievement motivation and fear of failure: Implications for the prediction of effort, attribution, and performance. In J. LeBreton and J. Binning, Recent issues and innovations in personality assessment. Symposium at the 16th annual conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
21.
Bing, M. N., Whanger, J. C., Davison, H. K., & VanHook, J. B. (2004). Incremental validity of the frame-ofreference effect in personality scale scores: A replication and extension. Journal of Applied Psychology, 89, 150-157.
22.
Bornstein, R. F. (2002). A process dissociation approach to objective-projective test score interrelationships. Journal of Personality Assessment, 78, 47-68.
23.
Brendl, C. M., Markman, A. B., & Messner, C. (2001). How do indirect measures of evaluation work? Evaluating the inference of prejudice in the implicit association test. Journal of Personality and Social Psychology, 81, 760-773.
24.
Brewin, C. R. (1989). Cognitive change processes in psychotherapy. Psychological Review, 96, 379-394.
25.
Brewin, C. R., & Shapiro, D. (1984). Beyond locus of control: Attribution of responsibility for positive and negative outcomes. British Journal of Psychology, 75, 43-50.
26.
Brunstein, J. C., & Schmitt, C. H. (2004). Assessing individual differences in achievement motivation with the implicit association test. Journal of Research in Personality, 38, 536-555.
27.
Burger, J. M. (1985). Desire for control and achievement-related behaviors. Journal of Personality and Social Psychology, 48, 1520-1533.
28.
Champoux, J. E., & Peters, W. S. (1980). Applications of moderated regression in job design research. Personnel Psychology, 33, 759-783.
29.
Champoux, J. E., & Peters, W. S. (1987). Form, effect size, and power in moderated regression analysis. Journal of Occupational Psychology, 60, 243-255.
30.
Chaplin, W. F. (1991). The next generation of moderator research in personality psychology. Journal of Personality, 59, 143-178.
31.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
32.
Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
33.
Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Hillsdale, NJ: Lawrence Erlbaum.
34.
Cooper, W. H. (1983). An achievement motivation nomological network. Journal of Personality and Social Psychology, 44, 841-861.
35.
Corr, P. J., & Gray, J. A. (1995). Attributional style, socialization and cognitive ability as predictors of sales success: A predictive validity study. Personality and Individual Differences, 18, 241-252.
36.
Corr, P. J., & Gray, J. A. (1996). Attributional style as a personality factor in insurance sales performance in the UK. Journal of Occupational and Organizational Psychology, 69, 83-87.
37.
Cortina, J. M. (1993). Interaction, nonlinearity, and multicollinearity: Implications for multiple regression. Journal of Management, 19, 915-922.
38.
Cortina, J. M. & Folger, R. G. (1998). When is it acceptable to accept a null hypothesis: No way, Jose?Organizational Research Methods, 1, 334-350.
39.
Costa, P. T., Jr., & McCrae, R. R. (1992). NEO-PI-R professional manual. Odessa, FL: Psychological Assessment Resources.
40.
Cronbach, L. J., & Gleser, G. C. (1957). Psychological tests and personnel decisions. Urbana, IL: University of Illinois Press.
41.
Csikszentmihalyi, M. (1975). Beyond boredom and anxiety. San Francisco: Jossey-Bass.
42.
Day, D. V., & Silverman, S. B. (1989). Personality and job performance: Evidence of incremental validity. Personnel Psychology, 42, 25-36.
43.
Dweck, C. S., & Leggett, E. L. (1988). A social-cognitive approach to motivation and personality. Psychological Review, 95, 256-273.
44.
Edwards, J. R. (1993). Problems with the use of profile similarity indices in the study of congruence in organizational research. Personnel Psychology, 46, 641-665.
45.
Edwards, J. R., & Harrison, R. V. (1993). Job demands and worker health: Three-dimensional reexamination of the relationship between person-environment fit and strain. Journal of Applied Psychology, 78, 628-648.
46.
Edwards, J. R., & Parry, M. E. (1993). On the use of polynomial regression equations as an alternative to difference scores in organizational research. Academy of Management Journal, 36, 1577-1613.
47.
Egloff, B., Schwerdtfeger, A., & Schmukle, S. C. (2005). Temporal stability of the implicit association test— Anxiety. Journal of Personality Assessment, 84, 82-88.
48.
Epstein, S. (1994). Integration of the cognitive and the psychodynamic unconscious. American Psychologist, 49, 709-724.
49.
Equal Employment Opportunity Commission, Civil Service Commission, Department of Labor, & Department of Justice. (1978). Adoption of four agencies of uniform guidelines on employee selection procedures, 43 Fed. Reg. 38, 290-38, 315.
50.
Evans, M. G. (1985). A Monte Carlo study of the effects of correlated method variance in moderated multiple regression analysis. Organizational Behavior and Human Decision Processes, 36, 305-323.
51.
Fazio, R. H., & Olson, M. A. (2003). Implicit measures in social cognition research: Their meaning and uses. Annual Review of Psychology, 54, 297-327.
52.
Feather, N. T. (1961). The relationship of persistence at a task to expectation of success and achievement-related motives. Journal of Abnormal and Social Psychology, 63, 552-561.
53.
Finn, K. V., & Frone, M. R. (2004). Academic performance and cheating: Moderating role of school identification and self-efficacy. Journal of Educational Research, 97, 115-122.
54.
Furnham, A., Sadka, V., & Brewin, C. R. (1992). The development of an occupational attributional style questionnaire. Journal of Organizational Behavior, 13, 27-39.
55.
Garson, D. (2006). Structural equation modeling. Retrieved February 25, 2006, from http://www2.chass.ncsu.edu/garson/pa765/structur.htm.
56.
Gough, H. G., & Bradley, P. (1996). CPI manual (3rd ed.). Palo Alto, CA: Consulting Psychologists Press.
57.
Greenwald, A. G., & Banaji, M. R. (1995). Implicit social cognition: Attitudes, self-esteem, and stereotypes. Psychological Review, 102, 4-27.
58.
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74, 1464-1480.
59.
Herting, J. R. (2002). Evaluating and rejecting true mediation models: A cautionary note. Prevention Science, 3, 285-289.
60.
Hogan, R. (1991). Personality and personality measurement. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 2, pp. 873-919). Palo Alto, CA: Consulting Psychologists Press.
61.
Hogan, R. T., Hogan, J., & Roberts, B. W. (1996). Personality measurement and employment decisions: Questions and answers. American Psychologist, 51, 469-477.
62.
Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-98.
63.
Hurtz, G. M., & Donovan, J. J. (2000). Personality and job performance: The big five revisited. Journal of Applied Psychology, 85, 869-879.
64.
Ingerick, M., Cortina, J. M., Dudley, N. M., Margalit, D. L., Orvis, K. A., & Baughman, K. L. (2004, April). “Adapting” to a new measurement approach: Lessons learned from developing a conditional reasoning (CR) measure of adaptability. In S. B. Gustafson, Making conditional reasoning tests work: Reports from the frontier. Symposium at the 19th annual conference of the Society for Industrial and Organizational Psychology, Chicago, IL.
65.
Jaccard, J., & Wan, C. K. (1996). LISREL approaches to interaction effects in multiple regression. Thousand Oaks, CA: Sage.
66.
James, L. R. (1998). Measurement of personality via conditional reasoning. Organizational Research Methods, 1, 131-163.
67.
James, L. R., & Brett, J. M. (1984). Mediators, moderators, and tests for mediation. Journal of Applied Psychology, 69, 307-321.
68.
James, L. R., McIntyre, M. D., Glisson, C. A., Green, P. D., Patton, T. W., LeBreton, J. M., et al. (2005). A conditional reasoning measure for aggression. Organizational Research Methods, 8, 69-99.
69.
James, L. R., Mulaik, S. A., & Brett, J. M. (2006). A tale of two methods. Organizational Research Methods, 9, 233-244.
70.
Jones, S. C. (1973). Self and interpersonal evaluations: Esteem theories versus consistency theories. Psychological Bulletin, 79, 185-199.
71.
Karpinski, A., & Hilton, J. L. (2001). Attitudes and implicit association test. Journal of Personality and Social Psychology, 81, 774-788.
72.
Kehr, H. M. (2004). Integrating implicit motives, explicit motives, and perceived abilities: The compensatory model of work motivation and volition. Academy of Management Review, 29, 479-499.
73.
Lanyon, R. I., & Goodstein, L. D. (1997). Personality assessment (3rd ed.). Oxford: John Wiley & Sons.
74.
LeBreton, J. M., Barksdale, C. D., Robin, J. D., & James, L. R. (in press). Measurement issues associated with conditional reasoning tests of personality: Deception and faking. Journal of Applied Psychology.
75.
LeBreton, J. M., Binning, J. F., & Adorno, A. J. (2006). “Sub-clinical” psychopaths. In J. C. Thomas & D. Segal (Eds.), Comprehensive handbook of personality and psychopathology (Vol. 1, Personality and everyday functioning, pp. 388-411). New York: John Wiley and Sons.
76.
Lilienfeld, S. O., Wood, J. M., & Garb, H. N. (2000). The scientific status of projective techniques. Psychological Science in the Public Interest, 1, 27-66.
77.
Lundy, A. (1985). The reliability of the Thematic Apperception Test. Journal of Personality Assessment, 49, 141-145.
78.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002). On the practice of dichotomization of quantitative variables. Psychological Methods, 7, 19-40.
79.
Maqsud, M. (1997). Effects of metacognitive skills and nonverbal ability on academic achievement of high school pupils. Educational Psychology, 17, 387-397.
80.
Maxwell, S. E., & Delaney, H. D. (1993). Bivariate median splits and spurious statistical significance. Psychological Bulletin, 113, 181-190.
81.
McClelland, D. C. (1985). How motives, skills, and values determine what people do. American Psychologist, 40, 812-825.
82.
McClelland, D. C., & Boyatzis, R. E. (1982). Leadership motive pattern and long-term success in management. Journal of Applied Psychology, 67, 737-743.
83.
McClelland, D. C., Koestner, R., & Weinberger, J. (1989). How do self-attributed and implicit motives differ?Psychological Review, 96, 690-702.
84.
McClelland, G. H., & Judd, C. M. (1993). Statistical difficulties of detecting interactions and moderator effects. Psychological Bulletin, 114, 376-390.
85.
Mischel, W., & Shoda, Y. (1995). A cognitive-affective system theory of personality: Reconceptualizing situations, dispositions, dynamics, and invariance in personality structure. Psychological Review, 102, 246-268.
86.
Mitchell, T. R. (1982). Motivation: New directions for theory, research, and practice. Academy of Management Review, 7, 80-88.
87.
Morris, J. H., Sherman, J., & Mansfield, E. R. (1986). Failures to detect moderating effects with ordinary least squares moderated-regression: Some reasons and a remedy. Psychological Bulletin, 99, 282-288.
88.
Mount, M. K., & Barrick, M. R. (1995). The Big Five personality dimensions: Implications for research and practice in human resources management. In G. R. Ferris (Ed.), Research in personnel and human resources management (Vol. 13, pp. 153-200). Greenwich, CT: JAI.
89.
Murphy, K., & Myors, B. (1998). Statistical power analysis: A simple and general model for traditional and modern hypothesis tests. Mahwah, NJ: Erlbaum.
90.
Murray, H. A. (1938). Explorations in personality. New York: Oxford University Press.
91.
Murray, H. A. (1943). Thematic Apperception Test. Cambridge, MA: Harvard University Press.
92.
Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231-259.
93.
Nosek, B. A., Greenwald, A. G., & Banaji, M. R. (2005). Understanding and using the implicit association test: II. Method and construct validity. Personality and Social Psychology Bulletin, 31, 166-180.
94.
Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679.
95.
Patten, R. L., & White, L. A. (1977). Independent effects of achievement motivation and overt attribution on achievement behavior. Motivation and Emotion, 1, 39-59.
96.
Peterson, C., & Seligman, M. E. P. (1984). Causal explanations as a risk factor for depression: Theory and evidence. Psychological Review, 91, 347-374.
97.
Peterson, C., Semmel, A., von Baeyer, C., Abramson, L. Y., Metalsky, G. I., & Seligman, M. E. P. (1982). The Attributional Style Questionnaire. Cognitive Therapy and Research, 6, 287-300.
98.
Proudfoot, J. G., Corr, P. J., Guest, D. E., & Gray, J. A. (2001). The development and evaluation of a scale to measure occupational attributional style in the financial services sector. Personality and Individual Differences, 30, 259-270.
99.
Rorschach, H. (1921). Psychodiagnostics: A diagnostic test based on perception. New York: Grune & Stratton.
100.
Rosse, J. G., Stecher, M. D., Miller, J. L., & Levin, R. A. (1998). The impact of response distortion on preemployment personality testing and hiring decisions. Journal of Applied Psychology, 83, 634-644.
101.
Roth, P. L., & Clarke, R. L. (1998). Meta-analyzing the relationship between grades and salary. Journal of Vocational Behavior, 53, 386-400.
102.
Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274.
103.
Schmit, M. J., & Ryan, A. M. (1993). The Big Five in personnel selection: Factor structure in applicant and nonapplicant populations. Journal of Applied Psychology, 78, 966-974.
104.
Schneider, D., & Dorans, N. (1999). Concordance between SAT I and ACT scores for individual students. Research Notes (RN-07). New York: The College Board.
105.
Schulman, P., Seligman, M. E. P., & Amsterdam, D. (1987). The Attributional Style Questionnaire is not transparent. Behaviour Research and Therapy, 25, 391-395.
106.
Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93-105.
107.
Sechrest, L. (1963). Incremental validity: A recommendation. Educational and Psychological Measurement, 23, 153-158.
108.
Seligman, M. E. P., Abramson, L. Y., Semmel, A., & von Baeyer, C. (1979). Depressive attributional style. Journal of Abnormal Psychology, 88, 242-247.
109.
Seligman, M. E. P., & Schulman, P. (1986). Explanatory style as a predictor of productivity and quitting among life insurance sales agents. Journal of Personality and Social Psychology, 50, 832-838.
110.
Shaver, J. M. (2005). Testing for mediating variables in management research: Concerns, implications, and alternative strategies. Journal of Management, 31, 330-353.
111.
Smith, D. B., & Ellingson, J. E. (2002). Substance versus style: A new look at social desirability in motivating contexts. Journal of Applied Psychology, 87, 211-219.
112.
Spangler, W. D. (1992). Validity of questionnaire and TAT measures of need for achievement: Two meta-analyses. Psychological Bulletin, 112, 140-154.
113.
Stark, S., Chernyshenko, O. S., Chan, K.-Y., Lee, W. C., & Drasgow, F. (2001). Effects of the testing situation on item responding: Cause for concern. Journal of Applied Psychology, 86, 943-953.
114.
Steffens, M. C., & Konig, S. S. (2006). Predicting spontaneous Big Five behavior with implicit association tests. European Journal of Psychological Assessment, 22, 13-20.
115.
Steiner, D. D., & Gilliland, S. W. (1996). Fairness reactions to personnel selection techniques in France and the United States. Journal of Applied Psychology, 81, 134-141.
116.
Stone, E. F., & Hollenbeck, J. R. (1989). Clarifying some controversial issues surrounding statistical procedures for detecting moderator variables: Empirical evidence and related matters. Journal of Applied Psychology, 74, 3-10.
117.
Stone-Romero, E. F., & Anderson, L. E. (1994). Relative power of moderated multiple regression and the comparison of subgroup correlation coefficients for detecting moderating effects. Journal of Applied Psychology, 79, 354-359.
118.
Sweeney, P. D., Anderson, K., & Bailey, S. (1986). Attributional style in depression: A meta-analytic review. Journal of Personality and Social Psychology, 50, 974-991.
119.
Tett, R. P., Jackson, D. N., & Rothstein, M. (1991). Personality measures as predictors of job performance: A meta-analytic review. Personnel Psychology, 44, 703-742.
120.
Watson, G. & Glaser, E. M. (1980). Watson-Glaser Critical Thinking Appraisal. New York: Harcourt Brace Jovanovich.
121.
Weiner, B. (1979). A theory of motivation for some classroom experiences. Journal of Educational Psychology, 71, 3-25.
122.
Weiner, B. (1985). An attributional theory of achievement motivation and emotion. Psychological Review, 92, 548-573.
123.
Westen, D. (1998). The scientific legacy of Sigmund Freud: Toward a psychodynamically informed psychological science. Psychological Bulletin, 124, 333-371.
124.
Winter, D. G., John, O. P., Stewart, A. J., Klohnen, E. C., & Duncan, L. E. (1998). Traits and motives: Toward an integration of two traditions in personality research. Psychological Review, 105, 230-250.
125.
Winter, D. G., & Stewart, A. J. (1977). Power motivation as a function of retest instructions. Journal of Consulting and Clinical Psychology, 45, 436-440.
