Using Item Response Theory to Develop Measures of Acquisitive and Protective Self-Monitoring From the Original Self-Monitoring Scale

Abstract

For the past 40 years, the conventional univariate model of self-monitoring has reigned as the dominant interpretative paradigm in the literature. However, recent findings associated with an alternative bivariate model challenge the conventional paradigm. In this study, item response theory is used to develop measures of the bivariate model of acquisitive and protective self-monitoring using original Self-Monitoring Scale (SMS) items, and data from two large, nonstudent samples (Ns = 13,563 and 709). Results indicate that the new acquisitive (six-item) and protective (seven-item) self-monitoring scales are reliable, unbiased in terms of gender and age, and demonstrate theoretically consistent relations to measures of personality traits and cognitive ability. Additionally, by virtue of using original SMS items, previously collected responses can be reanalyzed in accordance with the alternative bivariate model. Recommendations for the reanalysis of archival SMS data, as well as directions for future research, are provided.

Keywords

self-monitoring acquisitive and protective self-monitoring item response theory Five-Factor Model metatraits plasticity and stability

Get full access to this article

View all access options for this article.

References

Allen

D. G.

Weeks

K. P.

Moffitt

K. R.

(2005). Turnover intentions and voluntary turnover: The moderating roles of self-monitoring, locus of control, proactive personality, and risk aversion. Journal of Applied Psychology, 90, 980-990. doi:10.1037/0021-9010.90.5.980

Arbuckle

J. L.

(2012). Amos (Version 22.0.0) [Computer software]. Chicago, IL: SPSS.

Barrick

M. R.

Parks

Mount

M. K.

(2005). Self-monitoring as a moderator of the relationships between personality traits and performance. Personnel Psychology, 58, 745-767. doi:10.1111/j.1744-6570.2005.00716.x

Bock

R. D.

Aitkin

(1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46, 443-459. doi:10.1007/BF02293801

Briggs

S. R.

Cheek

J. M.

(1988). On the nature of self-monitoring: Problems with assessment, problems with validity. Journal of Personality and Social Psychology, 54, 663-678. doi:10.1037/0022-3514.54.4.663

Briggs

S. R.

Cheek

J. M.

Buss

A. H.

(1980). An analysis of the self-monitoring scale. Journal of Personality and Social Psychology, 38, 679-686. doi:10.1037/0022-3514.38.4.679

Cai

Thissen

du Toit

S. H. C.

(2011). IRTPRO 2.1 for Windows [Computer software]. Chicago, IL: Scientific Software International.

Chapman

D. S.

Uggerslev

K. L.

Webster

(2003). Applicant reactions to face-to-face and technology-mediated interviews: A field investigation. Journal of Applied Psychology, 88, 944-953. doi:10.1037/0021-9010.88.5.944

Choi

S. W.

Gibbons

L. E.

Crane

P. K.

(2011). lordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39, 1-30.

10.

Conn

S. R.

Rieke

M. L.

(1994). The 16PF (Technical manual; 5th ed.). Champaign, IL: Institute for Personality and Ability Testing.

11.

Costa

P. T.

Jr. McCrae

R. R.

(1992). NEO PI-R (Professional manual). Odessa, FL: Psychological Assessment Resources.

12.

Côté

Lopes

P. N.

Salovey

Miners

C. T. H.

(2010). Emotional intelligence and leadership emergence in small groups. Leadership Quarterly, 21, 496-508. doi:10.1016/j.leaqua.2010.03.012

13.

Cronbach

L. J.

Meehl

P. E.

(1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302. doi:10.1037/h0040957

14.

Day

D. V.

Schleicher

D. J.

Unckless

A. L.

Hiller

N. J.

(2002). Self-monitoring personality at work: A meta-analytic investigation of construct validity. Journal of Applied Psychology, 87, 390-401. doi:10.1037/0021-9010.87.2.390

15.

de Ayala

R. J.

(2009). The theory and practice of item response theory. New York, NY: Guilford Press.

16.

DeYoung

C. G.

(2006). Higher-order factors of the Big Five in a multi-informant sample. Journal of Personality and Social Psychology, 91, 1138-1151. doi:10.1037/0022-3514.91.6.1138

17.

DeYoung

C. G.

Grazioplene

R. G.

Peterson

J. B.

(2012). From madness to genius: The Openness/Intellect trait domain as a paradoxical simplex. Journal of Research in Personality, 46, 63-78. doi:10.1016/j.jrp.2011.12.003

18.

Digman

J. M.

(1997). Higher-order factors of the Big Five. Journal of Personality and Social Psychology, 73, 1246-1256. doi:10.1037/0022-3514.73.6.1246

19.

Dorans

N. J.

Holland

P. W.

(1993). DIF detection and description: Mantel-Haenszel and standardization. In Holland

P. W.

Wainer

(Eds.), Differential item functioning (pp. 35-66). Hillsdale, NJ: Lawrence Erlbaum.

20.

Dunn

E. W.

Biesanz

J. C.

Human

L. J.

Finn

(2007). Misunderstanding the affective consequences of everyday social interactions: The hidden benefits of putting one’s best face forward. Journal of Personality and Social Psychology, 92, 990-1005. doi:10.1037/0022-3514.92.6.990

21.

Ellis

R. J.

(1988). Self-monitoring and leadership emergence in groups. Personality and Social Psychology Bulletin, 14, 681-693. doi:10.1177/0146167288144004

22.

Fraley

R. C.

Waller

N. G.

Brennan

K. A.

(2000). An item response theory analysis of self-report measures of adult attachment. Journal of Personality and Social Psychology, 78, 350-365. doi:10.1037//0022-3514.78.2.350

23.

Fuglestad

P. T.

Snyder

(2010). Status and the motivational foundations of self-monitoring. Social & Personality Psychology Compass, 4, 1031-1041. doi:10.1111/j.1751-9004.2010.00311.x

24.

Gangestad

S. W.

Simpson

J. A.

(1993). Development of a scale measuring genetic variation related to expressive control. Journal of Personality, 61, 133-158.

25.

Gangestad

S. W.

Snyder

(1985). “To carve nature at its joints”: On the existence of discrete class variables in personality. Psychological Review, 92, 317-349. doi:10.1037/0033-295X.92.3.317

26.

Gangestad

S. W.

Snyder

(1991). Taxometric analysis redux: Some statistical considerations for testing a latent class model. Journal of Personality and Social Psychology, 61, 141-146. doi:10.1037/0022-3514.61.1.141

27.

Gangestad

S. W.

Snyder

(2000). Self-monitoring: Appraisal and reappraisal. Psychological Bulletin, 126, 530-555. doi:10.1037/0033-2909.126.4.530

28.

Ghiselli

E. E.

Campbell

J. P.

Zedeck

(1981). Measurement theory for the behavioral sciences. San Francisco, CA: W. H. Freeman.

29.

Glas

C. A. W.

(1998). Detection of differential item functioning using Lagrange multiplier tests. Staistica Sinica, 8, 647-667.

30.

Glomb

T. M.

Liao

(2003). Interpersonal aggression in work groups: Social influence, reciprocal, and individual effects. Academy of Management Journal, 46, 486-496.

31.

Goldberg

L. R.

Johnson

J. A.

Eber

H. W.

Hogan

Ashton

M. C.

Cloninger

C. R.

Gough

H. G.

(2006). The International Personality Item Pool and the future of public-domain personality measures. Journal of Research in Personality, 40, 84-96. doi:0.1016/j.jrp.2005.08.007

32.

Hambleton

R. K.

(2006). Good practices for identifying differential item functioning. Medical Care, 44(Suppl. 3), S182-S188. doi:10.1097/01.mlr.0000245443.86671.c4

33.

Glas

C. A. W.

Kosinski

Stillwell

D. J.

Veldkamp

B. P.

(2014). Predicting self-monitoring skills using textual posts on Facebook. Computers in Human Behavior, 33, 69-78. doi:10.1016/j.chb.2013.12.026

34.

Jodoin

M. G.

Gierl

M. J.

(2001). Evaluating Type 1 error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329-349. doi:10.1207/S15324818AME1404_2

35.

John

O. P.

Cheek

J. M.

Klohnen

E. C.

(1996). On the nature of self-monitoring: Construct explication with Q-sort ratings. Journal of Personality and Social Psychology, 71, 763-776. doi:10.1037/0022-3514.71.4.763

36.

Kline

R. B.

(2005). Principles and practice of structural equation modeling. New York, NY: Guilford Press.

37.

Kosinski

Stillwell

Graepel

(2013). Private traits and attributes are predictable from digital records of human behavior. Proceedings of the National Academy of Sciences, 110, 5802-5805. doi:10.1073/pnas.1218772110

38.

Lennox

(1988). The problem with self-monitoring: A two-sided scale and a one-sided theory. Journal of Personality Assessment, 52, 58-73. doi:10.1207/s15327752jpa5201_5

39.

Lennox

R. D.

Wolfe

R. N.

(1984). Revision of the self-monitoring scale. Journal of Personality and Social Psychology, 46, 1349-1364.

40.

Lynam

D. R.

Sherman

E. D.

Samuel

Miller

J. D.

Few

L. R.

Widiger

T. A.

(2013). Development of a short form of the elemental psychopathy. Assessment, 20, 659-669. doi:10.1177/1073191113502072

41.

Magis

Beland

Raiche

(2013). difR: Collection of methods to detect dichotomous differential item functioning (DIF) in psychometrics (R package version 4.5). Retrieved from http://artax.karlin.mff.cuni.cz/r-help/library/difR/html/00Index.html

42.

Markon

K. E.

Krueger

R. F.

Watson

(2005). Delineating the structure of normal and abnormal personality: An integrative hierarchical approach. Journal of Personality and Social Psychology, 88, 139-157. doi:10.1037/0022-3514.88.1.139

43.

McDonald

R. P.

(1999). Test theory: A unified approach. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.

44.

Miell

le Voi

(1985). Self-monitoring and control in dyadic interactions. Journal of Personality and Social Psychology, 49, 1652-1661. doi:10.1037/0022-3514.49.6.1652

45.

Mullen

E. J.

Noe

R. A.

(1999). The mentoring information exchange: When do mentors seek information from their protégés? Journal of Organizational Behavior, 20, 233-242.

46.

O’Connor

B. P.

(2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32, 396-402. doi:10.3758/BF03200807

47.

Penfield

R. D.

Camilli

(2006). Differential item functioning and item bias. In Rao

C. R.

Sinharay

(Eds.), Handbook of statistics: Psychometrics (pp. 125-167). Amsterdam, Netherlands: Elsevier.

48.

R Development Core Team. (2015). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org

49.

Raven

J. C.

(2000) The Raven’s progressive matrices: Change and stability over culture and time. Cognitive Psychology, 41, 1-48.

50.

Reise

S. P.

Widaman

K. F.

Pugh

R. H.

(1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552-566. doi:10.1037/0033-2909.114.3.552

51.

Revelle

(2015). Procedures for psychological, psychometric, and personality research (User’s manual). Retrieved from http://www.personality-project.org/r

52.

Samejima

(1969). Estimation of latent ability using a response pattern of graded scores (Psychometric Monograph No. 17). Retrieved from https://www.psychometricsociety.org/sites/default/files/pdf/MN17.pdf

53.

Scherbaum

C. A.

Cohen-Charash

Kern

M. J.

(2006). Measuring general self-efficacy: A comparison of three measures using item response theory. Educational and Psychological Measurement, 66, 1047-1063. doi:10.1177/0013164406288171

54.

Scott

B. A.

Barnes

C. M.

Wagner

D. T.

(2012). Chameleonic or consistent? A multilevel investigation of emotional labor variability and self-monitoring. Academy of Management Journal, 55, 905-926.

55.

Simms

L. J.

(2008). Classical and modern methods of psychological scale construction. Social & Personality Psychology Compass, 2, 414-433. doi:10.1111/j.1751-9004.2007.00044.x

56.

Snyder

(1974). Self-monitoring of expressive behavior. Journal of Personality and Social Psychology, 30, 526-537. doi:10.1037/h0037039

57.

Snyder

(1987). Public appearances/private realities: The psychology of self-monitoring. New York, NY: W. H. Freeman.

58.

Snyder

Gangestad

(1986). On the nature of self-monitoring: Matters of assessment, matters of validity. Journal of Personality and Social Psychology, 51, 125-139. doi:10.1037/0022-3514.51.1.125

59.

Snyder

Simpson

J. A.

Gangestad

(1986). Personality and sexual relations. Journal of Personality and Social Psychology, 51, 181-190. doi:10.1037/0022-3514.51.1.181

60.

Stark

Chernyshenko

O. S.

Drasgow

(2006). Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified strategy. Journal of Applied Psychology, 91, 1292-1306. doi:10.1037/0021-9010.91.6.1292

61.

Stillwell

D. J.

Kosinski

(2015). myPersonality Project website. Retrieved from http://mypersonality.org

62.

Teresi

J. A.

Fleishman

J. A.

(2007). Differential item functioning and health assessment. Quality of Life Research, 16, 33-42. doi:10.1007/s11136-007-9184-6

63.

Velicer

W. F.

(1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41, 321-327.

64.

Wilmot

M. P.

(2015). A contemporary taxometric analysis of the latent structure of self-monitoring. Psychological Assessment, 27, 353-364. doi:10.1037/pas0000030

65.

Wilmot

M. P.

DeYoung

C. G.

Stillwell

Kosinski

(2015). Self-monitoring and the metatraits. Journal of Personality. Advance online publication. doi:10.1111/jopy.12162

66.

Wolf

Spinath

F. M.

Riemann

Angleitner

(2009). Self-monitoring and personality: A behavioural-genetic study. Personality and Individual Differences, 47, 25-29. doi:10.1016/j.paid.2009.01.040