Examining the Criterion Validity and Diagnostic Specificity of Self-Report Measures of Narcissism and Mania

Abstract

We examined the validity of self-report measures of narcissism and mania by relating them to interview-based ratings of psychopathology. Narcissism scales were taken from the Narcissistic Personality Inventory (NPI), the Personality Diagnostic Questionnaire–4+, and the Short Dark Triad. Mania measures included the Altman Self-Rated Mania Scale (ASRM) and scales taken from the Hypomanic Personality Scale (HPS) and Expanded Version of the Inventory of Depression and Anxiety Symptoms. Our analyses addressed two key issues. The first issue was whether these scales demonstrated significant criterion validity (e.g., whether the HPS scales correlated significantly with interview ratings of mania). The second issue was whether they displayed specificity to their target constructs (e.g., whether the NPI scales correlated more strongly with ratings of narcissistic personality disorder than with other forms of psychopathology). All of the narcissism scales—including all three NPI subscales—correlated significantly with interview ratings of narcissistic personality disorder and showed considerable evidence of diagnostic specificity. Most of the mania scales also displayed good criterion validity and diagnostic specificity. However, two measures—the ASRM and the HPS Social Vitality subscale—had weak, nonsignificant associations with interview ratings of manic episodes; these findings raise concerns regarding their validity as specific indicators of mania.

Keywords

narcissism mania criterion validity discriminant validity diagnostic specificity

Get full access to this article

View all access options for this article.

References

Ackerman

R. A.

Donnellan

M. B.

Roberts

B. W.

Fraley

R. C.

(2016). The effect of response format on the psychometric properties of the Narcissistic Personality Inventory: Consequences for item meaning and factor structure. Assessment, 23(2), 203-220. https://doi.org/10.1177/1073191114568113

Ackerman

R. A.

Witt

E. A.

Donnellan

M. B.

Trzesniewski

K. H.

Robins

R. W.

Kashy

D. A.

(2011). What does the Narcissistic Personality Inventory really measure? Assessment, 18(1), 67-87. https://doi.org/10.1177/1073191110382845

Alloy

L. B.

Bender

R. E.

Whitehouse

W. G.

Wagner

C. A.

Liu

R. T.

Grant

D. A.

Jager-Hyman

Molz

Choi

J. Y.

Harmon-Jones

Abramson

L. Y.

(2012). High Behavioral Approach System (BAS) sensitivity, reward responsiveness, and goal-striving predict first onset of bipolar disorders: A prospective behavioral high-risk design. Journal of Abnormal Psychology, 121(2), 339-351. https://doi.org/10.1037/a0025877

Altman

E. G.

Hedeker

Peterson

J. L.

Davis

J. M.

(1997). The Altman Self-Rating Mania Scale. Biological Psychiatry, 42(10), 948-955. https://doi.org/10.1016/S0006-3223(96)00548-3

Altman

E. G.

Hedeker

Peterson

J. L.

Davis

J. M.

(2001). A comparative evaluation of three self-rating scales for acute mania. Biological Psychiatry, 50(6), 468-471. https://doi.org/10.1016/S0006-3223(01)01065-4

American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd ed.). Author.

American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Author.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Author.

Cain

N. M.

Pincus

A. L.

Ansell

E. B.

(2008). Narcissism at the crossroads: Phenotypic description of pathological narcissism across clinical theory, social/personality psychology, and psychiatric diagnosis. Clinical Psychology Review, 28(4), 638-656. https://doi.org/10.1016/j.cpr.2007.09.006

10.

Campbell

D. T.

Fiske

D. W.

(1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81-105. https://doi.org/10.1037/h0046016

11.

Cicchetti

D. V.

(1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284-290. https://doi.org/10.1037/1040-3590.6.4.284

12.

Crowe

M. L.

Lynam

D. R.

Campbell

W. K.

Miller

J. L.

(2019). Exploring the structure of narcissism: Toward an integrated solution. Journal of Personality, 87(6), 1151-1169. https://doi.org/10.1111/jopy.12464

13.

Eckblad

Chapman

L. J.

(1986). Development and validation of a scale for hypomanic personality. Journal of Abnormal Psychology, 95(3), 214-222. https://doi.org/10.1037/0021-843X.95.3.214

14.

Fossati

Borroni

Grazioli

Dornetti

Marcassoli

Maffei

Cheek

(2009). Tracking the hypersensitive dimension in narcissism: Reliability and validity of the Hypersensitive Narcissism Scale. Personality and Mental Health, 3(4), 235-247. https://doi.org/10.1002/pmh.92

15.

Fulford

Johnson

S. L.

Carver

C. S.

(2008). Communalities and differences in characteristics of persons at risk for narcissism and mania. Journal of Research in Personality, 42(6), 1427-1438. https://doi.org/10.1016/j.jrp.2008.06.002

16.

Hyler

S. E.

(1994). Personality Diagnostic Questionnaire-4+ (PDQ-4+). New York State Psychiatric Institute.

17.

Johnson

S. L.

Edge

M. D.

Holmes

M. K.

Carver

C. S.

(2012). The behavioral activation system and mania. Annual Review of Clinical Psychology, 8, 243-267. https://doi.org/10.1146/annurev-clinpsy-032511-143148

18.

Johnson

S. L.

Leedom

L. J.

Muhtadie

(2012). The dominance behavioral system and psychopathology: Evidence from self-report, observational, and biological studies. Psychological Bulletin, 138(4), 692-743. https://doi.org/10.1037/a0027503

19.

Jones

D. N.

Paulhus

D. L.

(2014). Introducing the Short Dark Triad (SD3): A brief measure of dark personality traits. Assessment, 21(1), 28-41. https://doi.org/10.1177/1073191113514105

20.

Kenny

D. A.

(1987). Statistics for the social and behavioral sciences. Little, Brown and Company.

21.

Krizan

Herlache

A. D.

(2018). The narcissism spectrum model: A synthetic view of narcissistic personality. Personality and Social Psychology Review, 22(1), 3-31. https://doi.org/10.1177/1088868316685018

22.

Krusemark

E. A.

Campbell

W. K.

Crowe

M. L.

Miller

J. D.

(2018). Comparing self-report measures of grandiose narcissism, vulnerable narcissism, and narcissistic personality disorder in a male offender sample. Psychological Assessment, 30(7), 984-990. https://doi.org/10.1037/pas0000579

23.

Kwapil

T. R.

Miller

M. B.

Zinser

M. C.

Chapman

L. J.

Chapman

Eckblad

(2000). A longitudinal study of high scorers on the Hypomanic Personality Scale. Journal of Abnormal Psychology, 109(2), 222-226. https://doi.org/10.1037/0021-843X.109.2.222

24.

Miller

J. D.

Gaughan

E. T.

Pryor

L. R.

Kamen

Campbell

W. K.

(2009). Is research using the Narcissistic Personality Inventory relevant for understanding narcissistic personality disorder? Journal of Research in Personality, 43(3), 482-488. https://doi.org/10.1016/j.jrp.2009.02.001

25.

Miller

J. D.

Lynam

D. R.

(2017). A passionate call for dispassionate conclusion: Comment on Fossati et al. (2016). Psychological Assessment, 29(11), 1413-1416. https://doi.org/10.1037/pas0000473

26.

Miller

J. D.

Lynam

D. R.

Hyatt

C. S.

Campbell

W. K.

(2017). Controversies in narcissism. Annual Review of Clinical Psychology, 13, 291-315. https://doi.org/10.1146/annurev-clinpsy-032816-045244

27.

Miller

J. D.

Maples

Campbell

W. K.

(2011). Comparing the construct validity of scales derived from the Narcissistic Personality Inventory: A reply to Rosenthal and Hooley (2010). Journal of Research in Personality, 45(5), 401-407. https://doi.org/10.1016/j.jrp.2010.12.004

28.

Miller

J. D.

McCain

Lynam

D. R.

Few

L. R.

Gentile

MacKillop

Campbell

W. K.

(2014). A comparison of the criterion validity of popular measures of narcissism and narcissistic personality disorder via the use of expert ratings. Psychological Assessment, 26(3), 958-969. https://doi.org/10.1037/a0036613

29.

Mohammadzadeh

Monazzami

(2019). Validation of the Hypomanic Personality Scale (HPS) in Iranian adolescents. Personality and Mental Health, 13(1), 15-23. https://doi.org/10.1002/pmh.1435

30.

Parker

Fletcher

McCraw

Hong

(2014). The Hypomanic Personality Scale: A measure of personality and/or bipolar symptoms? Psychiatry Research, 220(1-2), 654-658. https://doi.org/10.1016/j.psychres.2014.07.040

31.

Pfohl

Blum

Zimmerman

(1997). Structured Interview for DSM-IV Personality. American Psychiatric Press.

32.

Raskin

R. N.

Hall

C. S.

(1979). A Narcissistic Personality Inventory. Psychological Reports, 45(2), 590. https://doi.org/10.2466/pr0.1979.45.2.590

33.

Raskin

R. N.

Terry

(1988). A principal-components analysis of the Narcissistic Personality Inventory and further evidence of its construct validity. Journal of Personality and Social Psychology, 54(5), 890-902. https://doi.org/10.1037/0022-3514.54.5.890

34.

Rosenthal

S. A.

Hooley

J. M.

(2010). Narcissism assessment in social-personality research: Does the association between narcissism and psychological health result from a confound with self-esteem? Journal of Research in Personality, 44(4), 453-465. https://doi.org/10.1016/j.jrp.2010.05.008

35.

Schalet

B. D.

Durbin

C. E.

Revelle

(2011). Multidimensional structure of the Hypomanic Personality Scale. Psychological Assessment, 23(2), 504-522. https://doi.org/10.1037/a0022301

36.

Sheehan

D. V.

Lecrubier

Sheehan

K. H.

Amorim

Janavas

Weiller

Hergueta

Baker

Dunbar

G. C.

(1998). The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry, 59(Suppl. 20), 22-57. https://www.semanticscholar.org/paper/The-Mini-International-Neuropsychiatric-Interview-a-Sheehan-Lecrubier/e531b9821e39c1e1aa2df1641774ba31af736913

37.

Siedor

Maples-Keller

J. L.

Miller

J. D.

Campbell

W. K.

(2016). Narcissism and hypomania revisited: A test of the similarities and differences in their empirical networks. Current Psychology, 35(2), 244-254. https://doi.org/10.1007/s12144-016-9408-4

38.

Stanton

Daly

Stasik-O’Brien

S. M.

Ellickson-Larew

Clark

L. A.

Watson

(2017). An integrative analysis of the Narcissistic Personality Inventory and the Hypomanic Personality Scale: Implications for construct validity. Assessment, 24(6), 695-711. https://doi.org/10.1177/1073191115625801

39.

Walsh

M. A.

DeGeorge

D. P.

Barrantes-Vidal

Kwapil

T. R.

(2015). A 3-year longitudinal study of risk for bipolar spectrum psychopathology. Journal of Abnormal Psychology, 124(3), 486-497. https://doi.org/10.1037/abn0000045

40.

Watson

(2009). Differentiating the mood and anxiety disorders: A quadripartite model. Annual Review of Clinical Psychology, 5, 221-247. https://doi.org/10.1146/annurev.clinpsy.032408.153510

41.

Watson

Ellickson-Larew

Stanton

Levin-Aspenson

H. F.

Khoo

Stasik-O’Brien

S. M.

Clark

L. A.

(2019). Aspects of extraversion and their associations with psychopathology. Journal of Abnormal Psychology, 128(8), 777-794. https://doi.org/10.1037/abn0000459

42.

Watson

O’Hara

M. W.

(2017). Understanding the emotional disorders: A symptom-level approach based on the IDAS-II. Oxford University Press.

43.

Watson

O’Hara

M. W.

Naragon-Gainey

Koffel

Chmielewski

Kotov

Stasik

S. M.

Ruggero

C. J.

(2012). Development and validation of new anxiety and bipolar symptom scales for an expanded version of the IDAS (the IDAS-II). Assessment, 19(4), 399-420. https://doi.org/10.1177/1073191112449857

44.

Watson

Stanton

Khoo

Ellickson-Larew

Stasik-O’Brien

S. M.

(2019). Extraversion and psychopathology: A multilevel hierarchical review. Journal of Research in Personality, 81(August), 1-10. https://doi.org/10.1016/j.jrp.2019.04.009