Personality dysfunction is a core element of the diagnosis of personality disorders in both main diagnostic systems (Diagnostic and Statistical Manual of Mental Disorders [5th ed.] Personality Disorders and ICD-11 [International Classification of Diseases, 11th Revision] Personality Disorders). A recent study by Sleep et al. explored the structure of personality dysfunction (N = 517 undergraduates) with exploratory bass-ackward factor analyses at the item level using items from six measures of personality functioning. The present study represents a replication of the study by Sleep and colleagues in a community sample of individuals currently in or seeking psychological/psychiatric treatment. Participants were recruited from Prolific who completed items from six measures of personality dysfunction (N = 457). The primary factor analysis identified three lower-order factors of impairment (Negative Self-Regard, Disagreeableness, and Intimacy Problems). These dysfunction factors showed moderate to strong relations to the factors generated by Sleep et al.; however, there were important differences in the overall structure suggesting a lack of formal replication.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.).
2.
BachB.BrownT. A.MulderR. T.Newton-HowesG.SimonsenE.SellbomM. (2021). Development and initial evaluation of the ICD-11 personality disorder severity scale: PDS-ICD-11. Personality and Mental Health, 15(3), 223–236. https://doi.org/10.1002/pmh.1510
3.
BaierA. L.KlineA. C.FeenyN. C. (2020). Therapeutic alliance as a mediator of change: A systematic review and evaluation of research. Clinical Psychology Review, 82, 101921. https://doi.org/10.1016/j.cpr.2020.101921
4.
BlitonC. F.RocheM. J.PincusA. L.DueberD. (2022a). Examining the structure and validity of self-report measures of DSM-5 alternative model for personality disorders criterion A. Journal of Personality Disorders, 36(2), 157–182. https://doi.org/10.1521/pedi_2021_35_531
5.
BrownT. A.SellbomM. (2023). Further validation of the Personality Disorder Severity for ICD-11 (PDS-ICD-11) scale in a community mental health sample. Psychological Assessment, 35(8), 706–714. https://doi.org/10.1037/pas0001253
6.
CameronS. K.RodgersJ.DagnanD. (2018). The relationship between the Therapeutic Alliance and Clinical Outcomes in cognitive behaviour therapy for adults with depression: A meta-analytic review. Clinical Psychology & Psychotherapy, 25(3), 446–456. https://doi.org/10.1002/cpp.2180
CroweM. L.LynamD. R.MillerJ. D. (2018). Uncovering the structure of agreeableness from self-report measures. Journal of Personality, 86(5), 771–787. https://doi.org/10.1111/jopy.12358
9.
DonnellanM. B.OswaldF. L.BairdB. M.LucasR. E. (2006). The Mini-IPIP scales: Tiny-yet-effective measures of the Big Five Factors of Personality. Psychological Assessment, 18(2), 192–203. https://doi.org/10.1037/1040-3590.18.2.192
10.
Erdur-BakerO.AbersonC. L.BarrowJ. C.DraperM. R. (2006). Nature and severity of college students’ psychological concerns: A comparison of clinical and nonclinical national samples. Professional Psychology: Research and Practice, 37(3), 317–323. https://doi.org/10.1037/0735-7028.37.3.317
11.
FlakeJ. K.FriedE. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3(4), 456–465. https://doi.org/10.1177/2515245920952393
12.
GamacheD.SavardC.LeclercP.CôtéA. (2019). Introducing a short self-report for the assessment of DSM–5 level of personality functioning for personality disorders: The Self and Interpersonal Functioning Scale. Personality Disorders: Theory, Research, and Treatment, 10(5), 438–447. https://doi.org/10.1037/per0000335
13.
GoldbergL. R. (2006). Doing it all Bass-Ackwards: The development of hierarchical factor structures from the top down. Journal of Research in Personality, 40(4), 347–358. https://doi.org/10.1016/j.jrp.2006.01.001
14.
HaehnerP.SleepC. E.MillerJ. D.LynamD. R.HopwoodC. J. (2024). The longitudinal (co)development of personality traits and the level of personality functioning after negative life events. Clinical Psychological Science, 12(4), 782–801.
15.
HatcherR. L.GillaspyJ. A. (2006). Development and validation of a revised short version of the Working Alliance Inventory. Psychotherapy Research, 16(1), 12–25. https://doi.org/10.1080/10503300500352500
16.
HornJ. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/bf02289447
17.
HutsebautJ.FeenstraD. J.KamphuisJ. H. (2016). Development and preliminary psychometric evaluation of a brief self-report questionnaire for the assessment of the DSM-5 level of personality functioning scale: The LPFS brief form (LPFS-BF). Personality Disorders, 7(2), 192–197. https://doi.org/10.1037/per0000159
18.
KamC. C. S.SunS. (2022). Method factor due to the use of reverse-keyed items: Is it simply a response style artifact?Current Psychology, 41(4), 1–9. https://doi.org/10.1007/s12144-020-00645-z
19.
KerberA.EhrenthalJ. C.ZimmermannJ.RemmersC.NolteT.WendtL. P.HeimP.MüllerS.BeintnerI.KnaevelsrudC. (2024). Examining the role of personality functioning in a hierarchical taxonomy of psychopathology using two years of ambulatory assessed data. Translational Psychiatry, 14, Article 340. https://doi.org/10.1038/s41398-024-03046-z
20.
KielL.HopwoodC. J.LindM. (2024). Changes in personality functioning and pathological personality traits as a function of treatment: A feasibility study. Journal of Psychopathology and Behavioral Assessment, 46, 695–704.
21.
KotovR.KruegerR. F.WatsonD.AchenbachT. M.AlthoffR. R.BagbyR. M.BrownT. A.CarpenterW. T.CaspiA.ClarkL. A.EatonN. R.ForbesM. K.ForbushK. T.GoldbergD.HasinD.HymanS. E.IvanovaM. Y.LynamD. R.MarkonK.. . .ZimmermanM. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology, 126(4), 454–477. https://doi.org/10.1037/abn0000258
22.
KruegerR. F.DerringerJ.MarkonK. E.WatsonD.SkodolA. E. (2013). The Personality Inventory for DSM-5-Brief Form (PID-5-BF)-Adult. American Psychiatric Association.
23.
LeisingD.ZimmermannJ. (2011). An integrative conceptual framework for assessing personality and personality pathology. Review of General Psychology, 15, 317–330. https://doi.org/10.1037/a0025070
24.
LivesleyW. J.SchroederM. L.JacksonD. N.JangK. L. (1994). Categorical distinctions in the study of personality disorder: Implications for classification. Journal of Abnormal Psychology, 103(1), 6–17. https://doi.org/10.1037/0021-843x.103.1.6
25.
Lorenzo-SevaU.ten BergeJ. M. F. (2006). Tucker’s congruence coefficient as a meaningful index of factor similarity. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 2(2), 57–64. https://doi.org/10.1027/1614-2241.2.2.57
26.
LynamD. R.GaughanE. T.MillerJ. D.MillerD. J.Mullins-SweattS.WidigerT. A. (2011). Assessing the basic traits associated with psychopathy: Development and validation of the Elemental Psychopathy Assessment. Psychological Assessment, 23(1), 108–124. https://doi.org/10.1037/a0021146
MoreyL. C. (2017). Development and initial evaluation of a self-report form of the DSM-5 Level of Personality Functioning Scale. Psychological Assessment, 29(10), 1302–1308. https://doi.org/10.1037/pas0000450
29.
MoreyL. C. (2019). Thoughts on the assessment of the DSM–5 alternative model for personality disorders: Comment on Sleep et al. (2019). Psychological Assessment, 31(10), 1192–1199. https://doi.org/10.1037/pas0000710
30.
MoreyL. C.McCredieM. N.BenderD. S.SkodolA. E. (2022). Criterion A: Level of personality functioning in the alternative DSM–5 model for personality disorders. Personality Disorders: Theory, Research, and Treatment, 13(4), 305–315. https://doi.org/10.1037/per0000551
31.
NailsJ. G.Maffly-KippJ.DeShongH. L.LowmasterS. E.KurtzJ. E. (2023). A crisis in college student mental health? Self-ratings of psychopathology before and after the COVID-19 pandemic. Psychological Assessment, 35(11), 1010–1018. https://doi.org/10.1037/pas0001241
32.
NielsenS. R.WrightA. G. (2024). The structure of identity dysfunction in self-report measures. Journal of Personality Assessment. Advance online publication. https://doi.org/10.1080/00223891.2024.2362982
33.
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
ParkerG.Hadzi-PavlovicD.BothL.KumarS.WilhelmK.OlleyA. (2004). Measuring disordered personality functioning: To Love and to work reprised. Acta Psychiatrica Scandinavica, 110(3), 230–239. https://doi.org/10.1111/j.1600-0447.2004.00312.x
36.
PedrelliP.NyerM.YeungA.ZulaufC.WilensT. (2015). College students: Mental health problems and treatment considerations. Academic Psychiatry, 39(5), 503–511. https://doi.org/10.1007/s40596-014-0205-9
37.
PhillipsN. L.Van TilK.LynamD. R.MillerJ. D. (2024). A comprehensive item-level examination of conscientiousness’ underlying structure across three large samples. Journal of Personality, 92(4), 985–1005.
38.
PilkonisP. A.ChoiS. W.ReiseS. P.StoverA. M.RileyW. T.CellaD. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS™): Depression, anxiety, and anger. Assessment, 18(3), 263–283. https://doi.org/10.1177/1073191111411667
39.
PopperK. (1959). The logic of scientific discovery. Basic Books.
40.
R Core Team. (2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
41.
RevelleW. (2019). psych: Procedures for psychological, psychometric, and personality research (R package version 1.8.12). Northwestern University. https://CRAN.Rproject.org/package=psych
42.
SchmidtS. (2009). Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Review of General Psychology, 13(2), 90–100.
43.
SiefertC. J.SextonJ.MeehanK.NelsonS.HaggertyG.DauphinB.HuprichS. (2020). Development of a short form for the DSM–5 levels of personality functioning questionnaire. Journal of Personality Assessment, 102(4), 516–526. https://doi.org/10.1080/00223891.2019.1594842
44.
SimmonsJ. P.NelsonL. D.SimonsohnU. (2016). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632
45.
SleepC. E.LynamD. R. (2022). The problems with Criterion A: A comment on Morey et al. (2022). Personality Disorders: Theory, Research, and Treatment, 13(4), 325–327. https://doi.org/10.1037/per0000585
46.
SleepC. E.LynamD. R.MillerJ. D. (2021). Personality impairment in the DSM-5 and ICD-11: Current standing and limitations. Current Opinion in Psychiatry, 34(1), 39–43. https://doi.org/10.1097/YCO.0000000000000657
47.
SleepC. E.LynamD. R.WidigerT. A.CroweM. L.MillerJ. D. (2019a). An evaluation of DSM–5 Section III personality disorder Criterion A (impairment) in accounting for psychopathology. Psychological Assessment, 31(10), 1181–1191. https://doi.org/10.1037/pas0000620
48.
SleepC. E.LynamD. R.WidigerT. A.CroweM. L.MillerJ. D. (2019b). Difficulties with the conceptualization and assessment of Criterion A in the DSM-5 alternative model of personality disorder: A reply to Morey (2019). Psychological Assessment, 31(10), 1200–1205. https://doi.org/10.1037/pas0000758
49.
SleepC. E.PhillipsN. L.DuT. V.LynamD. R.MillerJ. D. (2024). Examining the structure of personality dysfunction. Personality Disorders: Theory, Research, and Treatment, 15, 110–121.
50.
SleepC. E.WeissB.LynamD. R.MillerJ. D. (2020). The DSM–5 section III personality disorder criterion a in relation to both pathological and general personality traits. Personality Disorders: Theory, Research, and Treatment, 11(3), 202–212. https://doi.org/10.1037/per0000383
51.
SwalesM. A. (2022). Personality disorder diagnoses in ICD-11: Transforming conceptualisations and practice. Clinical Psychology in Europe, 4, Article e9635. https://doi.org/10.32872/cpe.9635
52.
UliaszekA. A.AmestoyM. E.FournierM. A.Al-DajaniN. (2023). Criterion A of the alternative model of personality disorders: Structure and validity in a community sample. Psychological Assessment, 35(5), 453–461. https://doi.org/10.1037/pas0001225
53.
VelicerW. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41(3), 321–327. https://doi.org/10.1007/BF02293557
54.
VerheulR.AndreaH.BerghoutC. C.DolanC.BusschbachJ. J.van der KroftP. J.BatemanA. W.FonagyP. (2008). Severity indices of personality problems (SIPP-118): Development, factor structure, reliability, and validity. Psychological Assessment, 20(1), 23–34. https://doi.org/10.1037/1040-3590.20.1.23
55.
VizeC. E.PhillipsN. L.MillerJ. D.LynamD. R. (2024). On the use and misuses of preregistration: A reply to Klonsky (2024). Assessment. Advance online publication. https://doi.org/10.1177/10731911241275256
56.
WattsA. L.GreeneA. L.RingwaldW.ForbesM. K.BrandesC. M.Levin-AspensonH. F.DelawallaC. (2023). Factor analysis in personality disorders research: Modern issues and illustrations of practical recommendations. Personality Disorders: Theory, Research, and Treatment, 14(1), 105–117. https://doi.org/10.1037/per0000581
57.
WeekersL. C.HutsebautJ.KamphuisJ. H. (2018). The level of personality functioning scale-brief form 2.0: Update of a brief instrument for assessing level of personality functioning. Personality and Mental Health, 13(1), 3–14. https://doi.org/10.1002/pmh.1434
58.
WidigerT. A.TrullT. J.ClarkinJ. F.SandersonC.CostaP. T.Jr. (2002). A description of the DSM-IV personality disorders with the five-factor model of personality. In CostaP. T.JrWidigerT. A. (Eds.), Personality disorders and the five-factor model of personality (pp. 89–99). American Psychological Association. https://doi.org/10.1037/10423-006
59.
World Health Organization. (2024). Clinical descriptions and diagnostic requirements for ICD-11 mental, behavioural and neurodevelopmental disorders. https://iris.who.int/handle/10665/375767
60.
WrightA. G. C.RingwaldW. R.HopwoodC. J.PincusA. L. (2022). It’s time to replace the personality disorders with the interpersonal disorders. American Psychologist, 77(9), 1085–1099. https://doi.org/10.1037/amp0001087
61.
ZimmermannJ.FalkC. F.WendtL.SpitzerC.FischerF.BachB.SellbomM.MüllerS. (2023). Validating the German version of the Personality Disorder Severity-ICD-11 Scale using nominal response models. Psychological Assessment, 35(3), 257–268. https://doi.org/10.1037/pas0001199
