Psychometric Analysis of the Dating Anxiety Scale for Adolescents in Samples of Polish and U.S. Young Adults: Examining the Factor Structure,Measurement Invariance,Item Functioning,and Convergent Validity

Abstract

This study explored whether the Dating Anxiety Scale for Adolescents (DAS-A), which was originally developed in the United States to assess dating anxiety in adolescents, is appropriate for use in samples of young adults from Poland and the United States. The factor structure, measurement invariance across country, gender and relationship status, degree of precision across latent levels of the DAS and the functioning of individual items, and convergent validity were examined in a sample of 309 Polish and 405 U.S. young adults. The confirmatory factor analysis (CFA) supported the original three-factor measurement model of the DAS. Invariance tests revealed factor loadings and item thresholds that differed across subgroups, supporting partial metric and partial scalar invariance. The MIRT analysis showed that all items adequately discriminated participants with low and high anxiety. Dating anxiety latent factor correlations with mental health and interpersonal competence were significant in the expected negative directions. The results call for careful interpretation of research involving the DAS in cultural, gender, and relationship status groups, particularly when the primary goal is to compare mean levels of dating anxiety. Further development of the scale is recommended before it can be used across country, gender, and relationship status groups.

Keywords

item response theory measurement invariance validity dating anxiety young adults

Get full access to this article

View all access options for this article.

References

Adamczyk

(2015). Development and validation of the Polish-language version of the Dating Anxiety Scale in a sample of young adults. Psychologia Społeczna, 4(35), 478-488. https://doi.org/10.7366/1896180020153508

Adamczyk

Segrin

. (2016). The mediating role of romantic desolation and dating anxiety in the association between interpersonal competence and life satisfaction among Polish young adults. Journal of Adult Development, 23(1), 1-10. https://doi.org/10.1007/s10804-015-9216-3

Allen

Bourhis

Emmers-Sommer

Sahlsteind

(1998). Reducing dating anxiety: A meta-analysis. Communication Reports, 11(1), 49-55. https://doi.org/10.1080/08934219809367684

Asher

Aderka

I. M.

(2020). Dating with social anxiety: An empirical examination of momentary anxiety and desire for future interaction. Clinical Psychological Science, 8(1), 99-110. https://doi.org/10.1177/2167702619867055

Baker

F. B.

Kim

S. H.

(2004). Item response theory: Parameter estimation techniques (2nd ed.). CRC Press.

Bentler

P. M.

(1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238-246. https://doi.org/10.1037/0033-2909.107.2.238

Berscheid

E. S.

Regan

P. C.

(2016). The psychology of interpersonal relationships. Psychology Press.

Boyle

A. M.

O’Sullivan

L. F.

(2013). The influence of dating anxiety on normative experiences of dating, sexual interactions, and alcohol consumption among Canadian middle adolescents. Journal of Youth Studies, 16(2), 222-236. https://doi.org/10.1080/13676261.2012.704987

Brannon

(2002). Psychologia rodzaju [Psychology of gender]. Gdańskie Wydawnictwo Psychologiczne.

10.

Brown

T. A.

(2014). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.

11.

Buhrmester

Furman

Wittenberg

M. T.

Reis

H. T.

(1988). Five domains of interpersonal competence in peer relationships. Journal of Personality and Social Psychology, 55(6), 991-1008. https://doi.org/10.1037/0022-3514.55.6.991

12.

Bulcroft

R. A.

Bulcroft

K. A.

(1991).The nature and functions of dating in later life. Research on Aging, 13(2), 244-260. https://doi.org/10.1177/0164027591132007

13.

Bullinger

Alonso

Apolone

Leplège

Sullivan

Wood-Dauphinee

Gandek

Wagner

Aaronson

Bech

Fukuhara

Kaasa

Ware

J. E.

Jr. (1998). Translating health status questionnaires and evaluating their quality: The International Quality of Life Assessment Project approach. Journal of Clinical Epidemiology, 51(11), 913-923. https://doi.org/10.1016/s0895-4356(98)00082-1

14.

Bühler

J. L.

Nikitin

(2020). Sociohistorical context and adult social development: New directions for 21st century research. American Psychologist, 75(4), 457-469. https://doi.org/10.1037/amp0000611

15.

Byrne

B. M.

(2004). Testing for multigroup invariance using AMOS graphics: A road less traveled. Structural Equation Modeling, 11(2), 272-300. https://doi.org/10.1207/s15328007sem1102_8

16.

Calvert

J. D.

Moore

Jensen

B. J.

(1987). Psychometric evaluation of the dating anxiety survey: A self-report questionnaire for the assessment of dating anxiety in males and females. Journal of Psychopathology and Behavioral Assessment, 9(3), 341-351. https://doi.org/https://doi.org/10.1007/BF00964562

17.

CBOS. (2019). Preferowane i realizowane modele życia rodzinnego [Preferred and implemented family life models]. https://www.cbos.pl/SPISKOM.POL/2019/K_046_19.PDF

18.

Chalmers

(2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), https://doi.org/10.18637/jss.v048.i06

19.

Chen

W. H.

Thissen

(1997). Local dependence indexes for item pairs using item response theory. Journal of Educational Behavioral Statistics, 22(3), 265-289. https://doi.org/https://doi.org/10.2307/1165285

20.

Chorney

D. B.

Morris

T. L.

(2008). The changing face of dating anxiety: Issues in assessment with special populations. Clinical Psychology: Science and Practice, 15(3), 224-238. https://doi.org/10.1111/j.1468-2850.2008.00132.x

21.

Cole

D. A.

Ciesla

J. A.

Steiger

J. H.

(2007). The insidious effects of failing to include design-driven correlated residuals in latent-variable covariance structure analysis. Psychological Methods, 12(4), 381-398. https://doi.org/10.1037/1082-989X.12.4.381

22.

Connolly

McDonald

K. P.

(2020). Cross-cultural perspectives on dating and marriage. In Hupp

Jewell

J. D.

(Eds.), The encyclopedia of child and adolescent development (pp. 1-13). John Wiley & Sons. https://doi.org/10.1002/9781119171492.wecad486

23.

Conger

J. C.

Farrell

A. D.

(1981). Behavioral components of heterosocial skills. Behavior Therapy, 12(1), 41-55. https://doi.org/10.1016/S0005-7894(81)80105-0

24.

Curran

J. P.

Gilbert

F. S.

Little

L. M.

(1976). A comparison between behavioral replication training and sensitivity training approaches to heterosexual dating anxiety. Journal of Counseling Psychology, 23(3), 190-196. https://doi.org/10.1037/0022-0167.23.3.190

25.

Dimitrov

D. M.

(2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43(2), 121-149. https://doi.org/10.1177/0748175610373459

26.

Dryman

M. T.

Gardner

Weeks

J. W.

Heimberg

R. G.

(2016). Social anxiety disorder and quality of life: How fears of negative and positive evaluation relate to specific domains of life satisfaction. Journal of Anxiety Disorders, 38(March), 1-8. https://doi.org/10.1016/j.janxdis.2015.12.003

27.

Eaton

A. A.

Rose

(2011). Has dating become more egalitarian? A 35 year review using Sex Roles. Sex Roles, 64(11-12), 843-862. https://doi.org/10.1007/s11199-011-9957-9

28.

Fitzpatrick

Blazek

Kazmierczak

Lewandowska-Walter

Pastwa-Wojciechowska

Blazek

(2014). Lifestyle and close relationship trends among young adults in Poland. Journal of Social and Personal Relationships, 31(7), 928-937. https://doi.org/10.1177/0265407513510478

29.

Funder

D. C.

Ozer

D. J.

(2019). Evaluating effect size in psychological research: Sense and nonsense. Advances in Methods and Practices in Psychological Science, 2(2), 156-168. https://doi.org/10.1177/2515245919847202

30.

Gere

MacDonald

(2013). Assessing relationship quality across cultures: An examination of measurement equivalence. Personal Relationships, 20(3), 422-442. https://doi.org/10.1111/pere.12001

31.

Glickman

A. R.

La Greca

A. M.

(2004). The Dating Anxiety Scale for Adolescents: Scale development and associations with adolescent functioning. Journal of Clinical Child & Adolescent Psychology, 33(3), 566-578. https://doi.org/10.1207/s15374424jccp3303_14

32.

Górska

(2011). Psychometric properties of the Polish version of the Interpersonal Competence Questionnaire (ICQ-R). European Journal of Psychological Assessment, 27(3), 186-192. https://doi.org/10.1027/1015-5759/a000066

33.

Hance

M. A.

Blackhart

Daw

(2018). Free to be me: The relationship between true self, rejection sensitivity, and the use of online dating sites. Journal of Social Psychology, 15 8(4), 421-429. https://doi.org/10.1080/00224545.2017.1389684

34.

Heene

Hilbert

Freudenthaler

H. H.

Bühner

(2012). Sensitivity of SEM fit indexes with respect to violations of uncorrelated errors. Structural Equation Modeling, 19(1), 36-50. https://doi.org/10.1080/10705511.2012.634710

35.

Hope

D. A.

Heimberg

R. G.

(1990). Dating anxiety. In Leitenberg

(Ed.), Handbook of social and evaluation anxiety (pp. 217-246). Plenum.

36.

Houts

C. R.

Cai

(2013). flexMIRT R user’s manual version 2: Flexible multilevel multidimensional item analysis and test scoring. Vector Psychometric Group.

37.

Huang

C. D.

Church

A. T.

Katigbak

M. S.

(1997). Identifying cultural differences in items and traits: Differential item functioning in the NEO personality inventory. Journal of Cross-Cultural Psychology, 28(2), 192-218. https://doi.org/10.1177/0022022197282004

38.

Immekus

J. C.

Snyder

K. E.

Ralston

P. A.

(2019). Multidimensional item response theory for factor structure assessment in educational psychology research. Frontiers in Education, 4(45), 1-15. https://doi.org/10.3389/feduc.2019.00045

39.

La Greca

A. M.

Lopez

. (1998). Social anxiety among adolescents: Linkages with peer relations and friendships. Journal of Abnormal Child Psychology, 26(2), 83-94. https://doi.org/10.1023/a:1022684520514

40.

La Greca

A. M.

Mackey

E. R

. (2007). Adolescents’ anxiety in dating situations: The potential role of friends and romantic partners. Journal of Clinical Child & Adolescent Psychology, 36(4), 522-533. https://doi.org/10.1080/15374410701662097

41.

Manning

W. D.

Joyner

Hemez

Cupka

(2019). Measuring cohabitation in U.S. national surveys. Demography, 56(4), 1195-1218. https://doi.org/10.1007/s13524-019-00796-0

42.

Maruish

M. E.

(Ed.). (2012). User’s manual for the SF-12v2 Health Survey (3rd ed.). Quality Metric Incorporated.

43.

Meredith

(1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525-543. https://doi.org/https://doi.org/10.1007/BF02294825

44.

Migliaccio

T. A

(2014). Typologies of men’s friendships: Constructing masculinity through them. Masculinities & Social Change, 3(2), 119-147. https://doi.org/10.4471/MCS.2014.47

45.

Morelli

N. M.

Elson

Duong

J. B.

Evans

M. C.

Villodas

M. T.

(2020). Examining the factor structure and measurement invariance of the Trauma Symptom Checklist for Children in a diverse sample of trauma-exposed adolescents. Assessment. Advance online publication. https://doi.org/10.1177/1073191120939158

46.

Muthén

L. K.

Muthén

B. O.

(2017). Mplus user’s guide (8th ed.). Muthén & Muthén.

47.

Orlando

Thissen

(2003). Further investigation of the performance of S-X2: An item fit index for use with dichotomous item response theory models. Applied Psychological Measurement, 27(4), 289-298. https://doi.org/10.1177/0146621603027004004

48.

Podsakoff

P. M.

MacKenzie

S. B.

Lee

J.-Y.

Podsakoff

N. P.

(2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879-903. https://doi.org/10.1037/0021-9010.88.5.879

49.

Report on Demographic situation of Poland by the Government Population Council. (2019). Warszawa: Rządowa Rada Ludnościowa.

50.

Sass

D. A.

Schmitt

T. A.

Marsh

H. W.

(2014). Evaluating model fit with ordered categorical data within a measurement invariance framework: A comparison of estimators. Structural Equation Modeling: A Multidisciplinary Journal, 21(2), 167-180. https://doi.org/10.1080/10705511.2014.882658

51.

Segrin

(1996). The relationship between social skills deficits and psychosocial problems: A test of a vulnerability model. Communication Research, 23(4), 425-450. https://doi.org/10.1177/009365096023004005.

52.

Schiltz

H. K.

Magnus

B. E.

McVey

A. J.

Haendel

A. D.

Dolan

B. K.

Stanley

R. E.

Willar

K. A.

Pleiss

S. J.

Carson

A. M.

Carlson

Murphy

Vogt

E. M.

Yund

B. D.

Van Hecke

A. V.

(2021). A psychometric analysis of the Social Anxiety Scale for Adolescents among youth with autism spectrum disorder: Caregiver-adolescent agreement, factor structure, and validity. Assessment, 28(1), 100-115. https://doi.org/10.1177/1073191119851563

53.

Sidelinger

Frisby

Booth-Butterfield

(2009). Dating anxiety among young adults: The impact of communicative attributes, mate value, and baggage on the dating experience. Paper presented at the annual meeting of the NCA 95th Annual Convention, Chicago Hilton & Towers, Chicago.

54.

Steenkamp

J. B. E. M.

Baumgartner

(1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25(1), 78-90. https://doi.org/10.1086/209528

55.

Steiger

J. H.

(1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25(2), 173-180. https://doi.org/10.1207/S15327906mbr2502_4

56.

Stevens

S. B.

Morris

T. L.

(2007). College dating and social anxiety: Using the Internet as a means of connecting to others. Cyberpsychology & Behavior, 10(5), 680-688. https://doi.org/10.1089/cpb.2007.9970

57.

Stover

A. M.

McLeod

L. D.

Langer

M. M.

Chen

W.H.

Reeve

B. B.

(2019). State of the psychometric methods: Patient-reported outcome measure development and refinement using Item Response Theory. Journal of Patient-Reported Outcome, 3(1), Article 50. https://doi.org/10.1186/s41687-019-0130-5

58.

Smock

P. J.

Schwartz

Ch. R

. (2020). The demography of families: a review of patterns and change. Journal of Marriage and Family, 82(1), 9-349. https://doi.org/10.1111/jomf.12612

59.

Szarota

(2011). Anatomia randki [The anatomy of dating]. Warszawa: MUZA SA.

60.

Tucker

L. R.

Lewis

(1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1-10. https://doi.org/10.1007/BF02291170

61.

Valkenburg

P. M.

Peter

(2007). Who visits online dating sites? Exploring some characteristics of online daters. Cyber Psychology and Behavior, 10(6), 849-852. https://doi.org/10.1089/cpb.2007.9941

62.

Wachter

G. G.

de Valk

H. A. G.

(2020). Dating relationships of the Turkish second generation in Europe: Patterns, partner origin and the role of parents. International Journal of Intercultural Relations, 79, 94-105. https://doi.org/10.1016/j.ijintrel.2020.08.009

63.

Warumzer

(2013). Wzór idealnej randki a współczesne dążenie do idealnego związku [The model of ideal date against the modern quest for perfect relationship]. Annales Universitatis Paedagogicae Cracoviensis Studia Sociologica V, 2, 100-116.

64.

Watson

Friend

(1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33(4), 448-457. https://doi.org/10.1037/h0027806

65.

West

S. G.

Taylor

A. B.

(2012). Model fit and model selection in structural equation modeling. In Hoyle

R. H.

(Ed.), Handbook of structural equation modeling (pp. 209-231). Guilford Press.

66.

Wetzel

Lang

F. J.

Back

Vecchione

Rogoza

Roberts

(2021). Measurement invariance of three narcissism questionnaires across the US, the UK, and Germany. Assessment, 28(1), 29-43. https://doi.org/10.1177/1073191120907967

67.

Widaman

K. F.

Ferrer

Conger

R. D.

(2010). Factorial invariance within longitudinal structural equation models: Measuring the same construct across time. Child Development Perspectives, 4(1), 10-18. https://doi.org/10.1111/j.1750-8606.2009.00110.x

68.

Yoon

Lai

M. H. C.

(2018). Testing factorial invariance with unbalanced samples. Structural Equation Modeling, 25(2), 201-213. https://doi.org/10.1080/10705511.2017.1387859

69.

Yoon

Millsap

R. E.

(2007). Detecting violations of factorial invariance using data-based specification searches: A Monte Carlo study. Structural Equation Modeling, 14(3), 435-463. https://doi.org/10.1080/10705510701301677

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.70 MB