Development and Psychometric Evaluation of a DSM-V-Based Social Networking Site Use Disorder Test: The SNS-DT-10

Abstract

While the problematic use of Social Networking Sites (SNS) has been observed in some individuals, few validated and widely accepted measures are available to assess and screen for problematic use. This is an attempt at adapting the Diagnostic and Statistical Manual of Mental Disorders–based Internet Gaming Disorder Test-10 (IGDT-10) measure to assess SNS use disorder and problematic SNS use in the form of the SNS use disorder Test-10 (SNS-DT-10) questionnaire, and assessing its validity and reliability. The study was conducted in three phases: First, the IGDT-10 questionnaire was translated and adapted to assess SNS use disorder, and content validity was assessed. Then, a sample of 126 students from the Tehran University of Medical Sciences was used to determine internal consistency and construct validity using confirmatory factor analysis. Finally, retest data from 87 participants were used to estimate test–retest reliability. Item content validity indices were above .80 and scale content validity indices surpassed .83. The root mean square error of approximation for the 1-factor model was .04 and the comparative fit and Tucker–Lewis fit indices were .97 and .96, respectively, indicating appropriate construct validity. The intra-class correlation coefficient of the number of positive criteria for SNS use disorder was .81 and the Kappa coefficients for SNS use disorder and problematic SNS use were .85 and .57. Cronbach’s alpha was .79 for the entire questionnaire. Overall, the SNS-DT-10 questionnaire has appropriate content and construct validity, internal consistency, and test–retest reliability. Further validation of this questionnaire in larger and more diverse samples and comparison with professional clinical diagnostic interviews are warranted.

Keywords

internet/gaming addiction validity of assessment tests/questionnaires translated questionnaires

Get full access to this article

View all access options for this article.

References

American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Publishing.

Andreassen

C. S.

Torsheim

Brunborg

G. S.

Pallesen

(2012). Development of a facebook addiction scale. Psychological Reports, 110(2), 501–517. https://doi.org/10.2466/02.09.18.PR0.110.2.501-517

Azizi

S. M.

Soroush

Khatony

(2019). The relationship between social networking addiction and academic performance in Iranian students of medical sciences: A cross-sectional study. BMC Psychology, 7(1), 28. https://doi.org/10.1186/s40359-019-0305-0

Bányai

Zsila

Á.

Király

Maraz

Elekes

Griffiths

M. D.

Andreassen

C. S.

Demetrovics

(2017). Problematic social media use: Results from a large-scale nationally representative adolescent sample. PLos One, 12(1), e0169839. https://doi.org/10.1371/journal.pone.0169839

Billieux

Schimmenti

Khazaal

Maurage

Heeren

(2015). Are we overpathologizing everyday life? A tenable blueprint for behavioral addiction research. Journal of Behavioral Addictions, 4(3), 119–123. https://doi.org/10.1556/2006.4.2015.009

Bollen

K. A.

(1989). Structural equations with latent variables (Vol. 210). John Wiley & Sons.

Boomsma

(1985). Nonconvergence, improper solutions, and starting values in LISREL maximum likelihood estimation. Psychometrika, 50(2), 229–242. https://doi.org/10.1007/BF02294248

Cabral

(2008). Is generation Y addicted to social media. Future of Children, 2(1), 5–14.

Carbonell

Panova

(2017). A critical consideration of social networking sites’ addiction potential. Addiction Research & Theory, 25(1), 48–57. https://doi.org/10.1080/16066359.2016.1197915

10.

Davis

L. L.

(1992). Instrument review: Getting the most from a panel of experts. Applied Nursing Research, 5(4), 194–197. https://doi.org/10.1016/S0897-1897(05)80008-4

11.

Dehghani

Zareei Mahmoodabadi

(2018). The effect of using virtual social networks on depression, anxiety, and stress among young adults. Social Behavior Research & Health, 2(1), 174–180

12.

Fung

(2019). Cross-cultural validation of the social media disorder scale. Psychology Research and Behavior Management, 12, 683-690. https://doi.org/10.2147/PRBM.S216788.

13.

Griffiths

M. D.

(2012). Facebook addiction: Concerns, criticism, and recommendations—a response to andreassen and colleagues. Psychological Reports, 110(2), 518–520. https://doi.org/10.2466/01.07.18.PR0.110.2.518-520

14.

Griffiths

M. D.

Kuss

D. J.

Demetrovics

(2014). Chapter 6 ‐ Social networking addiction: An overview of preliminary findings. In P. Kenneth, L. Rosenberg, and C. Feder (Eds.), Behavioral addictions: Criteria, evidence, and treatment (pp. 119–141). Academic Press. https://www.sciencedirect.com/science/article/pii/B9780124077249000069

15.

Hawi

Samaha

(2019). Identifying commonalities and differences in personality characteristics of internet and social media addiction profiles: Traits, self-esteem, and self-construal. Behaviour & Information Technology, 38(2), 110–119. https://doi.org/10.1080/0144929X.2018.1515984

16.

Hootsuite We Are Social . (2020, February 18). Digital 2020: Iran. DataReportal – global digital insights. Datareportal. https://datareportal.com/reports/digital-2020-iran

17.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.

18.

Hussain

Griffiths

M. D.

(2018). Problematic social networking site use and comorbid psychiatric disorders: A systematic review of recent large-scale studies. Frontiers in Psychiatry, 9, 686. https://doi.org/10.3389/fpsyt.2018.00686.

19.

Hussain

Wegmann

Yang

Montag

(2020). Social networks use disorder and associations with depression and anxiety symptoms: A systematic review of recent research in China. Frontiers in Psychology, 11, 211. https://doi.org/10.3389/fpsyg.2020.00211.

20.

Khodarahimi

Fathi

(2017). The role of online social networking on emotional functioning in a sample of Iranian adolescents and young adults. Journal of Technology in Human Services, 35(2), 120–134. https://doi.org/10.1080/15228835.2017.1293587

21.

King

D. L.

Chamberlain

S. R.

Carragher

Billieux

Stein

Mueller

Potenza

M. N.

Rumpf

H. J.

Saunders

Starcevic

Demetrovics

Brand

Lee

H. K.

Spada

Lindenberg

A. M. S.

Lemenager

Pallesen

Achab

Delfabbro

P. H.

(2020). Screening and assessment tools for gaming disorder: A comprehensive systematic review. Clinical Psychology Review, 77, 101831. https://doi.org/10.1016/j.cpr.2020.101831.

22.

Király

Bőthe

Ramos-Diaz

Rahimi-Movaghar

Lukavska

Hrabec

Miovsky

Billieux

Deleuze

Nuyens

Karila

Griffiths

M. D.

Nagygyörgy

Urbán

Potenza

M. N.

King

D. L.

Rumpf

H.-J.

Carragher

Demetrovics

(2018). Ten-Item Internet Gaming Disorder Test (IGDT-10): Measurement invariance and cross-cultural validation across seven language-based samples. Psychology of Addictive Behaviors. Journal of the Society of Psychologists in Addictive Behaviors, 33(1), 91–103. https://doi.org/10.1037/adb0000433

23.

Király

Sleczka

Pontes

H. M.

Urbán

Griffiths

M. D.

Demetrovics

(2017). Validation of the Ten-item internet gaming disorder test (IGDT-10) and evaluation of the nine DSM-5 internet gaming disorder criteria. Addictive Behaviors, 64, 253-260. https://doi.org/10.1016/j.addbeh.2015.11.005.

24.

Koo

T. K.

M. Y.

(2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012

25.

Lau

J. T. F.

P. K. H.

A. M. S.

Tang

Qin

(2016). Validation of the social networking activity intensity scale among junior middle school students in China. PLoS One, 11(10). https://doi.org/10.1371/journal.pone.0165695

26.

Lin

C.-Y.

Broström

Nilsen

Griffiths

M. D.

Pakpour

A. H.

(2017). Psychometric validation of the Persian Bergen Social Media Addiction Scale using classic test theory and rasch models. Journal of Behavioral Addictions, 6(4), 620–629. https://doi.org/10.1556/2006.6.2017.071.

27.

Machold

Judge

Mavrinac

Elliott

Murphy

A. M.

Roche

(2012). Social networking patterns/hazards among Irish teenagers. Irish Medical Journal, 105(5), 151–152.

28.

McHugh

M. L.

(2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22(3), 276-282. https://doi.org/10.11613/BM.2012.031.

29.

Monacis

De Palo

Griffiths

M. D.

Sinatra

(2017). Social networking addiction, attachment style, and validation of the Italian version of the Bergen Social Media Addiction Scale. Journal of Behavioral Addictions, 6(2), 178–186. https://doi.org/10.1556/2006.6.2017.023

30.

Muthén

L. K.

Muthén

B. O.

(2012). Mplus Version 7 user’s guide. Muthén & Muthén.

31.

Ostic

Qalati

S. A.

Barbosa

Shah

S. M. M.

Galvan Vela

Herzallah

A. M.

Liu

(2021). Effects of social media use on psychological well-being: A mediated model. Frontiers in Psychology, 12, 2381. https://doi.org/10.3389/fpsyg.2021.678766.

32.

Pittman

(2018). Happiness, loneliness, and social media: Perceived intimacy mediates the emotional benefits of platform use. The Journal of Social Media in Society, 7(2), 164–176.

33.

Pontes

H. M.

(2017). Investigating the differential effects of social networking site addiction and Internet gaming disorder on psychological health. Journal of Behavioral Addictions, 6(4), 601–610. https://doi.org/10.1556/2006.6.2017.075

34.

Ryan

Chester

Reece

Xenos

(2014). The uses and abuses of Facebook: A review of facebook addiction. Journal of Behavioral Addictions, 3(3), 133–148. https://doi.org/10.1556/JBA.3.2014.016

35.

Savci

Ercengiz

Aysan

(2018). Turkish adaptation of the social media disorder scale in adolescents. Archives of Neuropsychiatry, 55(3), 248–255. https://doi.org/10.5152/npa.2017.19285

36.

Schmitt

T. A.

(2011). Current methodological considerations in exploratory and confirmatory factor analysis. Journal of Psychoeducational Assessment, 29(4), 304–321. https://doi.org/10.1177/0734282911406653

37.

Statista (2020). Number of social media users worldwide 2010-2021. Statista.Com. https://www.statista.com/statistics/278414/number-of-worldwide-social-network-users/

38.

Tavakol

Dennick

(2011). Making sense of cronbach’s alpha. International Journal of Medical Education, 2, 53. https://dx.doi.org/10.5116/ijme.4dfb.8dfd.

39.

van den Eijnden

R. J. J. M.

Lemmens

J. S.

Valkenburg

P. M.

(2016). The social media disorder scale. Computers in Human Behavior, 61, 478-487. https://doi.org/10.1016/j.chb.2016.03.038.

40.

Wegmann

Brand

(2019). A narrative overview about psychosocial characteristics as risk factors of a problematic social networks use. Current Addiction Reports, 6(4), 402–409. https://doi.org/10.1007/s40429-019-00286-8.

41.

World Health Organization . (2016). Process of translation and adaptation of instruments. World Health Organization. https://www.who.int/substance_abuse/research_tools/translation/en/.

42.

World Health Organization . (2019). International statistical classification of diseases and related health problems (11th ed.). World Health Organization. https://icd.who.int/en.

43.

Zhou

Lian

Tian

Niu

Sun

(2017). The relationship between social network sites use and life satisfaction: A moderated mediation model. Psychological Development and Education, 33(3), 297–305. https://doi.org/10.16187/j.cnki.issn1001-4918.2017.03.06

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.35 MB