Despite problematic internet use being especially high among adolescents, there are no screening instruments in Spain specifically for adolescents that would facilitate early detection of this problem. The main goal of this study was to validate the Compulsive Internet Use Scale (CIUS) in the adolescent Spanish population as well as to analyze the discriminative capacity of CIUS based on sociodemographic characteristics, grade point average, and other addictive behaviors. Data were obtained from the ESTUDES, a representative survey of addictive behaviors of Spanish adolescents. The sample consisted of a total of 34,308 adolescents aged between 14 and 18 years old (Mage = 15.70; SD = 1.19; 51.7% females). Results indicated that the CIUS fit a unidimensional structure, exhibited measurement invariance with respect to sex and age, and demonstrated excellent reliability (ω = .94). Past-month tobacco, alcohol, and cannabis use, as well as past-year gambling and gaming, were related to CIUS scores. A standardized screening instrument that provides valid, reliable information on young people’s use of the Internet in Spain is a critical requirement for successful early detection and intervention in this population.
AlimoradiZ.LinC.BroströmA.BülowP.BajalanZ.GriffithsM.OhayonM.PakpourA. (2019). Internet addiction and sleep problems: A systematic review and meta-analysis. Sleep Medicine Reviews, 47, 51–61. https://doi.org/10.1016/J.SMRV.2019.06.004
2.
Al-KhaniA. M.SaquibJ.RajabA. M.KhalifaM. A.AlmazrouA.SaquibN. (2021). Internet addiction in Gulf countries: A systematic review and meta-analysis. Journal of Behavioral Addictions, 10(3), 601–610. https://doi.org/10.1556/2006.2021.00057
3.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Psychological Association.
4.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.).
5.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.).
6.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Publishing.
7.
AndersonD. R. (2008). Model based inference in the life sciences: A primer on evidence. Springer.
8.
ArpaciI. (2020). Gender differences in the relationship between problematic Internet use and nomophobia. Current Psychology, 41, 6558–6567. https://doi.org/10.1007/s12144-020-01160-x
9.
BakerF. (1985). The basics of item response theory. Heineman.
10.
BhandariP.NeupaneD.RijalS.ThapaK.MishraS.PoudyalA. (2017). Sleep quality, Internet addiction and depressive symptoms among undergraduate students in Nepal. BMC Psychiatry, 17(1), Article 106. https://doi.org/10.1186/S12888-017-1275-5
11.
BlancaM. J.EscobarM.LimaJ. F.ByrneD.AlarcónR. (2020). Psychometric properties of a short form of the Adolescent Stress Questionnaire (ASQ-14). Psicothema, 32(2), 261–267. https://doi.org/10.7334/PSICOTHEMA2019.288
12.
BurnhamK. P.AndersonD. R. (2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research, 33(2), 261–304. https://doi.org/10.1177/0049124104268644
CartierreN.CoulonN.DemervalR. (2011). Validation of a short French version for adolescents of the Compulsive Internet Use Scale. Neuropsychiatrie de l’Enfance et de l’Adolescence, 59(7), 415–419. https://doi.org/10.1016/J.NEURENF.2011.06.003
15.
ChenF. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
16.
ChenS. K.LoM. T.LinS. S. J. (2017). Impulsivity as a precedent factor for problematic Internet use: How can we be sure?International Journal of Psychology, 52(5), 389–397. https://doi.org/10.1002/ijop.12231
17.
CohenJ. (1988). Statistical power analysis for behavioral sciences. Lawrence Erlbaum.
18.
Cuenca-RoyoA.Sánchez-NiubóA.ForeroC.TorrensM.SuelvesJ.Domingo-SalvanyA. (2012). Psychometric properties of the CAST and SDS scales in young adult cannabis users. Addictive Behaviors, 37(6), 709–715. https://doi.org/10.1016/J.ADDBEH.2012.02.012
19.
Cuenca-RoyoA.Sánchez-NiubóA.TorrensM.SuelvesJ.Domingo-SalvanyA. (2013). The Cannabis Abuse Screening Test (CAST) for psychiatric disorders diagnosis in young cannabis users. Adicciones, 25(1), 87–88. https://pubmed.ncbi.nlm.nih.gov/23607121/
20.
DhirA.ChenS.NieminenM. (2015). Psychometric validation of the Chinese Compulsive Internet Use Scale (CIUS) with Taiwanese high school adolescents. Psychiatric Quarterly, 86(4), 581–596. https://doi.org/10.1007/s11126-015-9351-9
21.
Díaz-CárdenasS.Arrieta VergaraK.Simancas-PallaresM. (2019). Internet addiction and academic performance in dental students. Revista Colombiana de Psiquiatria, 48(4), 198–207. https://doi.org/10.1016/J.RCP.2018.03.002
22.
DowningM.AntebiN.SchrimshawE. (2014). Compulsive use of Internet-based sexually explicit media: Adaptation and validation of the Compulsive Internet Use Scale (CIUS). Addictive Behaviors, 39(6), 1126–1130. https://doi.org/10.1016/J.ADDBEH.2014.03.007
23.
FernandesB.AydinC.UzunB.Tan-MansukhaniR.BiswasU. (2021). Psychometric properties of the compulsive internet use scale among adolescents in India, Philippines and Turkey. Addictive Behaviors Reports, 13, 100349. https://doi.org/10.1016/J.ABREP.2021.100349
24.
FerrandoP. J.Lorenzo-SevaU. (2017). Program FACTOR at 10: Origins, development and future directions. Psicothema, 29(2), 236–240. https://doi.org/10.7334/PSICOTHEMA2016.304
25.
FerrandoP. J.Lorenzo-SevaU.Hernández-DoradoA.MuñizJ. (2022). [Decalogue for the factor analysis of test items]. Psicothema, 34(1), 7–17. https://doi.org/10.7334/psicothema2021.456
26.
Garrido-CalderónC.González-NavarroD.Seva-LorenzoU.Piera-FerrandoP. (2019). Multidimensional or essentially unidimensional? A multi-faceted factor-analytic approach for assessing the dimensionality of tests and items. Psicothema, 31(4), 450–457. https://doi.org/10.7334/PSICOTHEMA2019.153
27.
GmelG.KhazaalY.StuderJ.BaggioS.MarmetS. (2019). Development of a short form of the Compulsive Internet Use Scale in Switzerland. International Journal of Methods in Psychiatric Research, 28(1), e1765. https://doi.org/10.1002/MPR.1765
28.
Gómez-BenitoJ.HidalgoM. D.ZumboB. D. (2013). Effectiveness of combining statistical tests and effect sizes when using logistic discriminant function regression to detect differential item functioning for polytomous items. Educational and Psychological Measurement, 73(5), 875–897. https://doi.org/10.1177/0013164413492419
29.
GreerF.LiuJ. (2016). Creating short forms and screening measures. In SchweizerK.DiStefanoC. (Eds.), Principles and methods of test construction (pp. 272–287). Hogrefe Publishing.
30.
GriffithsM. D. (2009). A “components” model of addiction within a biopsychosocial framework. Journal of Substance Use, 10(4), 191–197. https://doi.org/10.1080/14659890500114359
31.
GriffithsM. D. (2018). Conceptual issues concerning Internet addiction and internet gaming disorder: Further critique on ryding and Kaye (2017). International Journal of Mental Health and Addiction, 16(1), 233–239. https://doi.org/10.1007/s11469-017-9818-z
32.
GuertlerD.BrodaA.BischofA.KastirkeN.MeerkerkG.JohnU.MeyerC.RumpfH. (2014). Factor structure of the compulsive internet use scale. Cyberpsychology, Behavior, and Social Networking, 17(1), 46–51. https://doi.org/10.1089/CYBER.2013.0076
33.
GuertlerD.RumpfH.BischofA.KastirkeN.PetersenK.JohnU.MeyerC. (2014). Assessment of problematic internet use by the Compulsive Internet Use Scale and the Internet Addiction Test: A sample of problematic and pathological gamblers. European Addiction Research, 20(2), 75–81. https://doi.org/10.1159/000355076
34.
GuoL.ShiG.DuX.WangW.GuoY.LuC. (2021). Associations of emotional and behavioral problems with Internet use among Chinese young adults: The role of academic performance. Journal of Affective Disorders, 287, 214–221. https://doi.org/10.1016/J.JAD.2021.03.050
35.
HiguchiS.NakayamaH.MiharaS.MaezonoM.KitayuguchiT.HashimotoT. (2017). Inclusion of gaming disorder criteria in ICD-11: A clinical perspective in favor Commentary on: Scholars’ open debate paper on the World Health Organization ICD-11 Gaming Disorder proposal (Aarseth et al.). Journal of Behavioral Addictions, 6(3), 293–295. https://doi.org/10.1556/2006.6.2017.049
36.
Hinojo-LucenaF.Aznar-DíazI.Cáceres-RecheM.Trujillo-TorresJ.Romero-RodríguezJ. (2019). Problematic Internet use as a predictor of eating disorders in students: A systematic review and meta-analysis study. Nutrients, 11(9), 2151. https://doi.org/10.3390/NU11092151
37.
HuL. T.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
38.
IBM Corp. (2016). IBM SPSS statistics for Windows (Version 24.0) [Computer software].
39.
JavaeedA.JeelaniR.GulabS.GhauriS. (2020). Relationship between internet addiction and academic performance of undergraduate medical students of Azad Kashmir. Pakistan Journal of Medical Sciences, 36(2), 229–233. https://doi.org/10.12669/PJMS.36.2.1061
40.
JeongH.YimH. W.LeeS. Y.LeeH. K.PotenzaM. N.JoS. J.SonH. J. (2019). Reciprocal relationship between depression and Internet gaming disorder in children: A 12-month follow-up of the iCURE study using cross-lagged path analysis. Journal of Behavioral Addictions, 8(4), 725–732. https://doi.org/10.1556/2006.8.2019.74
41.
JoY.BhangS.ChoiJ.LeeH.LeeS.KweonY. (2019). Clinical characteristics of diagnosis for internet gaming disorder: Comparison of DSM-5 IGD and ICD-11 GD diagnosis. Journal of Clinical Medicine, 8(7), 945. https://doi.org/10.3390/JCM8070945
42.
Jovičić-BurićD.MuslićL.KrašićS.MarkelićM.Pejnović FranelićI.Musić MilanovićS. (2021). Croatian validation of the Compulsive Internet Use Scale. Addictive Behaviors, 119, 106921. https://doi.org/10.1016/j.addbeh.2021.106921
43.
KhazaalY.ChattonA.AtwiK.ZullinoD.KhanR.BillieuxJ. (2011). Arabic validation of the Compulsive Internet Use Scale (CIUS). Substance Abuse Treatment, Prevention, and Policy, 6(1), Article 32. https://doi.org/10.1186/1747-597X-6-32
44.
KhazaalY.ChattonA.HornA.AchabS.ThorensG.ZullinoD.BillieuxJ. (2012). French validation of the Compulsive Internet Use Scale (CIUS). Psychiatric Quarterly, 83(4), 397–405. https://doi.org/10.1007/s11126-012-9210-x
45.
KotyukE.MagiA.EisingerA.KirályO.VereczkeiA.BartaC.GriffithsM.SzékelyA.KökönyeiG.FarkasJ.KunB.BadgaiyanR.UrbánR.BlumK.DemetrovicsZ. (2020). Co-occurrences of substance use and other potentially addictive behaviors: Epidemiological results from the Psychological and Genetic Factors of the Addictive Behaviors (PGA) Study. Journal of Behavioral Addictions, 9(2), 272–288. https://doi.org/10.1556/2006.2020.00033
46.
Lanthier-LabontéS.DufourM.MilotD.LoslierJ. (2020). Is problematic Internet use associated with alcohol and cannabis use among youth? A systematic review. Addictive Behaviors, 106, 106331. https://doi.org/10.1016/J.ADDBEH.2020.106331
47.
LiL.GriffithsM. D.MeiS.NiuZ. (2021). The mediating role of impulsivity and the moderating role of gender between fear of missing out and gaming disorder among a sample of Chinese University Students. Cyberpsychology, Behavior, and Social Networking, 24(8), 550–557. http://doi.org/10.1089/cyber.2020.0283
48.
López-FernándezO.GriffithsM. D.KussD. J.DawesC.PontesH. M.JusticeL.RumpfH. J.BischofA.GässlerA. K.SuryaniE.MännikköN.KääriänenM.RomoL.MorvanY.KernL.GrazianiP.RousseauA.HormesJ. M.SchimmentiA.BillieuxJ. (2019). Cross-cultural validation of the Compulsive Internet Use Scale in four forms and eight languages. Cyberpsychology, Behavior, and Social Networking, 22(7), 451–464. https://doi.org/10.1089/cyber.2018.0731
49.
MachimbarrenaJ.González-CabreraJ.Ortega-BarónJ.Beranuy-FarguesM.Álvarez-BardónA.TejeroB. (2019). Profiles of problematic Internet use and its impact on adolescents’ health-related quality of life. International Journal of Environmental Research and Public Health, 16(20), 3877. https://doi.org/10.3390/IJERPH16203877
50.
MariE.BiondiS.VarchettaM.CricentiC.FraschettiA.PizzoA.BarchielliB.RomaP.Marti-VilarM.GonzàlezF.MariaA.QuaglieriA. (2023). Gender differences in Internet addiction: A study on variables related to its possible development. Computers in Human Behavior Reports, 9, 100247. https://doi.org/10.1016/j.chbr.2022.100247
51.
MarinoC.CanaleN.VienoA.CaselliG.ScacchiL.SpadaM. M. (2020). Social anxiety and Internet gaming disorder: The role of motives and metacognitions. Journal of Behavioral Addictions, 9(3), 617–628. https://doi.org/10.1556/2006.2020.00044
52.
Marín-VilaM.Carballo-CrespoJ. L.Coloma-CarmonaA. (2018). Rendimiento académico y cognitivo en el uso problemático de Internet [Academic outcomes and cognitive performance in problematic Internet use]. Adicciones, 30(2), 101–110. https://doi.org/10.20882/ADICCIONES.844
53.
MeerkerkG. J.Van Den EijndenR. J. J. M.VermulstA. A.GarretsenH. F. L. (2009). The Compulsive Internet Use Scale (CIUS): Some psychometric properties. CyberPsychology & Behavior, 12(1), 1–6. https://doi.org/10.1089/cpb.2008.0181
54.
MihajlovM.VejmelkaL. (2017). Internet addiction: A review of the first twenty years. Psychiatria Danubina, 29(3), 260–272. https://doi.org/10.24869/psyd.2017.260
55.
MillsapR. E. (2011). Statistical approaches to measurement invariance. Routledge.
56.
MonacisL.SinatraM.GriffithsM. D.de PaloV. (2018). Assessment of the Italian Version of the Internet Disorder Scale (IDS-15). International Journal of Mental Health and Addiction, 16(3), 680–691. https://doi.org/10.1007/s11469-017-9823-2
57.
MoonS.HwangJ.KimJ.ShinA.BaeS.KimJ. (2018). Psychometric properties of the Internet Addiction Test: A systematic review and meta-analysis. Cyberpsychology, Behavior, and Social Networking, 21(8), 473–484. https://doi.org/10.1089/CYBER.2018.0154
58.
MüllerK. W.BeutelM. E.DreierM.WölflingK. (2019). A clinical evaluation of the DSM-5 criteria for Internet Gaming Disorder and a pilot study on their applicability to further Internet-related disorders. Journal of Behavioral Addictions, 8(1), 16–24. https://doi.org/10.1556/2006.7.2018.140
PanY. C.ChiuY. C.LinY. H. (2020). Systematic review and meta-analysis of epidemiology of internet addiction. Neuroscience & Biobehavioral Reviews, 118, 612–622. https://doi.org/10.1016/j.neubiorev.2020.08.013
62.
PetryN. M.O’BrienC. P. (2013). Internet gaming disorder and the DSM-5. Addiction, 108(7), 1186–1187. https://doi.org/10.1111/ADD.12162
63.
PetryN. M.RehbeinF.GentileD. A.LemmensJ. S.RumpfH.-J.MößleT.BischofG.TaoR.FungD. S. S.BorgesG.AuriacombeM.IbáñezA. G.TamP.O’BrienC. P. (2014). An international consensus for assessing internet gaming disorder using the new DSM-5 approach. Addiction, 109(9), 1399–1406. https://doi.org/10.1111/ADD.12457
64.
PostigoÁ.García-CuetoE.CuestaM.Menéndez-AllerÁ.Prieto-DíezF.LozanoL. M. (2020). Assessment of the enterprising personality: A short form of the BEPE battery. Psicothema, 32(4), 575–582. https://doi.org/10.7334/PSICOTHEMA2020.193
65.
RestrepoA.ScheiningerT.ClucasJ.AlexanderL.SalumG.GeorgiadesK.PaksarianD.MerikangasK.MilhamM. (2020). Problematic internet use in children and adolescents: Associations with psychiatric disorders and impairment. BMC Psychiatry, 20(1), Article 252. https://doi.org/10.1186/S12888-020-02640-X
66.
RosseelY. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(1), 1–36. https://doi.org/10.18637/JSS.V048.I02
67.
RückerJ.AkreC.BerchtoldA.SurisJ. C. (2015). Problematic Internet use is associated with substance use in young adolescents. Acta Paediatrica, 104(5), 504–507. https://doi.org/10.1111/APA.12971
68.
RydingF. C.KayeL. K. (2018). “Internet addiction”: A conceptual minefield. International Journal of Mental Health and Addiction, 16(1), 225–232. https://doi.org/10.1007/s11469-017-9811-6
69.
SamejimaF. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34(4), 1–97. https://psycnet.apa.org/record/1972-04809-001
70.
SarmientoA.ZychI.Herrera-LópezM.Delgado SánchezU.OksanenA. (2021). Psychometric properties of the Compulsive Internet Use Scale in Spain, Colombia, and Mexico. Cyberpsychology, Behavior, and Social Networking, 24(2), 108–116. https://doi.org/10.1089/cyber.2020.0046
71.
ThompsonM. S. (2016). Assessing measurement invariance of scales using multiple group structural equation modeling. In SchweizerK.DiStefanoC. (Eds.), Principles and methods of test construction (pp. 218–246). Hogrefe Publishing.
72.
TimmermanM.Lorenzo-SevaU. (2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods, 16(2), 209–220. https://doi.org/10.1037/A0023353
73.
TsitsikaA.CritselisE.JanikianM.KormasG.KafetzisD. (2011). Association between internet gambling and problematic internet use among adolescents. Journal of Gambling Studies, 27(3), 389–400. https://doi.org/10.1007/S10899-010-9223-Z
74.
WartbergL.PetersenK.KammerlR.RosenkranzM.ThomasiusR. (2014). Psychometric validation of a German version of the Compulsive Internet Use Scale. Cyberpsychology, Behavior, and Social Networking, 17(2), 99–103. https://doi.org/10.1089/CYBER.2012.0689
75.
WhittakerT. A. (2011). Using the modification index and standardized expected parameter change for model modification. The Journal of Experimental Education, 80(1), 26–44. https://doi.org/10.1080/00220973.2010.531299
76.
YangJ.GuoX.DuX.JiangY.WangW.XiaoD.WangT.LuC.GuoL. (2018). Association between problematic internet use and sleep disturbance among adolescents: The role of the child’s sex. International Journal of Environmental Research and Public Health, 15(12), 2682. https://doi.org/10.3390/IJERPH15122682
77.
YauY.PilverC.SteinbergM.RugleL.HoffR.Krishnan-SarinS.PotenzaM. (2014). Relationships between problematic internet use and problem-gambling severity: Findings from a high-school survey. Addictive Behaviors, 39(1), 13–21. https://doi.org/10.1016/J.ADDBEH.2013.09.003
78.
YongR.InoueA.KawakamiN. (2017). The validity and psychometric properties of the Japanese version of the Compulsive Internet Use Scale (CIUS). BMC Psychiatry, 17(1), Article 201. https://doi.org/10.1186/S12888-017-1364-5
