This study developed and validated the Adolescents’ Online Risk Behavior Scale (AORBS), a comprehensive instrument designed to assess multifaceted online risks among adolescents. Grounded in qualitative insights from interviews with adolescents, parents, and experts, the AORBS integrates three overarching domains—conduct, content, and contact risks—into a hierarchical structure encompassing six empirically derived factors: cyber aggression, internet addiction, harmful information inducement, consumer inducement, data breaches, and information fraud. Psychometric testing (N = 1,816 Chinese adolescents) demonstrated robust validity and reliability. Exploratory and confirmatory factor analyses confirmed a stable six-factor model (Comparative Fit Index = 0.92, Tucker–Lewis Index = 0.91, Root Mean Square Error of Approximation = 0.04), with high internal consistency (α = .88–.90 for subscales; α = .90 for the total scale). Convergent and discriminant validity were established through factor loadings (>0.60), average variance extracted (AVE > 0.50), and correlations with online disinhibition (r = .19–.33, p < .001). Distinctive contributions include capturing emerging digital risks (e.g., data breaches, fraud) and addressing cultural relevance for collectivist contexts. The AORBS provides a validated tool for identifying at-risk adolescents, informing interventions, and advancing research on evolving online threats.
BaraldiA. N.EndersC. K. (2010). An introduction to modern missing data analyses. Journal of School Psychology, 48(1), 5–37.
2.
BarlettC. P.GentileD. A. (2021). Attacking others online: The role of anonymity, aggressive traits, and moral disengagement. Psychology of Popular Media, 10(1), 1–8. https://doi.org/10.1037/ppm0000306
3.
BronfenbrennerU. (1979). The ecology of human development: Experiments by nature and design. Harvard university press.
4.
ButtonM.CrossC. (2017). Cyber frauds, scams and their victims. Routledge.
5.
CampbellD. T.FiskeD. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016
6.
CaplanS. E. (2010). Theory and measurement of generalized problematic Internet use: A two-step approach. Computers in Human Behavior, 26(5), 1089–1097.
7.
CheungC. M. K.WongR. Y. M.ChanT. K. H. (2021). Online disinhibition: conceptualization, measurement, and implications for online deviant behavior. Industrial Management + Data Systems, 121(1), 48–64. https://doi.org/10.1108/IMDS-08-2020-0509
ChoH.KwonM.ChoiJ. H.LeeS. K.ChoiJ. S.ChoiS. W.KimD. J. (2014). Development of the Internet addiction scale based on the Internet Gaming Disorder criteria suggested in DSM-5. Addictive Behaviors, 39(9), 1361–1366.
10.
ChuX.LiQ.FanC.JiaY. (2023). Life stress and cyberbullying: examining the mediating roles of expressive suppression and online disinhibition. Journal of Youth and Adolescence, 52(8), 1647–1661.
11.
ChunJ.KimJ.LeeS. (2023). Development of a cyberbullying victimization scale for adolescents in South Korea. Children and Youth Services Review, 144, 106744.
12.
ChunJ.LeeJ.KimJ.LeeS. (2020). An international systematic review of cyberbullying measurements. Computers in Human Behavior, 113, 106485.
13.
DemetrovicsZ.SzerediB.RózsaS. (2008). The three-factor model of Internet addiction: The development of the Problematic Internet Use Questionnaire. Behavior Research Methods, 40, 563–574.
14.
DeVellisR. F. (2016). Scale development: Theory and applications (4th ed.). SAGE publications.
15.
El AsamA.SamaraM.TerryP. (2019). Problematic internet use and mental health among British children and adolescents. Addictive Behaviors, 90, 428–436.
16.
EloS.KyngäsH. (2008). The qualitative content analysis process. Journal of Advanced Nursing, 62(1), 107–115.
FahyA. E.StansfeldS. A.SmukM.SmithN. R.CumminsS.ClarkC. (2016). Longitudinal associations between cyberbullying involvement and adolescent mental health. Journal of Adolescent Health, 59(5), 502–509.
19.
FinkelhorD.WalshK.JonesL.MitchellK.CollierA. (2021). Youth internet safety education: Aligning programs with the evidence base. Trauma, Violence, & Abuse, 22(5), 1233–1247.
20.
FornellC.LarckerD. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
21.
Gámez-GuadixM.Villa-GeorgeF. I.CalveteE. (2012). Measurement and analysis of the cognitive-behavioral model of generalized problematic Internet use among Mexican adolescents. Journal of Adolescence, 35(6), 1581–1591.
22.
GengJ.BaoL.WangH.WangJ.WeiX.LeiL. (2022). The relationship between childhood maltreatment and adolescents’ cyberbullying victimization: The new phenomenon of a “cycle of victimization.”Child Abuse & Neglect, 134, 105888.
23.
GerrardY. (2025). The kids are online: Confronting the myths and realities of young digital life (pp.24–46). University Univ of California Press.
24.
HairJ. F.RisherJ. J.SarstedtM.RingleC. M. (2019). When to use and how to report the results of PLS-SEM. European Business Review, 31(1), 2–24. https://doi.org/10.1108/EBR-11-2018-0203
25.
HamiltonJ. L.DreierM. J.BoydS. I. (2023). Social media as a bridge and a window: The changing relationship of adolescents with social media and digital platforms. Current Opinion in Psychology, 52, 101633.
HindujaS.PatchinJ. W. (2019). Connecting adolescent suicide to the severity of bullying and cyberbullying. Journal of School Violence, 18(3), 333–346.
28.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
29.
HuangD.LuoY.HeX.HongL.ZhangB. (2024). A qualitative study on parental mediation of rural-to-urban migrant children’s smartphone use in China: Concerns, strategies and challenges. Child & Family Social Work, 29(1), 195–204.
30.
JelenchickL. A.EickhoffJ.ChristakisD. A.BrownR. L.ZhangC.BensonM.MorenoM. A. (2014). The Problematic and Risky Internet Use Screening Scale (PRIUSS) for adolescents and young adults: Scale development and refinement. Computers in Human Behavior, 35, 171–178.
31.
JessorR. (1987). Problem-behavior theory, psychosocial development, and adolescent problem drinking. British Journal of Addiction, 82(4), 331–342.
32.
JessorR. (2018). Reflections on six decades of research on adolescent behavior and development. Journal of Youth and Adolescence, 47(3), 473–476.
33.
KaiserH. F. (1964). A method for determining eigenvalues. Journal of the Society for Industrial and Applied Mathematics, 12(1), 238–248.
34.
Kardefelt-WintherD.HeerenA.SchimmentiA.Van RooijA.MaurageP.CarrasM.EdmanJ.BlaszczynskiA.KhazaalY.BillieuxJ. (2017). How can we conceptualize behavioural addiction without pathologizing common behaviours?. Addiction, 112(10), 1709–1715.
35.
KerrC.NixonA.WildD. (2010). Assessing and demonstrating data saturation in qualitative inquiry supporting patient-reported outcomes research. Expert Review of Pharmacoeconomics & Outcomes Research, 10(3), 269–281.
36.
KlineR. B. (2016). Principles and practice of structural equation modeling (4th ed.). Guilford Press.
37.
KowalskiR. M.GiumettiG. W.SchroederA. N.LattannerM. R. (2014). Bullying in the digital age: a critical review and meta-analysis of cyberbullying research among youth. Psychological Bulletin, 140(4), 1073.
38.
LeeC.ShinN. (2017). Prevalence of cyberbullying and predictors of cyberbullying perpetration among Korean adolescents. Computers in Human Behavior, 68, 352–358.
39.
LiJ.WuY.HeskethT. (2023). Internet use and cyberbullying: Impacts on psychosocial and psychosomatic wellbeing among Chinese adolescents. Computers in Human Behavior, 138, 107461.
40.
LinM.KimY. (2020). The reliability and validity of the 18-item long form and two short forms of the Problematic Internet Use Questionnaire in three Japanese samples. Addictive Behaviors, 101, 105961.
41.
LivingstoneS.ÓlafssonK.HelsperE. J.Lupiáñez-VillanuevaF.VeltriG. A.FolkvordF. (2017). Maximizing opportunities and minimizing risks for children online: The role of digital skills in emerging strategies of parental mediation. Journal of Communication, 67(1), 82–105.
42.
LivingstoneS.Sefton-GreenJ. (2016). The class: Living and learning in the digital age. New York University Press.
43.
LivingstoneS.StoilovaM. (2021). The 4Cs: Classifying online risk to children. Contemporary Issues in Early Childhood, 22(2), 1–12. https://doi.org/10.1177/14639491211012243.
44.
MarchE.GrieveR.MarringtonJ. (2023). The relationship between toxic online disinhibition and risky social media use in adolescents. Computers in Human Behavior, 139, 107522. https://doi.org/10.1016/j.chb.2022.107522
45.
MitchellK. J.WellsM.PriebeG.YbarraM. L. (2014). Exposure to websites that encourage self-harm and suicide: Prevalence rates and association with actual thoughts of self-harm and thoughts of suicide in the United States. Journal of Adolescence, 37(8), 1335–1344. https://doi.org/10.1016/j.adolescence.2014.09.011
46.
MuthénB.MuthénL. (2017). Mplus. In Handbook of item response theory (pp. 507–518). Chapman and Hall/CRC.
47.
OjedaM.DodajA.CasasJ. A.SesarK.Del ReyR. (2025). Cross-cultural validation of the sexting behaviors and motives questionnaire (SBM-Q). Psicothema, 37(1), 60.
48.
PallantJ. (2020). SPSS survival manual: A step by step guide to data analysis using IBM SPSS. Routledge.
49.
PatchinJ. W.HindujaS. (2015). Measuring cyberbullying: Implications for research. Aggression and Violent Behavior, 23, 69–74.
RenW.ZhuX. (2022). Parental mediation and adolescents’ internet use: The moderating role of parenting style. Journal of Youth and Adolescence, 51(8), 1483–1496.
52.
Rodríguez-de-DiosI.van OostenJ. M.IgartuaJ. J. (2018). A study of the relationship between parental mediation and adolescents’ digital skills, online risks and online opportunities. Computers in Human Behavior, 82, 186–198. https://doi.org/10.1016/j.chb.2018.01.012
53.
SchilderJ. D.BrusselaersM. B. J.BogaertsS. (2016). The effectiveness of an intervention to promote awareness and reduce online risk behavior in early adolescence. Journal of Youth and Adolescence, 45(2), 286–300. https://doi.org/10.1007/s10964-015-0401-2
54.
ShevlinM. E.LewisC. A. (1999). The revised social anxiety scale: Exploratory and confirmatory factor analysis. The Journal of Social Psychology, 139(2), 250–252.
55.
SmahelD.MachackovaH.MascheroniG.DedkovaL.StaksrudE.O’lafssonK.LivingstoneS.HasebrinkU. (2020). EU kids online 2020: Survey results from 19 countries. School of Economics and Political Science. https://doi.org/10.21953/lse.47fdeqj01ofo
56.
StanickeL. I.HermansenM. H.HalvorsenM. S. (2024). A transitional object for relatedness and self-development-A meta-synthesis of youths’ experience of engagement in self-harm content online. Child & Family Social Work, 29(1), 270–286. https://doi.org/10.1111/cfs.13058
TabachnickB.FidellL. (2014). Using multivariate statistics: Pearson new international edition. Pearson Education Limited.
59.
TerweeC. B.PrinsenC. A.ChiarottoA.WestermanM. J.PatrickD. L.AlonsoJ.BouterL. M.de VetH. C. W.MokkinkL. B. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Quality of Life Research, 27, 1159–1170.
60.
TourangeauR.YanT. (2007). Sensitive questions in surveys. Psychological Bulletin, 133(5), 859–883.
61.
TwengeJ. M.JoinerT. E.RogersM. L.MartinG. N. (2018). Increases in depressive symptoms, suicide-related outcomes, and suicide rates among US adolescents after 2010 and links to increased new media screen time. Clinical Psychological Science, 6(1), 3–17.
62.
UdrisR. (2014). Cyberbullying among high school students in Japan: Development and validation of the Online Disinhibition Scale. Computers in Human Behavior, 41, 253–261.
63.
ValckeM.De WeverB.Van KeerH.SchellensT. (2011). Long-term study of safe Internet use of young children. Computers & Education, 57(1), 1292–1305.
64.
WachsS.WrightM. F. (2018). Associations between bystanders and perpetrators of online hate: The moderating role of toxic online disinhibition. International Journal of Environmental Research and Public Health, 15(9), 2030.
65.
WangL.JiangS.ZhouZ.FeiW.WangW. (2024). Online disinhibition and adolescent cyberbullying: A systematic review. Children and Youth Services Review, 156, 107352.
66.
WangH.LeiL. (2022). The relationship between parental phubbing and short-form videos addiction among Chinese adolescents. Journal of Research on Adolescence, 32(4), 1580–1591.
67.
WangL. H.MetzgerM. J. (2023). The role of culture in privacy management on social media among emerging adult children and their parents. Journal of International and Intercultural Communication, 16(2), 162–190.
68.
WangL.NgaiS. S. Y. (2021). Understanding the effects of personal factors and situational factors for adolescent cyberbullying perpetration: The roles of internal states and parental mediation. Journal of Adolescence, 89, 28–40. https://doi.org/10.1016/j.adolescence.2021.03.006
69.
WangX.QiaoY.LiW.DongW. (2022). How is online disinhibition related to adolescents’ cyberbullying perpetration? Empathy and gender as moderators. The Journal of Early Adolescence, 42(5), 704–732.
WeiH.LiuM. (2022). Loving your parents and treating others well: The effect of filial piety on cyberbullying perpetration and its functional mechanism among Chinese graduate students. Journal of Interpersonal Violence, 37(11–12), NP8670–NP8695.
72.
WilloughbyT.ChalmersH.BusseriM. A. (2004). Where is the syndrome? Examining co-occurrence among multiple problem behaviors in adolescence. Journal of Consulting and Clinical Psychology, 72(6), 1022–1037.
73.
WrightM. F.HarperB. D.WachsS. (2022). The associations between cyberbullying perpetration, the online disinhibition effect, and social-emotional problems. Journal of Youth and Adolescence, 51(5), 939–951. https://doi.org/10.1007/s10964-022-01591-8
74.
YangC.DuJ.LiX.LiW.HuangC.ZhangY.ZhaoY. (2025). Association between parental phubbing and short-form video addiction: A moderated mediation analysis among Chinese adolescents. Journal of Affective Disorders, 369, 523–530.
75.
ZhangX. A.CozmaR. (2022). Risk sharing on Twitter: Social amplification and attenuation of risk in the early stages of the COVID-19 pandemic. Computers in Human Behavior, 126, 106983.
76.
ZhaoQ.HuangY.LiC. (2022). Does adolescents’ Internet addiction trigger depressive symptoms and aggressive behavior, or vice versa? The moderating roles of peer relationships and gender. Computers in Human Behavior, 129, 107143. https://doi.org/10.1016/j.chb.2021.107143
