Online flow refers to the rate of an individual's absorbance in an Internet activity in which they are engaged. It has been implicated with both the effectiveness of cyberhealth and online education applications, as well as excessive Internet use. One way of assessing it is the Online Flow Questionnaire (OFQ). Consequently, this study investigated the optimum measurement of online flow, as well as OFQ cutoff points, using Item Response Theory (IRT). A large sample of high school students from Greece (N = 1579, Mage = 16.12, SDage = 0.85; 50.5 percent females) completed the OFQ and the data were analyzed using IRT procedures. The analysis indicated that items in the OFQ possess differing levels of discrimination and difficulty, although all items were generally within acceptable ranges. An OFQ cutoff score of 5 represented an extremely high level of online flow experiences. The findings suggest that the OFQ generally functions as an acceptable marker of overall online flow. However, the current format of the OFQ appears to inhibit its ability to detect variability at the extreme low and high ends of the latent trait in the population assessed. Future revisions (potentially employing computerized adaptive tests) of the OFQ response format may enhance its utility.
Get full access to this article
View all access options for this article.
References
1.
AndersonEL, SteenE, StavropoulosV. Internet use and problematic internet use: A systematic review of longitudinal research trends in adolescence and emergent adulthood. Int J Adolesc Youth, 2017; 22(4):430–454; doi: 10.1080/02673843.2016.1227716
2.
KaoG, JoynerK, BalistreriKS. The Company We Keep: Interracial Friendships and Romantic Relationships from Adolescence to Adulthood. Russell Sage Foundation: New York; 2019; 208 p.
3.
Internet World Stats. World Internet Users Statistics and 2020 World Population Stats. Internetworldstats.com. Available from: https://www.Internetworldstats.com/stats.htm [Last accessed August8, 2020].
4.
RagneddaM. The Third Digital Divide: A Weberian Approach to Digital Inequalities. Routledge: London; 2017; 136 p.
5.
ScheerderA, Van DeursenA, Van DijkJ. Determinants of Internet skills, uses and outcomes. A systematic review of the second-and third-level digital divide. Telemat Inform, 2017; 34(8):1607–1624; doi: 10.1016/j.tele.2017.07.007
6.
Salmela-AroK, MuotkaJ, AlhoK, et al.School burnout and engagement profiles among digital natives in Finland: A person-oriented approach. Eur J Dev Psychol, 2016; 13(6):704–718; doi: 10.1080/17405629.2015.1107542
7.
AlexandrakiK, StavropoulosV, BurleighTL, et al.Internet pornography viewing preference as a risk factor for adolescent internet addiction: The moderating role of classroom personality factors. J Behav Addict, 2018; 7(2):423–432; doi: 10.1556/2006.7.2018.34
8.
CashH, RaeCD, SteelAH, WinklerA. Internet addiction: A brief summary of research and practice. Curr Psychiatry Rev, 2012; 8(4):292–298; doi: 10.2174/157340012803520513
9.
StavropoulosV, BurleighTL, BeardCL, et al.Being there: A preliminary study examining the role of presence in internet gaming disorder. Int J Ment Health Addict, 2019; 17(4):880–890. doi: 10.1007/s11469-018-9891-y
10.
HuE, StavropoulosV, AndersonA, et al.Internet gaming disorder: Feeling the flow of social games. Addict Behav Rep, 2019; 9:100140; doi: 10.1016/j.abrep.2018.10.004
11.
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (5th ed.). APA: Washington; 2013; 947 p.
12.
StavropoulosV, BurleighTL, BeardCL, et al.Being there: A preliminary study examining the role of presence in internet gaming disorder. Int J Ment Health Addict, 2019; 17(4):880–890; doi: 10.1007/s11469-018-9891-y
13.
ChenH, WigandRT, NilanMS. Optimal experience of web activities. Comput Hum Behav, 1999; 15(5):585–608; doi: 10.1016/S0747-5632(99)00038-2
14.
NakamuraJ, CsikszentmihalyiM. The Concept of Flow. InFlow and the Foundations of Positive Psychology. Springer: Dordrecht; 2014; 298 p.
15.
StavropoulosV, AlexandrakiK, Motti-StefanidiF. Flow and telepresence contributing to internet abuse: Differences according to gender and age. Comput Hum Behav, 2013; 29(5):1941–1948; doi: 10.1556/2006.6.2017.026
16.
KelleyTM, PranskyJ, LambertEG. Realizing improved mindfulness/flow/mental health through understanding three spiritual principles. J Spirit Ment Health, 2017; 19(2):133–150; doi: 10.1080/19349637.2016.1215855
17.
SanjamsaiS, PhukaoD. Flow experience in computer game playing among Thai University students. Kasetsart J Soc Sci, 2018; 39(2):175–182; doi: 10.1016/j.kjss.2018.03.003
18.
LiuCC.A model for exploring players flow experience in online games. Inf Technol People, 2017; 30(1):139–162; doi: 10.1108/ITP-06-2015-0139
19.
WebsterJ, TrevinoLK, RyanL. The dimensionality and correlates of flow in human-computer interactions. Comput Hum Behav, 1993; 9(4):411–426; doi: 10.1016/0747–5632(93)90032-N
SiciliaM, RuizS. The role of flow in web site effectiveness. J Interact Advert, 2007; 8(1):33–44; doi: 10.1080/15252019.2007.10722135
22.
StavropoulosV, GriffithsMD, BurleighTL, et al.Flow on the Internet: A longitudinal study of Internet addiction symptoms during adolescence. Behav Inf Technol, 2018; 37(2):159–172; doi: 10.1080/0144929X.2018.1424937
23.
HuE, StavropoulosV, AndersonA, et al.Assessing online flow across cultures: A two-fold measurement invariance study. Front Psychol, 2019; 10:407; doi: 10.3389/fpsyg.2019.00407
24.
JamshidiD, KeshavarzY, KazemiF, et al.Mobile banking behavior and flow experience: An integration of utilitarian features, hedonic features and trust. Int J Soc Econ, 2018; 45(1):57–81; doi: 10.1108/IJSE-10-2016-0283
25.
WeberR, TamboriniR, Westcott-BakerA, et al.Theorizing flow and media enjoyment as cognitive synchronization of attentional and reward networks. Commun Theory, 2009; 19(4):397–422; doi: 10.1111/j.1468–2885.2009.01352.x
26.
WuTY, LinCY, ÅrestedtK, et al.Psychometric validation of the Persian nine-item Internet Gaming Disorder Scale–Short Form: Does gender and hours spent online gaming affect the interpretations of item descriptions?. J Behav Addict, 2017; 6(2):256–263; doi: 10.1556/2006.6.2017.025
27.
StavropoulosV, MastrotheodorosS, BurleighTL, et al.Avoidant romantic attachment in adolescence: Gender, excessive internet use and romantic relationship engagement effects. PLoS One, 2018; 13(7):e0201176; doi: 10.1371/journal.pone.0201176
28.
StavropoulosV, GomezR, Motti-StefanidiF. Internet gaming disorder: A pathway towards assessment consensus. Front Psychol, 2019; 10:1822; doi: 10.3389/fpsyg.2019.01822
29.
StavropoulosV, O'FarrellDL, BaynesKL, et al.Depression and disordered gaming: Does culture matter?. Int J Ment Health Addict, 2020; 20:843–861; doi: 10.1007/s11469-020-00231-1
30.
StavropoulosV, MastrotheodorosS, PapapetrouS, et al.Measurement invariance: The case of measuring romantic attachment in Greek and Cypriot adolescents. Eur J Dev Psychol, 2019; 16(3):362–371; doi: 10.1080/17405629.2017.1414696
31.
GomezR, StavropoulosV, BeardC, et al.Item response theory analysis of the recoded internet gaming disorder scale-short-form (IGDS9-SF). Int J Ment Health Addict, 2019; 17(4):859–879; doi: 10.1007/s11469-018-9890-z
32.
StavropoulosV, MongerK, ZarateD, et al.Online gambling disorder questionnaire (OGD-Q): An item response theory examination. Addict Behav Rep, 2022; 16:100449; doi: 10.1016/j.abrep.2022.100449
33.
ZarateD, FullwoodL, ProkofievaM, et al.Problematic shopping behavior: An item response theory examination of the seven-item Bergen shopping addiction scale. Int J Ment Health Addict, 2022; doi: 10.1007/s11469-022-00844-4
34.
ZarateD, MarmaraJ, PotocznyC, et al.Body Appreciation Scale (BAS-2): Measurement invariance across genders and item response theory examination. BMC Psychol, 2021; 9(1):1–15; doi: 10.1186/s40359-021-00609-3
35.
MarmaraJ, ZarateD, VassalloJ, et al.Warwick Edinburgh mental well-being scale (WEMWBS): Measurement invariance across genders and item response theory examination. BMC Psychol, 2022; 10(1):31; doi: 10.1186/s40359-022-00720-z
36.
LittleRJ.A test of missing completely at random for multivariate data with missing values. J Am Stat Assoc, 1988; 83(404):1198–1202.
37.
ViladrichC, Angulo-BrunetA, DovalE. A journey around alpha and omega to estimate internal consistency reliability. Ann Psychol, 2017; 33(3):755–782; doi: 10.6018/analesps.33.3.268401
38.
BeatonD, BombardierC, GuilleminF, et al. Recommendations for the Cross-Cultural Adaptation of Health Status Measures. American Academy of Orthopaedic Surgeons: New York; 2002, Vol. 12; pp. 1–9.
OrlandoM, ThissenD. Likelihood-based item fit-indices for dichotomous item response theory models. Appl Psychol Measure, 2000; 24(1):50–64; doi: 10.1177/01466216000241003
41.
HuLT, BentlerPM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model, 1999; 6(1):1–55; doi: 10.1080/10705519909540118
42.
StoneCA, ZhangB. Assessing goodness of fit of item response theory models: A comparison of traditional and alternative procedures. J Educ Measure, 2003; 40(4):331–352; doi: 10.1111/j.1745–3984.2003.tb01150.x
43.
RosseelY.Lavaan: An R package for structural equation modelling. J Stat Softw, 2021; 48(2):1–36; doi: 10.18637/jss.v048.i02
44.
ChenWH, ThissenD. Local dependence indexes for item pairs using item response theory. J Educ Behav Stat, 1997; 22(3):265–289; doi: 10.2307/1165285
45.
BockRD, AitkinM. Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 1981; 46(4):443–459.
ZarateD, BallM, MontagC, et al.Unravelling the web of addictions: A network analysis approach. Addict Behav Rep, 2022; 15:100406; doi: 10.1016/j.abrep.2022.100406
48.
AppelM, GnambsT, RichterT, et al.The Transportation Scale–Short Form (TS–SF). Media Psychol, 2015; 18(2):243–266; doi: 10.1080/15213269.2014.987400
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
