Video Game Pursuit (VGPu) Scale Development: Designing and Validating a Scale With Implications for Game-Based Learning and Assessment

Abstract

Background. Recent research on game-based assessment and training demonstrates growing interest in how individual differences affect game-based outcomes. However, there is still a lack of clarity about the variables that affect important game-based outcomes and issues with measurement approaches regarding these variables (e.g., no validation of scales). This study develops a model where video game pursuit (VGPu) is measured as an antecedent to entering the gaming cycle. We propose that VGPu-related antecedents lead to a feedback loop where engaging in the game cycle affects game-related outcomes which again affect the antecedents of re-entering the game cycle. Moreover, we validate a measure of VGPu and provide construct as well as criterion validity evidence.

Methods. Within three studies (N = 716) we develop and validate the VGPu scale - a psychometrically sound measure of intentions to pursue video games. Using Amazon’s MTurk (Studies 1, 2), participants responded to the VGPu items and we conducted exploratory and confirmatory factor analyses showing that VGPu consists of a general latent VGPu factor with four subfactors (Intentional Game Play, Generalized Game Self-Efficacy, Enjoyment of Games, Prone to Game Immersion). In Study 3, students responded to the VGPu items, to items examining construct validity, and played three video games from different genres to assess criterion-related validity of game performance and game reactions.

Results. Results demonstrate construct and criterion-related validity showing that VGPu correlates with other game-related scales and predicts game performance and game reactions.

Discussion. The findings demonstrate the value of the VGPu scale for research and practice because pursuing video games seems to be an important variable for predicting how individuals perform and react to game-based activities. Finally, we discuss implications for future research and practice in the realm of game-based assessment and training.

Keywords

game-based assessment game-based training scale development scale validation video game pursuit

Get full access to this article

View all access options for this article.

References

Adomaityte

(2013). Predicting post-training reactions from pre-training attitudes (Unpublished Master’s thesis). University of Montreal, Montreal, Quebec, Canada.

Ang

Van Dyne

Koh

K. Y.

Templer

K. J.

Tay

Chandrasekar

N. A.

(2007). Cultural intelligence: Its measurement and effects on cultural judgment and decision making, cultural adaptation and task performance. Management and Organization Review, 3, 335-371. doi:10.1111/j.1740-8784.2007.00082.x

Argenton

Pallavicini

Barone

Zini

Garcea

Zanacchi

Mantovani

(2016). Hacking well-being: Can serious games fit positive technology framework? In Villani

Cipresso

Gaggioli

Riva

(Eds.), Integrating technology in positive psychology practice (pp. 230-246). Hershey, PA: IGI Global.

Bandura

Grusec

J. E.

Menlove

F. L.

(1966). Observational learning as a function of symbolization and incentive set. Child Development, 37, 499-506.

Barbeite

F. G.

Weiss

E. M.

(2004). Computer self-efficacy and anxiety scales for an Internet sample: Testing measurement equivalence of existing measures and development of new scales. Computers in Human Behavior, 20, 1-15. doi:10.1016/S0747-5632(03)00049-9

Bedwell

W. L.

Pavlas

Heyne

Lazzara

E. H.

Salas

(2012). Toward a taxonomy linking game attributes to learning: An empirical study. Simulation & Gaming, 43, 729-760. doi:10.1177/1046878112439444

Ben-Zvi

(2007). Using business games in teaching DSS. Journal of Information Systems Education, 18(1), 113-124.

Blair

(2011). The use of video game achievements to enhance player performance, self-efficacy, and motivation (Unpublished doctoral dissertation). University of Central Florida, Orlando. Available from Electronic Theses and Dissertations. (1827)

Bollen

K. A.

(1990). Overall fit in covariance structure models: Two types of sample size effects. Psychological Bulletin, 107, 256-259. doi:10.1037//0033-2909.107.2.256

10.

Boot

W. R.

Blakely

D. P.

Simons

D. J.

(2011). Do action video games improve perception and cognition? Frontiers in Psychology, 2, Article 226. doi:10.3389/fpsyg.2011.00226

11.

Brockmyer

J. H.

Fox

C. M.

Curtiss

K. A.

McBroom

Burkhart

K. M.

Pidruzny

J. N.

(2009). The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology, 45, 624-634. doi:10.1016/j.jesp.2009.02.016

12.

Buhrmester

Kwang

Gosling

S. D.

(2011). Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3-5. doi:10.1037/e527772014-223

13.

Calvillo-Gámez

E. H.

Cairns

Cox

A. L.

(2010). Assessing the core elements of the gaming experience. In Bernhaupt

(Ed.), Evaluating user experience in games: Concepts and methods (pp. 47-72). London, UK: Springer.

14.

Cassidy

Eachus

(2002). Developing the Computer User Self-Efficacy (CUSE) Scale: Investigating the relationship between computer self-efficacy, gender and experience with computers. Journal of Educational Computing Research, 26, 133-153. doi:10.2190/JGJR-0KVL-HRF7-GCNV

15.

Chamorro-Premuzic

Akhtar

Winsborough

Sherman

R. A.

(2017). The datafication of talent: How technology is advancing the science of human potential at work. Current Opinion in Behavioral Sciences, 18, 13-16. doi:10.1016/j.cobeha.2017.04.007

16.

Connolly

T. M.

Boyle

E. A.

MacArthur

Hainey

Boyle

J. M.

(2012). A systematic literature review of empirical evidence on computer games and serious games. Computers & Education, 59, 661-686. doi:10.1016/j.compedu.2012.03.004

17.

Diedenhofen

Musch

(2015). cocor: A comprehensive solution for the statistical comparison of correlations. PLoS ONE, 10(4), e0121945. doi:10.1371/journal.pone.0121945

18.

Doll

W. J.

Xia

(1997). Confirmatory factor analysis of the end-user computing satisfaction instrument. Journal of Organizational and End User Computing, 9(2), 24-31. doi:10.4018/joeuc.1997040103

19.

Doll

W. J.

Xia

Torkzadeh

(1994). A confirmatory factor analysis of the end-user computing satisfaction instrument. MIS Quarterly, 18, 453-461. doi:10.4018/joeuc.1997040103

20.

Fabrigar

L. R.

Wegener

D. T.

MacCallum

R. C.

Strahan

E. J.

(1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299. doi:10.1037/1082-989x.4.3.272

21.

Faul

Erdfelder

Buchner

Lang

A. G.

(2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41, 1149-1160. doi:10.3758/brm.41.4.1149

22.

Ferguson

C. J.

Cruz

A. M.

Rueda

S. M.

(2008). Gender, video game playing habits and visual memory tasks. Sex Role, 58, 279-286. doi:10.1007/s11199-007-9332-z

23.

(2009). EGameFlow: A scale to measure learners’ enjoyment of e-learning games. Computers & Education, 52, 101-112. doi:10.1016/j.compedu.2008.07.004

24.

Garris

Ahlers

Driskell

J. E.

(2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441-467. doi:10.1177/1046878102238607

25.

Govern

J. M.

Marsch

L. A.

(2001). Development and validation of the Situational Self-Awareness Scale. Consciousness and Cognition, 10, 366-378. doi:10.1006/ccog.2001.0506

26.

Greenfield

P. M.

Brannon

Lohr

(1994). Two-dimensional representation of movement through three-dimensional space: The role of video game expertise. Journal of Applied Developmental Psychology, 15(1), 87-103. doi:10.1016/0193-3973(94)90007-8

27.

Hinkin

T. R.

(1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1, 104-121. doi:10.1177/109442819800100106

28.

Hoelter

J. W.

(1983). The analysis of covariance structures: Goodness-of-fit indices. Sociological Methods and Research, 11, 325-344.

29.

Hogle

N. J.

Widmann

W. D.

Ude

A. O.

Hardy

M. A.

Fowler

D. L.

(2008). Does training novices to criteria and does rapid acquisition of skills on laparoscopic simulators have predictive validity or are we just playing video games? Journal of Surgical Education, 65, 431-435. doi:10.1016/j.jsurg.2008.05.008

30.

Horn

J. L.

(1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179-185. doi:10.1007/BF02289447

31.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1-55. doi:10.1080/10705519909540118

32.

Huang

J. L.

Curran

P. G.

Keeney

Poposki

E. M.

DeShon

R. P.

(2012). Detecting and deterring insufficient effort responding to surveys. Journal of Business and Psychology, 27, 99-114. doi:10.1007/s10869-011-9231-8

33.

Kaiser

H. F.

(1960). The application of electronic computers to factor analysis. Educational Psychological Measures, 20, 141-151. doi:10.1177/001316446002000116

34.

Keebler

J. R.

Jentsch

Schuster

(2014). The effects of video game experience and active stereoscopy on performance in combat identification tasks. Human Factors, 56(8), 1482-1496. doi:10.1177/0018720814535248

35.

Koivisto

Hamari

(2014). Demographic differences in perceived benefits from gamification. Computers in Human Behavior, 35, 179-188. doi:10.1016/j.chb.2014.03.007

36.

Landers

R. N.

Armstrong

M. B.

(2017). Enhancing instructional outcomes with gamification: An empirical test of the Technology-Enhanced Training Effectiveness Model. Computers in Human Behavior, 71, 499-507. doi:10.1016/j.chb.2015.07.031

37.

Landers

R. N.

Callan

R. C.

(2011, October). Casual social games as serious games: The psychology of gamification in undergraduate education and employee training. In Minhua

Oikonomou

Jain

L. C.

(Eds.), Serious games and edutainment applications (pp. 399-423). London, UK: Springer. doi:10.1007/978-1-4471-2161-9_20

38.

Lee

K. M.

Jeong

E. J.

Park

Ryu

(2011). Effects of interactivity in educational games: A mediating role of social presence on learning outcomes. International Journal of Human-Computer Interaction, 27(7), 620-633. doi:10.1080/10447318.2011.555302

39.

Lee

Faber

R. J.

(2007). Effects of product placement in on-line games on brand memory: A perspective of the limited-capacity model of attention. Journal of Advertising, 36, 75-90. doi:10.2753/joa0091-3367360406

40.

Long

L. K.

(2005). The role of trainee reactions in online training (Unpublished doctoral dissertation). Kent State University, OH.

41.

MacCallum

R. C.

Browne

M. W.

Sugawara

H. M.

(1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130-149. doi:10.1037/1082-989x.1.2.130

42.

MacCallum

R. C.

Hong

(1997). Power analysis in covariance structure modeling using GFI and AGFI. Multivariate Behavioral Research, 32(2), 193-210.

43.

Marchand

Hennig-Thurau

(2013). Value creation in the video game industry: Industry economics, consumer benefits, and research opportunities. Journal of Interactive Marketing, 27, 141-157. doi:10.1016/j.intmar.2013.05.001

44.

Marsh

H. W.

Balla

J. R.

McDonald

R. P.

(1988). Goodness-of-fit indices in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103, 391-410. doi:10.1037//0033-2909.103.3.391

45.

Mayer

R. E.

(2019). Computer games in education. Annual Review of Psychology, 70, 531-549. doi:10.1146/annurev-psych-010418-102744

46.

McDonald

R. P.

M. H. R.

(2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7, 64-82. doi:10.1037//1082-989x.7.1.64

47.

O’Brien

H. L.

Toms

E. G.

(2010). The development and evaluation of a survey to measure user engagement. Journal of the American Society for Information Science and Technology, 61, 50-69. doi:10.1002/asi.21229

48.

Okagaki

Frensch

P. A.

(1994). Effects of video game playing on measures of spatial performance: Gender effects in late adolescence. Journal of Applied Developmental Psychology, 15, 33-58. doi:10.1016/0193-3973(94)90005-1

49.

Orvis

K. A.

Horn

D. B.

Belanich

(2006). Videogame-based training success: The impact of trainee characteristics-year 2 (No. ARI-TR-1188). Alexandria, VA: Army Research Institute for the Behavioral and Social Sciences - Research and Advanced Concepts Office.

50.

Orvis

K. A.

Horn

D. B.

Belanich

(2008). The roles of task difficulty and prior videogame experience on performance and motivation in instructional videogames. Computers in Human Behavior, 24, 2415-2433. doi:10.1016/j.chb.2008.02.016

51.

Pekrun

Elliot

A. J.

Maier

M. A.

(2009). Achievement goals and achievement emotions: Testing a model of their joint relations with academic performance. Journal of Educational Psychology, 101, 115-135. doi:10.1037/a0013383

52.

Peng

Hsieh

(2012). The influence of competition, cooperation, and player relationship in a motor performance centered computer game. Computers in Human Behavior, 28, 2100-2106. doi:10.1016/j.chb.2012.06.014

53.

Pfeiffer

Motschnig

(2015). Enhancing e-learning with gaming: Case-study of a virtual course on 3D-printing for teachers. RicercAzione, 7(2), 165-184.

54.

Qin

Patrick Rau

P. L.

Salvendy

(2009). Measuring player immersion in the computer game narrative. International Journal of Human-Computer Interaction, 25(2), 107-133. doi:10.1080/10447310802546732

55.

Rummel

R. J.

(1970). Applied factor analysis. Evanston, IL: Northwestern University.

56.

Schrader

P. G.

McCreery

(2008). The acquisition of skill and expertise in massively multiplayer online games. Educational Technology Research and Development, 56, 557-574. doi:10.1007/s11423-007-9055-4

57.

Schwarzer

Jerusalem

(1995). Generalized Self-Efficacy scale. In Weinman

Wright

Johnston

(Eds.), Measures in health psychology: A user’s portfolio. Causal and control beliefs (pp. 35-37). Windsor, UK: NFER-Nelson.

58.

Shute

V. J.

Rahimi

(2019). Supporting learning in educational games: Promises and challenges. In Díaz

Ioannou

Bhagat

K. K.

Spector

J. M.

(Eds.), Learning in a digital world: Perspective on interactive technologies for formal and informal education (pp. 1-29). New York, NY: Springer.

59.

Singer

M. J.

Knerr

B. W.

(2010). Evaluation of a game-based simulation during distributed exercises. Orlando, FL: U.S. Army Research Institute for the Behavioral and Social Sciences.

60.

Sitzmann

(2011). A meta-analytic examination of the instructional effectiveness of computer-based simulation games. Personnel Psychology, 64, 489-528. doi:10.1111/j.1744-6570.2011.01190.x

61.

Smyth

(2007). Beyond self-selection in video game play: An experimental examination of the consequences of massively multiplayer online role-playing game play. CyberPsychology & Behavior, 10(5), 717-721. doi:10.1089/cpb.2007.9963

62.

Terlecki

Brown

Harner-Steciw

Irvin-Hannum

Marchetto-Ryan

Ruhl

Wiggins

(2011). Sex differences and similarities in video game experience, preferences, and self-efficacy: Implications for the gaming industry. Current Psychology, 30, 22-33. doi:10.1007/s12144-010-9095-5

63.

Wiebe

E. N.

Lamb

Hardy

Sharek

(2014). Measuring engagement in video game-based environments: Investigation of the User Engagement Scale. Computers in Human Behavior, 32, 123-132. doi:10.1016/j.chb.2013.12.001

64.

Wolf

M. J. P.

(2001). Genre and the video game. In Wolf

M. J. P.

(Ed.), The medium of the video game (pp. 113-134). Austin: University of Texas Press.

65.

Wang

Tsai

H.-H.

(2010). Falling in love with online games: The uses and gratifications perspective. Computers in Human Behavior, 26, 1862-1871. doi:10.1016/j.chb.2010.07.033

66.

Zou

G. Y.

(2007). Toward using confidence intervals to compare correlations. Psychological Methods, 12(4), 399-413. doi:10.1037/1082-989X.12.4.399

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.04 MB

0.10 MB