Validation of the Guess-18 for Video Game Players with Disabilities

Abstract

The purpose of this study is to determine if the game satisfaction scale, the GUESS-18, factors are valid for video gamers with disabilities. Participants were asked to evaluate a video game of their choice using the GUESS-18 and answer qualitative questions about the clarity of the items, requirements needed in order to play a video game, and aspects of video games they liked and disliked. A confirmatory factor analysis (CFA, N = 414) was used to evaluate model fit, and an analysis of the qualitative data was conducted. The CFA determined that the GUESS-18 is appropriate for use with this population, and analysis of the qualitative data determined that participants reported GUESS-18 statement items to be easy to understand. 82.29% of participant comments were mapped to GUESS-18 items, while the remaining statements were mapped to the original GUESS, GUESS factors, or were deemed Not Applicable or Not Enough Information.

Keywords

Accessibility User Experience Video Gaming Psychometrics Scale Validation

Get full access to this article

View all access options for this article.

References

Bentler

P. M.

(1990). Comparative fit indexes in structural models. Psychological bulletin, 107(2), 238.

Browne

M. W.

Cudeck

(1993). Alternative ways of assessing model fit. Sage focus editions, 154, 136-136.

Clement

(2022). Video gaming in the United States. Statista. Retrieved February 23, 2023, from https://www.statista.com/topics/8739/video-gaming-in-the-united- states/

Fabrigar

L. R.

Wegener

D. T.

MacCallum

R. C.

Strahan

E. J.

(1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272–299.

Gaskin

James

Lim

(2019). "Master Validity Tool". AMOS Plugin. Gaskination’s StatWiki.

Hair

Black

Babin

Anderson

(2010). Multivariate data analysis (7th ed.): Prentice-Hall, Inc. Upper Saddle River, NJ, USA.

Bentler

P.M.

(1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. SEM. 6(1), 1-55.

IJsselsteijn

Van Den Hoogen

Klimmt

De Kort

Lindley

Mathiak

… Vorderer

(2008). Measuring the experience of digital game enjoyment. In Proceedings of measuring behavior (Vol. 2008, No. 2008, pp. 88-89). Maastricht, the Netherlands: Noldus.

Keebler

J. R.

Shelstad

W. J.

Smith

D. C.

Chaparro

B. S.

Phan

M. H.

(2020). Validation of the GUESS-18: a short version of the Game User Experience Satisfaction Scale (GUESS). Journal of Usability Studies, 16(1), 49.

10.

Le Ngocn

M. T.

(2021). Newzoo’s Diversity & Inclusion Study: Half of players want more diverse characters in games; gamers want publishers to take a stance on societal issues. Newzoo. Retrieved February 14, 2022, from https://newzoo.com/insights/articles/Newzoos-Gamer-sentiment-diversity-inclusion-gender-ethnicity-sexual-identity-disability/

11.

Phan

M. H.

Keebler

J. R.

Chaparro

B. S.

(2016). The development and validation of the game user experience satisfaction scale (GUESS). Human factors, 58(8), 1217-1247.

12.

Roth. (1994). Missing data: A conceptual review for applied psychologists. Personnel Psychology, 47(3), 537–560.

13.

Ryan

R. M.

Rigby

C. S.

Przybylski

(2006). The motivational pull of video games: A self-determination theory approach. Motivation and emotion, 30, 344-360.

14.

Scope. (n.d.). Accessibility in gaming report. Scope. Retrieved February 23, 2023, from https://www.scope.org.uk/campaigns/research-policy/accessibility-in-gaming/

15.

Steiger

J. H.

(1980). Statistically based tests for the number of common factors. In Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA, May 1980.

16.

Tsikriktsis. (2005). A review of techniques for treating missing data in OM survey research. Journal of Operations Management, 24(1), 53–62.

17.

Tucker

Lewis

(1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10.

18.

Van Ommen

Chaparron

B. S

. (2021). Assessing video game satisfaction of gamers with disabilities. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 65, No. 1, pp. 822-826). Sage CA: Los Angeles, CA: SAGE Publications.

19.

Van Ommen

C. A.

Chaparron

B. S

. (2022). Exploring video game satisfaction of gamers with disabilities. In Universal Access in Human- Computer Interaction. Novel Design Approaches and Technologies: 16th International Conference, UAHCI 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Virtual Event, June 26–July 1, 2022, Proceedings, Part I (pp. 392-405). Cham: Springer International Publishing.