Studying pervasive games is inherently difficult and different from studying computer or board games. This article builds upon the experiences of staging and studying several playful pervasive technology prototypes. It discusses the challenges and pitfalls of evaluating pervasive game prototypes and charts methods that have proven useful in previous research. The aim is to open discussion on the situated methodology of qualitative study of evaluating and researching pervasive play.
AarsethE. (2003). Playing research: Methodological approaches to game analysis. Paper presented at the 5th Digital Arts & Culture Conference, Melbourne, Australia.
2.
AdamsM. (2009). Mixed reality arts. In MontolaM.StenrosJ.WaernA. (Eds.), Pervasive games. Theory and design (pp. 236-240). Amsterdam, Netherlands: Morgan Kaufmann.
3.
AhmetZ.WaernA. (2011). The engagement of a play collective: Collaborative play in a pervasive game. Manuscript under review.
4.
BatemanC.BoonR. (2006). 21st century game design. Hingham, MA: Charles River Media.
5.
BedwellB.SchnäderlbackH.BenfordS.RoddenT.KolevaB. (2009). In support of city exploration. In Proceedings of the 27th international conference on human factors in computing systems. Boston, MA: ACM.
6.
BenfordS. (Ed.). (2007). Evaluation of day of the figurines II (IPerG Deliverable D12.6). Retrieved from http://iperg.sics.se/press1.php
7.
BenfordS.FlinthamM.DrozdA.AnastasiR.RowlandD.TandavanitjN.. . .SuttonJ. (2004). Uncle Roy all around you: Implicating the city in a location-based performance. In Proceedings of the ACE conference. Singapore: ACM.
8.
BenfordS.GiannachiG.KolevaB.RoddenT. (2009, April4-9). From interaction to trajectories: Designing coherent journeys through user experiences. Proceedings of CHI 2009. Boston, MA: ACM.
9.
BichardJ.-P.WaernA. (2008). Pervasive play, immersion and story: Designing interference. In Proceedings of DIMEA ’08. Athens, Greece. ACM New York, NY, USA.
10.
BjörkS.HolopainenJ. (2005). Patterns in game design. Hingham, MA: Charles River Media.
11.
BrownE.CairnsP. (2004). A grounded investigation of game immersion. In CHI ’04 extended abstracts on human factors in computing systems (pp. 1297-1300). New York, NY: ACM.
12.
CallejaG. (2007). Digital game involvement. A conceptual model. Games and Culture, 2, 236-260.
13.
CsikszentmihalyiM. (1975). Beyond boredom and anxiety. The experience of play in work and games. San Francisco, CA: Jossey-Bass.
14.
DAY OF THE FIGURINES. (2005). [Developed by Mixed Reality Lab]. United Kingdom. Blast Theory.
15.
DelamontS. (2004). Ethnography and participant observation. In SealeC.GoboG.GubriumJ. F.SilvermanD. (Eds.), Qualitative research practice (pp. 217-229). London, England: SAGE.
DenwardM. (2008). Broadcast culture meets role-playing culture: Consequences for audience participation in a cross-media production. In Proceedings of IAMCR 2008. Stockholm, Sweden.
18.
de Souza e SilvaA.HjorthL. (2009). Playful urban spaces: A historical approach to mobile games. Simulation & Gaming, 40, 602-625.
19.
de Souza e SilvaA.SutkoD. M. (Eds.). (2009). Digital cityscapes: Merging digital and urban playscapes. New York, NY: Peter Lang.
20.
EricssonM. (2003). Enchanting reality: A vision of big experiences on small platforms. Level Up Conference Proceedings. Digra.
21.
ErmiL.MäyräF. (2007). Fundamental components of the gameplay experience: Analyzing immersion. In De CastellS.JensonJ. (Eds.), Worlds in play: International perspectives on digital games research (pp. 37-53). New York, NY: Peter Lang.
22.
FineG. A. (1983). Shared fantasy: Role-playing games as social worlds. Chicago, IL: University of Chicago Press.
23.
FischerJ. E.LindtI.StenrosJ. (2006). Epidemic menace II evaluation report(IPerG Deliverable D8.8 part II). Retrieved from http://iperg.sics.se/press1.php
24.
FischerJ. E.LindtI.StenrosJ. (2007). Evaluation of crossmedia gaming experiences in epidemic menace. In Proceedings of the 4th International Symposium on Pervasive Gaming Applications PerGames 2007. Salzburg, Austria.
25.
FullertonT.SwainC.HoffmanS. (2004). Game design workshop: Designing, prototyping, and playtesting games. San Francisco, CA: CMP Books.
26.
GoffmanE. (1974). Frame analysis: An essay on the organization of experience. Boston, MA: Northeastern University Press.
27.
HallR. (2004). The letterboxer’s companion. Helena, MN: Globe Pequot Press.
HopeametsäH. (2008). 24 hours in a bomb shelter: Player, character and immersion in ground zero. In MontolaM.StenrosJ. (Eds.), Playground worlds (pp. 187-198). Ropecon ry, Helsinki.
30.
HuizingaJ. (1938). Homo Ludens. Proeve Ener Bepaling Van Het Spelelement Der Cultuur [Homo ludens: A study of play element in culture]. Boston, MA: Beacon Press.
31.
INSECTOPIA. (2005). [Developed by Peitz, J.]. Gothenburg, Sweden: GAME Studio.
32.
INTERFERENCE. (2008). [Developed by Bichard, J. P., & Waern, A.]. Stockholm, Sweden.
33.
JennettC.CoxA. L.CairnsP.DhopareeS.EppsA.TijsG.WaltonA. (2008). Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 66, 641-661.
34.
JohnsonJ. W. (1981). A scholar looks at killer. Afterword in Killer: The Game of Assassination. Austin, TX: Steve Jackson Games.
35.
JonssonS.MontolaM.WaernA.EricssonM. (2006, June14-16). Prosopopeia: Experiences from a pervasive larp. In Proceedings of ACM SIGGCHI ACE 2006 Conference. West Hollywood, CA: ACM.
36.
JuulJ. (2004). Introduction to game time. In Wardrip-FruinN.HarriganP. (Eds.), First person: New media as story, performance, and game (pp. 131-142). Cambridge, MA: MIT Press.
37.
JuulJ. (2005). Half-real: Video games between real rules and fictional worlds. Cambridge, MA: MIT Press.
38.
KarppiT.SotamaaO. (2011). Rethinking playing research: Methodological observations from behind the decks. Simulation & Gaming.
39.
KoivistoE.OllilaM. (2006, November15-16). How to fail: Mobile game design in a research project involving software prototype development. In Game Design & Technology Workshop ’06. Liverpool, UK: ACM.
40.
KoivistoE.PalmT. (2005, November8-9). Iterative design of mobile games. In Computer Game Design and Technology Workshop ’05. Liverpool, UK: ACM.
41.
KücklichJ. (2007). Homo deludens: Cheating as a methodological tool in digital games research. Convergence, 12, 355-367.
42.
KultimaA.StenrosJ. (2010). Designing games for everyone: The expanded game experience model. In Proceedings of Future Play 2010. Vancouver, Canada.
43.
LinderothJ. (2004). Spelelement bortom idén om den interaktiva illusionen. (Game elements beyond the idea of an interactive illusion.) (Unpublished doctoral dissertation). Göteborg University, Göteborg. Retrieved from http://gupea.ub.gu.se/handle/2077/16217
44.
MagerkurthC.CheokA. D.MandrykR. L.NilsenT. (2005). Pervasive games: Bringing computer entertainment back to the real world. Computers in Entertainment, 3(1).
45.
MäyräF. (2008). An introduction to game studies: Games in culture. Los Angeles, CA: SAGE.
46.
MäyräF.LankoskiP. (2009). Play in hybrid reality: Alternative approaches to game design. In de Souza e SilvaA.SutkoD. M. (Eds.), Digital cityscapes: Merging digital and urban playscapes (pp. 129-147). New York, NY: Peter Lang.
47.
McGonigalJ. (2006a, January24). The puppet master problem: Design for real-world, mission based gaming. Lecture given at University of Art and Design Helsinki, as part of Games and Storytelling lecture series.
48.
McGonigalJ. (2006b). This might be a game: Ubiquitous play and performance at the turn of the twenty-first century (Unpublished doctoral dissertation). University of California, Berkeley.
49.
McMillanD.MorrisonA.BrownO.HallM.ChalmersM. (2010). Further into the wild: Running worldwide trials of mobile systems. In Proceedings of Pervasive 2010. Lecture Notes in Computer Science 6030 (pp. 210-227). Springer.
50.
MOMENTUM. (2007). [Developed by EricssonM.JonssonS..] Stockholm, Sweden. Retrieved from http://momentum.sics.se
51.
MontolaM. (2007, September24-28). Tangible pleasures of pervasive role-playing. In BabaA. (Ed.), Proceedings of DiGRA 2007 Situated Play Conference (pp. 178-185). Tokyo, Japan: The University of Tokyo.
52.
MontolaM. (2011a). A ludological view on the pervasive mixed-reality game research paradigm. Personal and Ubiquitous Computing, 15, 3-12.
53.
MontolaM. (2011b). Social constructionism for ludology. Simulation & Gaming.
54.
MontolaM.JäppinenA.LahtiJ.LankoskiP.WaernA.HolopainenJ. (2006). Pervasive game design and evaluation. Guidelines for IPerG Phase Two, IPerG Deliverable D5.4. Retrieved from http://iperg.sics.se/press1.php
55.
MontolaM.StenrosJ.WaernA. (2009). Pervasive games: Theory and design. Amsterdam, Netherlands: Morgan Kaufmann.
56.
MontolaM.WaernA. (2006, October6-8). Ethical and practical look at unaware game participation. In SantorineosM. (Ed.), Gaming realities: A challenge for digital culture (pp. 185-193). Athens, Greece: Mediaterra 2006 Festival, Fournos Centre for the Digital Culture.
57.
MyersD. (2009). In search of a minimalist game. In breaking new ground: Innovation in games, play, practice, and theory. In Proceedings of DiGRA. DiGRA. Retrieved from http://www.digra.org/dl/db/09287.39520.pdf
58.
NiemiJ.SawanoS.WaernA. (2005). Involving non-players in pervasive games. In Proceedings of Critical Computing. Aarhus, Denmark.
59.
NieuwdorpE. (2007). The pervasive discourse: An analysis. Computers in Entertainment, 5(2).
60.
PeitzJ. (2009). Insectopia. In MontolaM.StenrosJ.WaernA. (Eds.), Pervasive games. Theory and design (pp. 175-177). Amsterdam, Netherlands: Morgan Kaufmann.
61.
PRISONER ESCAPE FROM THE TOWER. (2006). [Developed by Historic Royal Palaces.]. Mscape Team.
62.
PROSOPOPEIA. (2005). [Developed by EricssonM.JonssonS..] Stockholm, Sweden. Retrieved from http://prosopopeia.sics.se/
63.
RabinS. (Ed.). (2005). Introduction to game development. Hingham, MA: Charles River Media.
64.
ReidJ. (2008). Design for coincidence: Incorporating real world artifacts in location based games. In Proceedings of DIMEA’08. Athens, Greece.
RowlandD.FlinthamM.OppermanL.MarshallJ.ChamberlainA.KolevaB.. . .PerezC. (2009). Ubikequitous computing: Designing interactive experiences for cyclists. In Proceedings of Mobile HCI. Bonn, Germany.
67.
SalenK.ZimmermanE. (2004). The rules of play: Game design fundamentals. Cambridge, MA: MIT Press.
SealeC.GoboG.GubriumJ. F.SilvermanD. (Eds.). (2004). Qualitative research practice. London, England: SAGE.
70.
StenrosJ.MontolaM. (2009) Momentum. In MontolaM.StenrosJ.WaernA. (Eds.), Pervasive games: Theory and design (pp. 111-116). Amsterdam, Netherlands: Morgan Kaufmann.
71.
StenrosJ.MontolaM.MäyräF. (2007). Pervasive games in ludic society. In Proceedings of Future Play 2007. New York, NY: ACM.
SweenyR. W.PattonR. M. (2009). CitySneak: Play, pedagogy, and surveillance. In de Souza e SilvaA.SutkoD. M. (Eds.), Digital cityscapes: Merging digital and urban playscapes (pp. 204-216). New York, NY: Peter Lang.
74.
TaylorT. L.KolkoB. (2003). Boundary spaces: Majestic and the uncertain status of knowledge, community and self in a digital age. Information, Communication & Society, 6, 497-522.
75.
THE TRUTH ABOUT MARIKA. (2007). [Developed by EricssonM.LägerstenD.]. SVT and Company P.
