The purpose of this project was to document the challenges in adapting a measure of complex working memory span for delivery over the web. Automated operation span (AOSPAN; Unsworth, Heitz, Schrock, & Engle, 2005) is one of the most widely used tests for measuring working memory capacity. However, AOSPAN is a computer-based test that runs locally and thus is only suitable for lab-based studies. We have recently created a web-based version of AOSPAN that runs on a much wider variety of platforms (e.g., mobile phones and tablets). Conclusions and recommendations are applicable to researchers who are thinking of conducting studies online and developing web-based measures of which are traditionally used in the laboratory.
Get full access to this article
View all access options for this article.
References
1.
BirnbaumM. H. (2001). Introduction to Behavioral Research on the Internet. Upper Saddle River, NJ: Prentice Hall.
2.
ConwayA. R.CowanN.BuntingM. F.TherriaultD. J.MinkoffS. R. (2002). A latent variable analysis of working memory capacity, short-term memory capacity, processing speed, and general fluid intelligence. Intelligence, 30(2), 163-183.
3.
ConwayA. R.KaneM. J.BuntingM. F.HambrickD. Z.WilhelmO.EngleR. W. (2005). Working memory span tasks: A methodological review and user’s guide. Psychonomic bulletin & review, 12(5), 769-786.
4.
EngleR. W.TuholskiS. W.LaughlinJ. E.ConwayA. R. (1999). Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. Journal of experimental psychology: General, 128(3), 309-331.
HewsonC. (2003). Conducting research on the internet. PSYCHOLOGIST-LEICESTER-, 16(6), 290-293.
7.
Inquisit Web 4.0.8.0 [Computer software]. (2014). Seattle, WA: Millisecond Software.
8.
KleinK.FissW. H. (1999). The reliability and stability of the Turner and Engle working memory task. Behavior Research Methods, Instruments, & Computers, 31(3), 429-432.
9.
KrantzJ. H.BallardJ.ScherJ. (1997). Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness. Behavior Research Methods, Instruments, & Computers, 29(2), 264-269.
10.
LeeH.BaniquedP. L.CosmanJ.MullenS.McAuleyE.SeversonJ.KramerA. F. (2012). Examining cognitive function across the lifespan using a mobile application. Computers in Human Behavior, 28(5), 1934-1946.
11.
LeeM. J.TedderM. C. (2003). The effects of three different computer texts on readers’ recall: based on working memory capacity. Computers in Human Behavior, 19(6), 767-783.
12.
LuskD. L.EvansA. D.JeffreyT. R.PalmerK. R.WikstromC. S.DoolittleP. E. (2009). Multimedia learning and individual differences: Mediating the effects of working memory capacity with segmentation. British Journal of Educational Technology, 40(4), 636-651.
13.
MasonW.SuriS. (2012). Conducting behavioral research on Amazon’s Mechanical Turk. Behavior research methods, 44(1), 1-23.
14.
PiperA. I. (1998). Conducting social science laboratory experiments on the World Wide Web. Library & Information Science Research, 20(1), 5-21.
15.
RedickT. S.BroadwayJ. M.MeierM. E.KuriakoseP. S.UnsworthN.KaneM. J.EngleR. W. (2012). Measuring working memory capacity with automated complex span tasks. European Journal of Psychological Assessment, 28(3), 164-171.
16.
RedickT. S.ShipsteadZ.HarrisonT. L.HicksK. L.FriedD. E.HambrickD. Z.KaneM. J.EngleR. W. (2013). No evidence of intelligence improvement after working memory training: a randomized, placebo-controlled study. Journal of Experimental Psychology: General, 142(2), 359-379.
17.
ReipsU. D. (2000). The Web experiment method: Advantages, disadvantages, and solutions. Psychological experiments on the Internet, 89-117.
18.
ReipsU. D. (2002a). Standards for Internet-based experimenting. Experimental Psychology, 49(4), 243-256.
19.
ReipsU. D. (2002b). Theory and techniques of conducting Web experiments. In BatinicB.ReipsU. D.BosnjakM. (Eds.), Online social sciences, 229-250. Seattle: Hogrefe & Huber.
20.
ShipsteadZ.RedickT. S.EngleR. W. (2010). Does working memory training generalize?. Psychologica Belgica, 50(3-4), 245-276.
21.
ShipsteadZ.RedickT. S.EngleR. W. (2012). Is working memory training effective?. Psychological bulletin, 138(4), 628-654.
22.
SkitkaL. J.SargisE. G. (2006). The Internet as psychological laboratory. Annual Review of Psychology, 57, 529-555.
23.
TroyerA. K.RoweG.MurphyK. J.LevineB.LeachL.HasherL. (2014). Development and evaluation of a self-administered on-line test of memory and attention for middle-aged and older adults. Frontiers in aging neuroscience, 6, 1-9.
24.
UnsworthN.HeitzR. P.SchrockJ. C.EngleR. W. (2005). An automated version of the operation span task. Behavior Research Methods, 37, 498-505.
25.
UnsworthN.RedickT. S.HeitzR. P.BroadwayJ. M.EngleR. W. (2009). Complex working memory span tasks and higher-order cognition: A latent-variable analysis of the relationship between processing and storage. Memory, 17(6), 635-654.
26.
ZakzanisK. K.AzarbehiR. (2014). Introducing BRAIN screen: Web-Based Real-Time Examination and Interpretation of Cognitive Function. Applied Neuropsychology: Adult, 21(2), 77-86.
