A tale is told of two problems. The scientific problem is how do people decide that random groupings of targets belong in the same or different clusters. The practical problem is whether data collection using a web-based study distorts our results. A validation study was conducted to determine whether the clustering judgments made by participants using a web-based interface are comparable to judgments made by participants who did a paper-based version of the task. Previewing the results, there was a good deal of correspondence between paper and web-based responses.
Get full access to this article
View all access options for this article.
References
1.
BirnbaumM. H. (2000). Psychological Experiments on the Internet. San Diego: Academic Press.
2.
ComptonB. J.LoganG. D. (1993). Evaluating a Computational Model of Perceptual Grouping by Proximity. Perception & Psychophysics, 53(4), 403-421.
3.
ComptonB. J.LoganG. D. (1999). Judgments of perceptual groups: Reliability and sensi tivity to stimulus transformation. Perception & Psychophysics, 61(7), 1320-1335.
4.
DandurandF.ShultzT. R.OnishiK. H. (2008). Comparing online and lab methods in a problem-solving experiment. Behavior Research Methods, 40(2), 428-434.
5.
DryM. J.NavarroD. J.PreissK.LeeM. D. (2009). The perceptual organization of point constellations. Paper presented at the COGSCI 2009: The annual meeting of the Cognitive Science Society.
6.
GoslingS. D.VazireS.SrivastavaS.JohnO. P. (2004). Should we trust web-based studies? A comparative analysis of six preconceptions about Internet questionnaires. American Psychologist, 59(2), 93-104.
7.
HessS. M.DetweilerM. C.EllisR. D. (1994). The Effects of Display Layout on Monitoring and Updating System States. Proceedings of the Human Factors and Ergonomics Society 38th Annual Meeting, Vols 1 and 2, 1336-1340.
8.
IpeirotisP. G.ProvostF.WangJ. (2010). Quality Management on Amazon Mechanical Turk. Paper presented at the Proceedings of the ACM SIGKDD Workshop on Human Computation.
9.
McGrawK. O.TewM. D.WilliamsJ. E. (2000). The integrity of Web-delivered experiments: Can you trust the data?Psychological Science, 11(6), 502-506.
10.
PaolacciG.ChandlerJ.IpeirotisP. G. (2010). Running experiments on Amazon Mechanical Turk. Judgment and Decision Making, 5(5), 411-419.
11.
PothosE. M.ChaterN. (2002). A simplicity principle in unsupervised human categorization. Cognitive Science, 26(3), 303-343.
12.
WeberB. A.YarandiH.RoweM. A.WeberJ. P. (2005). A comparison study: paper-based versus web-based data collection and management. Applied Nursing Research, 18(3), 182-185.
13.
WickensC. D.CarswellC. M. (1995). The proximity compatibility principle: Its psychological foundation and relevance to display design. Human Factors, 37(3), 473-494.
14.
WrightP. (1999). The Psychology of Layout: Consequences of the Visual Structure of Documents: AAAI Technical Report FS-99-04
