Evaluating the usability of CAPTCHAs on a mobile device with voice and touch input

Abstract

The usability of text-based CAPTCHAs, featuring distorted letters, and image-based CAPTCHAs, featuring pictures, was explored on an Apple iPad. Five conditions were explored: Confident CAPTCHA with either voice or touch input, ESP-PIX with voice or touch input, and Google’s CAPTCHA with touch input. Usability was analyzed in terms of performance, perceived usability, workload, and preference rankings. Results showed that CAPTCHAs involving touch input scored better in almost every measure than CAPTCHAs involving voice input. In particular, Confident Touch is recommended based on preference and perceived performance, whereas ESP-PIX Touch is recommended for its short completion time. When image-based CAPTCHAs are not feasible, Google’s CAPTCHA is a satisfactory alternative based on usability ratings.

Get full access to this article

View all access options for this article.

References

Baird

Chew

Fateman

Coates

Luk

(2003). Welcome to PARC’s CAPTCHAs. http://www2.parc.com/istl/projects/captcha/index.htm

Baird

Kopat

(2002). Human Interactive Proofs and Document Image Analysis. In Proceedings of the 5th IAPR International Workshop on Document Analysis Systems (DAS’02), volume 2423 of Lecture Notes in Computer Science (LNCS), 531-537, Princeton, NJ, USA. Springer.

Chellapilla

Larson

Simard

P. Y.

Czerwinski

(2005). Building segmentation based human-friendly human interaction proofs (HIPs). In Proceedings of the 2nd International Workshop on Human Interactive Proofs (HIP’05), 1-26, Springer-Verlag.

Chow

Golle

Jokobsson

Wang

(2008). Making CAPTCHAs clickable. In Proceedings of the 9th Workshop on Mobile Computing Systems and Applications, 1-9, Napa, CA.

Greer

. (2005). Malicious bots threaten network security. Computer, 38, 18-20. doi: 10.1109/MC.2005.26

Hart

S. G.

Staveland

L. E.

(1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Hancock

P. A.

Meshkati

(Eds.), Human Mental Workload (pp. 239-250). Amsterdam: New Holland Press.

Lewis

J. R.

(1995). IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7, 57-78. doi: 10.1080/10447319509509526110

Madathil

K. C.

Mitchell

Greenstein

J. S.

(2010). An analysis of the text-based and image-based CAPTCHA interfaces on desktops and mobile devices.

Pope

Kaur

(2005). Is it human or computer? Defending e-commerce with CAPTCHAs. IEEE Computer Society, 7, 43-49.

10.

Rajab

M. A.

Zarfoss

Monrose

Terzis

(2006). A multifaceted approach to understanding the botnet phenomenon. In Proceedings of the 6th ACM SIGCOMM on Internet Measurement (IMC’06), 41-52, Rio de Janeiro, Brazil, 2006. ACM.

11.

Staker

C. H.

Goldbach

Yudkin

(2011). Confident CAPTCHA. http://www.confidenttechnologies.com

12.

von Ahn

Blum

Hopper

N. J.

Langford

(2009). The CAPTCHA web page. http://www.captcha.net