Sage Journals: Discover world-class research

Abstract

Attentive user interfaces are user interfaces that aim to support users' attentional capacities. By sensing users' attention for objects and people in their everyday environment and by treating user attention as a limited resource, these interfaces avoid today's ubiquitous patterns of interruption. Focusing upon attention as a central interaction channel allows development of more sociable methods of communication and repair with ubiquitous devices. Our methods are analogous to human turn-taking in group communication. Turn-taking improves the user's ability to conduct foreground processing of conversations. Attentive user interfaces bridge the gap between foreground and periphery of user activity in a similar fashion, allowing users to move smoothly in between. The authors present a framework for augmenting user attention through attentive user interfaces. We propose 5 key properties of attentive systems: to (1) sense attention, (2) reason about attention, (3) regulate interactions, (4) communicate attention and (5) augment attention. We conclude with a discussion of privacy considerations of attentive user interfaces.

Les interfaces utilisateur attentives sont des interfaces utilisateur qui ont pour but de soutenir l'attention de l'utilisateur. En sentant l'attention portée par l'utilisateur aux objets et aux personnes dans l'environnement quotidien et en tenant compte de ce que l'attention de l'utilisateur est une ressource limitée, ces interfaces pallient aux schémas habituels d'interruption pervasive. En faisant de l'attention le canal central d'interaction, on peut développer des méthodes de communication et d'utilisation des dispositifs pervasifs ou ubiquitaires plus conviviales. Ces méthodes sont analogues à la prise de parole tour à tour dans l'interaction et la communication humaine en groupe. La prise de parole tour à tour améliore la capacité de l'utilisateur de conduire au premier plan le processus de la conversation. De même, les interfaces utilisateur attentives comblent le fossé entre le premier plan et la périphérie de l'activité de l'utilisateur, en permettant à l'utilisateur de se déplacer lentement de l'un à l'autre. Les auteurs présentent un cadre permettant d'augmenter l'attention de l'utilisateur par des interfaces utilisateur attentives. Ils proposent cinq propriétés clés des systèmes attentifs: (1) sentir l'attention, (2) raisonner sur l'attention, (3) réguler les interactions, (4) communiquer l'attention et (5) augmenter l'attention. Les auteurs concluent par une discussion des problèmes posés par les interfaces utilisateur attentives quant au respect de la vie privée.

Keywords

Attentive user interfaces Context-aware computing Eye tracking Notification Ubiquitous computing

Get full access to this article

View all access options for this article.

References

Argyle, M. & Cook, M. (1976) Gaze and mutual gaze. London : Cambridge University Press.

Baudisch, P. , Good, N. & Stewart, P. (2001) `Focus plus context screens: combining display technology with visualization techniques', in Proceedings of UIST 2001, pp. 31-40. Orlando, FL: UIST.

Bellotti, V. , Back, M. , Edwards, K. , Grinter, R. , Henderson, A. & Lopes, C. (2002) `Making sense of sensing systems: five questions for designers and researchers', in Proceedings of CHI 2002, pp. 415-22. Minneapolis, MN: ACM Press.

Bolt, R.A. (1985) `Conversing with computers', Technology review 88(2).

Carter, P. & Mies van der Rohe, L. (1999) Mies Van Der Rohe at work . London: Phaidon Press.

Cherry, C. (1953) `Some experiments on the reception of speech with one and with two ears', Journal of the acoustic society of America 25: 975-9.

Duchowski, A. (2003) Eye tracking methodology: theory and practice. Berlin: Springer-Verlag.

Duncan, S. (1972) `Some signals and rules for taking speaking turns in conversations', Journal of personal and social psychology 23: 283-92.

Gibbs, W. (2005) `Considerate computing', Scientific American 292(1): 54-61.

10.

Goldhaber, M. (1997) `The attention economy and the net', First Monday, http://www.first-monday.dk.

11.

Horvitz, E. (1999) `Principles of mixed-initiative user interfaces' , in Proceedings of CHI'99, pp. 159-66. Pittsburgh, PA: ACM Press.

12.

Horvitz, E. , Jacobs, A. & Hovel, D. (1999) `Attention-sensitive alerting', in Proceedings of UAI'99, pp. 305-13. Stockholm: Morgan Kaufmann.

13.

Ishii, H. & Ullmer, B. (1997) `Tangible bits: towards seamless interfaces between people, bits, and atoms', in Proceedings of CHI'97 , pp. 234-41. Atlanta, GA: ACM Press.

14.

Jacob, R. (1995) `Eye tracking in advanced interface design', in W. Barfield & T. Furness (eds) Virtual environments and advanced interface design, pp. 258-88. New York: Oxford University Press.

15.

Maglio, P. , Barrett, R. , Campbell, C. & Selker, T. (2000a) `SUITOR: an attentive information system', in Proceedings of UIST 2000, pp. 169-76. New Orleans.

16.

Maglio, P. , Matlock, T. , Campbell, C. , Zhai, S. & Smith, B. (2000b) `Gaze and speech in attentive user interfaces' , in Proceedings of the international conference on multimodal interfaces. Berlin: Springer-Verlag.

17.

Mamuji, A. , Vertegaal, R. , Dickie, C. , Sohn, C. & Danninger, M. (2004) `Attentive office cubicles: mediating visual and auditory interactions between office co-workers', in Video proceedings of Ubicomp 2004.

18.

Mamuji, A. , Vertegaal, R. , Shell, J. , Pham, T. & Sohn, C. (2003) `AuraLamp: contextual speech recognition in an eye contact sensing light appliance', in Adjunct Proceedings of Ubicomp 2003.

19.

Mann, S. , Nolan, J. & Wellman, B. (2003) `Sousveillance: inventing and using wearable computing devices for data collection in surveillance environments', Surveillance and society 1(3): 331-55.

20.

McGonkie, G.W. & Rayner, K. (1975) `The span of effective stimulus during a fixation in reading', Perception and psychophysics 17: 578-86.

21.

Moran, T. P. & Dourish, P., eds (2003) Human-computer interaction 16 (special issue on context-aware computing).

22.

Morimoto, C. , et al. (2000) `Pupil detection and tracking using multiple light sources', Image and vision computing 18.

23.

Murphy, H. & Duchowski, A. (2001) `Gaze-contingent level of detail rendering', in EuroGraphics 2001.

24.

Nielsen, J. (1993) `Noncommand user interfaces', Communications of ACM 36(4): 83-99.

25.

Oh, A. , et al. (2002) `Evaluating look-to-talk: a gaze-aware interface in a collaborative environment', in Extended abstracts of CHI 2002, pp. 650-1. Seattle, WA: ACM Press.

26.

Selker, T. (2001) `Eye-R, a glasses-mounted eye motion detection interface', in Extended abstracts of CHI 2001 . Seattle, WA: ACM Press.

27.

Shell, J.S. , Selker, T. & Vertegaal, R. (2003) `Interacting with groups of computers', Communications of the ACM 46(43): 40-6.

28.

Short, J. , Williams, E. & Christie, B. (1976) The social psychology of telecommunications. London: John Wiley.

29.

Smith, D. , Irby, C. , et al. (1982) `Designing the Star user interface', BYTE 7(4).

30.

Suh, B. , Woodruff, A. , Rosenholtz, R. & Glass, A. (2002) `Popout Prism: adding perceptual principles to overview + detail document interfaces', in Proceedings of CHI 2002, pp. 251-8. Minneapolis, MN: ACM Press.

31.

Vertegaal, R. (1999) `The GAZE groupware System: mediating joint attention in multiparty communication and collaboration', in Proceedings of CHI'99. Pittsburgh, PA: ACM Press.

32.

Vertegaal, R. & Ding, Y. (2002) `Explaining effects of eye gaze on mediated group conversations: amount or synchronization?', in Proceedings of CSCW 2002. New Orleans, MI: ACM Press.

33.

Vertegaal, R. , Cheng, D. , Sohn, C. & Mamuji, A. (2005) `Media eyePliances: using eye tracking for remote control focus selection of appliances', in Extended abstracts of ACM CHI 2005. Portland, OR: ACM Press.

34.

Vertegaal, R. , Slagter, R. , Van der Veer, G. & Nijholt, A. (2001) `Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes', in Proceedings of CHI 2001, pp. 301-8. Seattle, WA: ACM Press.

35.

Vertegaal, R. , Velichkovsky, B. & Van der Veer, G. (1997) `Catching the eye: management of joint attention in cooperative work', SIGCHI Bulletin 29(4).

36.

Vertegaal, R. , Weevers, I. , Sohn, C. & Cheung, C. (2003) `GAZE-2: conveying eye contact in group videoconferencing using eye-controlled camera direction', in Proceedings of CHI 2003. Fort Lauderdale, TX: ACM Press

37.

Want, R. , Fishkin, K. , et al. (1999) `Bridging physical and virtual worlds with electronic tags', in Proceedings of CHI'99, pp. 370-7. Pittsburgh, PA: ACM Press.

38.

Weiser, M. (1991) `The computer for the 21st century', Scientific American 265(3): 94-104. X10 Home Automation, http://www.x10.com (2002).

39.

Zhai, S. , Morimoto, C. & Ihde, S. (1999) `Manual and Gaze Input Cascaded (MAGIC) pointing' , in Proceedings of CHI'99, pp. 246-53. Pittsburgh, PA: ACM Press.

Attentive user interfaces: the surveillance and sousveillance of gaze-aware objects

Abstract

Keywords

Get full access to this article

References