This paper presents a solution for supporting adaptive user interfaces in work environments that require operators to move about in dynamic contexts for manipulating various physical objects. The solution architecture is built upon the use of logical languages for interactive applications integrated with context aware and adaptive features. The proposed architecture is able to adapt to specific aspects of the context during run-time by communicating with a context server and applying the specified adaptation rules. In order to show the possibilities of the proposed solution, we report on its application in the development of an adaptive user interface for a warehouse picking system, and discuss the results of the associated tests.
S.Ali, A.Lewandowski and J.Rett, A SOA based context-aware order picking system for warehouses using Laser Range Finder and wearable computer, in: 2011 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM), 2011, pp. 1–8.
2.
S.Bongartz, Y.Jin, F.Paternò, J.Rett, C.Santoro and L.D.Spano, Adaptive user interfaces for smart environments with the support of model-based languages, in: Proc. of AmI 2012, Vol. 7683, Springer, pp. 33–48.
3.
J.Coutaz, L.Nigay, D.Salber, A.Blandford, J.May and R.Young, Four easy pieces for assessing the usability of multimodal interaction: The CARE properties, in: Proc. of INTERACT 1995, pp. 115–120.
4.
C.Duarte and L.Carriço, A conceptual framework for developing adaptive multimodal applications, in: Proc. of IUI’06, ACM, 2006, pp. 132–139.
5.
B.Dumas, D.Lalanne and S.Oviatt, Multimodal Interfaces: A Survey of Principles, Models and Frameworks, Lecture Notes in Computer Science, Vol. 5440, Springer, 2009, pp. 3–26.
6.
M.Honkala and M.Pohja, Multimodal interaction with XForms, in: Proc. of ICWE 2006, pp. 201–208.
7.
J.Lawson, A.Al-Akkad, J.Vanderdonckt and B.Macq, An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components, in: Proc. of EICS 2009, ACM, pp. 245–254.
8.
M.Manca, F.Paternò, C.Santoro and L.D.Spano, Generation of multi-device adaptive multimodal web applications, in: Proc. of MobiWIS 2013, Lecture Notes in Computer Science, Vol. 8093, Springer Verlag, 2013, pp. 218–232.
9.
E.Marcotte, Responsive web design, a book apart, 2011, http://www.abookapart.com/products/responsiveweb-design.
10.
J.McNaull, J.C.Augusto, M.Mulvenna and P.McCullagh, Flexible context aware interface for ambient assisted living, Human-Centric Computing and Information Sciences4(1) (2014).
11.
G.Meixner, F.Paternò and J.Vanderdonckt, Past, present, and future of model-based user interface development, I-Com10(3) (2011), 2–11.
12.
M.Nebeling, M.Speicher and M.C.Norrie, W3Touch: Metrics-based Web page adaptation for touch, in: Proc. of CHI 2013, ACM, 2013, pp. 2311–2320.
13.
Z.Obrenovic, D.Starcevic and B.Selic, A model-driven approach to content repurposing, IEEE MultimediaJanuary (2004), 62–71.
14.
J.Octavia, L.Vanacken, C.Raymaekers, K.Coninx and E.Flerackers, Facilitating adaptation in virtual environments using a context-aware model-based design process, in: Proc. of TAMODIA 2009, Lecture Notes in Computer Science, Vol. 5963, pp. 58–71.
15.
F.Paternò, C.Santoro and L.D.Spano, MARIA: A universal, declarative, multiple abstraction-level language for service-oriented applications in ubiquitous environments, ACM Transactions on Computer-Human Interaction16(4) (2009), 1–30.
16.
T.E.Paymans, J.Lindenberg and M.Neerincx, Usability trade-offs for adaptive user interfaces: Ease of use and learnability, in: Proc. of IUI’04, ACM Press, 2004, pp. 301–303.
L.M.Reeves, J.Lai, J.A.Larson, S.Oviatt, T.S.Balaji, S.P.Buisine, P.Collings, P.Cohen, B.Kraal, J.-C.Martin, M.McTear, T.Raman, K.M.Stanney, H.Su and Q.Y.Wang, Guidelines for multimodal user interface design, Communications of the ACM47 (2004), 57–59.
19.
D.Salber, A.Dey and G.Abowd, The context toolkit: Aiding the development of context-enabled applications, in: Proc. of CHI’99, ACM, 1999, pp. 434–441.
20.
B.Schwerdtfeger and G.Klinker, Supporting order picking with augmented reality, in: 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, 2008, pp. 91–94.
21.
S.Sire and C.Chatty, The markup way to multimodal toolkits, in: W3C Multimodal Interaction Workshop, 2004, http://www.w3.org/2004/02/mmi-workshop/sire-intuilab.html.
22.
J.S.Sottet, V.Ganneau, G.Calvary, J.Coutaz, A.Demeure, J.M.Favre and R.Demumieux, Model-driven adaptation for plastic user interfaces, in: Proc. of INTERACT 2007, pp. 397–410.
23.
A.Stanciulescu, Q.Limbourg, J.Vanderdonckt, B.Michotte and F.Montero, A transformational approach for multimodal web user interfaces based on UsiXML, in: Proc. of ICMI, 2005, pp. 259–266.
24.
B.Ur, E.McManus, M.P.Y.Ho and M.L.Littman, Practical trigger-action programming in the smart home, in: Proc. of CHI 2014, ACM, 2014, pp. 803–812.
25.
L.van Velsen, T.van der Geest, R.Klaassen and M.Steehouder, User-centered evaluation of adaptive and adaptable systems: A literature review, Knowledge Engineering Review23(3) (2008), 261–281.
26.
K.A.Weaver, H.Baumann, T.Starner, H.Iben and M.Lawo, An empirical task analysis of warehouse order picking using head-mounted displays, in: Proc. of CHI 2010, ACM, New York, NY, 2010.
27.
T.Yang, M.Ferati, Y.Liu, R.R.Ghahari and D.Bolchini, Aural browsing On-The-Go: Listening-based back navigation in large web architectures, in: Proc. of CHI 2012, ACM, 2012, pp. 277–286.
