This article serves to the larger quest for increasing our capacities as designers, researchers, and scholars in understanding and developing human-computer interaction in computer-aided design. The central question is on how to ground the related research work in input technologies and interaction techniques for computer-aided design applications, which primarily focus on technology and implementation, within the actual territories of computer-aided design processes. To discuss that, the article first reviews a collection of research studies and projects that present input technologies and interaction techniques developed as alternative or complimentary to the mouse as used in computer-aided design applications. Based on the mode of interaction, these studies and projects are traced in four categories: hand-mediated systems that involve gesture- and touch-based techniques, multimodal systems that combine various ways of interaction including speech-based techniques, experimental systems such as brain-computer interaction and emotive-based techniques, and explorations in virtual reality- and augmented reality-based systems. The article then critically examines the limitations of these alternative systems related to the ways they have been envisioned, designed, and situated in studies as well as of the two existing research bases in human-computer interaction in which these studies could potentially be grounded and improved. The substance of examination is what is conceptualized as “frameworks of thought”—on variables and interrelations as elements of consideration within these efforts. Building upon the existing frameworks of thought, the final part discusses an alternative as a vehicle for incorporating layers of the material cultures of computer-aided design in designing, analyzing, and evaluating computer-aided design-geared input technologies and interaction techniques. The alternative framework offers the potential to help generate richer questions, considerations, and avenues of investigation.
MyersBA.A brief history of human computer interaction technology. Interactions1998; 25(2): 44–54.
2.
WalkerJ (ed). The Autodesk file: bits of history, words of experience. Indianapolis, IN: New Riders Publishing, 1989.
3.
BewleyWLRobertsTLSchroitD, et al. Human factors testing in the design of Xerox’s 8010 “Star” office workstation. In: Proceedings of the SIGCHI conference on human factors in computing systems, Boston, MA, 12–15 December 1983, pp. 72–77. New York: ACM.
4.
PriceLA. Studying the mouse for CAD systems. In: Proceedings of the 21st design automation conference, Albuquerque, NM, 25–27 June 1984, pp. 288–293. New York: IEEE.
5.
AttwoodD.Evaluation of discomfort experienced while operating CADD worksystems. Proc Hum Fact Soc An1986; 30(6): 543–547.
6.
AttwoodD.Comparison of discomfort experienced at CADD, word processing and traditional drafting workstations. Int J Ind Ergonom1989; 14(1): 39–50.
7.
KarlqvistLKHagbergMKösterM, et al. Musculoskeletal symptoms among computer assisted design (CAD) operators and evaluation of a self-assessment questionnaire. Int J Occup Env Heal1996; 2(3): 185–194.
8.
JensenCBorgVFinsenL, et al. Job demands, muscle activity and musculoskeletal symptoms in relation to work with the computer mouse. Scand J Work Env Hea1998; 24: 418–424.
9.
JensenCFinsenLHansenK, et al. Upper trapezius muscle activity patterns during repetitive manual material handling and work with a computer mouse. J Electromyogr Kines1999; 9(5): 317–325.
10.
CailFAptelM.Biomechanical stresses in computer-aided design and in data entry. Int J Occup Saf Ergo2003; 9(3): 235–255.
11.
AtkinsonSWoodsVHaslamRA, et al. Using non-keyboard input devices: interviews with users in the workplace. Int J Ind Ergonom2004; 133(6): 571–579.
12.
WuHCLiuYPChenHC.Differences in computer exposure between university administrators and CAD draftsmen. Appl Ergon2010; 141(6): 849–856.
13.
KumarPVermaJPrasadS.Hand data glove: a wearable real-time device for human-computer interaction. Int J Adv Sci Technol2012; 1: 99–104.
14.
KimDHilligesOIzadiS, et al. Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In: Proceedings of the 25th annual ACM symposium on user interface software and technology, Cambridge, MA, 7–10 October 2012, pp. 167–176. New York: ACM.
15.
WangRParisSPopovićJ.6D hands: markerless hand-tracking for computer aided design. In: Proceedings of the 24th annual ACM symposium on user interface software and technology, Santa Barbara, CA, 16–19 October 2011, pp. 549–558. New York: ACM.
16.
QinSZhuXYuH, et al. Real-time markerless hand gesture recognition with depth camera. In: Pacific-Rim conference on multimedia, Singapore, 4–6 December 2012, pp. 186–197. Berlin: Springer.
17.
SridharSBaillyGHeydrichE, et al. Full hand: markerless skeleton-based tracking for free-hand interaction. Saarbrücken: Max-Planck-Institut für Informatik.
18.
KangJZhongKQinS, et al. Instant 3D design concept generation and visualization by real-time hand gesture recognition. Comput Ind2013; 164(7): 785–797.
XiaoYPengQ. A hand gesture-based interface for design review using leap motion controller. In: DS 87-8 Proceedings of the 21st international conference on engineering design (ICED 17) vol 8: human behaviour in design, Vancouver, Canada, 21–25 August 2017, pp. 239–248.
21.
HuangJJaiswalPRaiR.Gesture-based system for next generation natural and intuitive interfaces. Ai Edam2019; 33(1): 54–68.
22.
RadhakrishnanSLinYZeidI, et al. Finger-based multitouch interface for performing 3D CAD operations. Int J Hum-Comput St2013; 171(3): 261–275.
23.
SongJChoSBaekSY, et al. GaFinC: gaze and finger control interface for 3D model manipulation in CAD application. Comput Aided Design2014; 146: 239–245.
24.
Solid Technologies. ANSYS SpaceClaim 3D modeling with multi-touch, https://sldtech.com/?p=1015 (2011, accessed 10 May 2019).
CamposPNoronhaH. A multimodal tablet-based interface for designing and reviewing 3D engineering models. In: Proceedings of the 2014 international working conference on advanced visual interfaces, Como, 27–29 May 2014, pp. 233–236. New York: ACM.
27.
SharmaAMadhvanathSShekhawatA, et al. MozArt: a multimodal interface for conceptual 3D modeling. In: Proceedings of the 13th international conference on multimodal interfaces, Alicante, 14–18 November 2011, pp. 307–310. New York: ACM.
28.
KhanSRajapakseHZhangH, et al. GesCAD: an intuitive interface for conceptual architectural design. In: Proceedings of the 29th Australian conference on computer-human interaction, Brisbane, QLD, Australia, 28 November–1 December 2017, pp. 402–406. New York: ACM.
29.
BhatRDeshpandeARaiR, et al. BCI-touch based system: a multimodal CAD interface for object manipulation. In: ASME 2013 international mechanical engineering congress and exposition, San Diego, CA, 15–21 November 2013, pp. V012T13A015. New York: American Society of Mechanical Engineers.
30.
IshiiHKobayashiM. ClearBoard: a seamless medium for shared drawing and conversation with eye contact. In: Proceedings of the SIGCHI conference on human factors in computing systems, Monterey, CA, 3–7 May 1992, pp. 525–532. New York: ACM.
ShankarSSVermaARaiR. Creating by imagining: use of natural and intuitive BCI in 3D CAD modeling. In: ASME 2013 international design engineering technical conferences and computers and information in engineering conference, Portland, OR, 4–7 August 2013, pp. V02AT02A036. New York: American Society of Mechanical Engineers.
33.
MothersillPBoveVMJr. The EmotiveModeler: an emotive form design CAD tool. In: Proceedings of the 33rd annual ACM conference extended abstracts on human factors in computing systems, Seoul, China, 18–23 April 2015, pp. 339–342. New York: ACM.
34.
MurakamiTNakajimaN. Direct and intuitive input device for 3-D shape deformation. In: Proceedings of the SIGCHI conference on human factors in computing systems, Boston, MA, 24–28 April 1994, pp. 465–470. New York: ACM.
35.
AbdelmohsenSMDoEY. TangiCAD: tangible interface for manipulating architectural 3D models. In: CAADRIA 2007 Proceedings of the 12th international conference on computer aided architectural design research in Asia, Nanjing, China, 19–21 April 2007.
36.
LiuXDoddsGMcCartneyJ, et al. Manipulation of CAD surface models with haptics based on shape control functions. Comput Aided Design2005; 137(14): 1447–1458.
37.
HaulrikNPetersenRMMerrittT. CADLens: haptic feedback for navigating in 3D environments. In: Proceedings of the 2017 ACM conference companion publication on designing interactive systems, Edinburgh, 10–14 June 2017, pp. 127–131. New York: ACM.
38.
MartiniAColizziLChionnaF, et al. A novel 3D user interface for the immersive design review. In: 2015 IEEE symposium on 3D user interfaces (3DUI), Arles, 23–24 March 2015, pp. 175–176. New York: IEEE.
39.
AromaaS. Virtual prototyping in design reviews of industrial systems. In: Proceedings of the 21st International Academic Mindtrek conference, Tampere, 20–21 September 2017, pp. 110–119. New York: ACM.
40.
WolfartsbergerJ.Analyzing the potential of virtual reality for engineering design review. Automat Constr2019; 1104: 27–37.
41.
WeidlichDCserLPolzinT, et al. Virtual reality approaches for immersive design. Int J Interact Des Manuf2009; 13(2): 103–108.
42.
TalabaDHorváthILeeKH.Special issue of computer-aided design on virtual and augmented reality technologies in product design. Comput Aided Design2010; 142(5): 361–363.
BourdotPConvardTPiconF, et al. VR–CAD integration: multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models. Comput Aided Design2010; 142(5): 445–461.
45.
CovarrubiasMBordegoniMCuginiU.A hand gestural interaction system for handling a desktop haptic strip for shape rendering. Sensor Actuat A-Phys2015; 1233: 500–511.
46.
NgLXOngSKNeeAY.ARCADE: a simple and fast augmented reality computer-aided design environment using everyday objects. In: Proceedings of the IADIS international conference interfaces and human computer interaction, 2010, pp. 227–234. Freiburg: IADIS Press.
47.
NgLXOonSWOngSK, et al. GARDE: a gesture-based augmented reality design evaluation system. Int J Interact Des Manuf2011; 15(2): 85.
48.
FugeMYumerMEOrbayG, et al. Conceptual design and modification of freeform surfaces using dual shape representations in augmented reality environments. Comput Aided Design2012; 144(10): 1020–1032.
49.
KimHSKangLS.AR-based 4D CAD system using marker and markerless recognition method. Procedia Engineer2017; 196: 29–35.
50.
NormanDADraperSW. User centered system design: new perspectives on human-computer interaction. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc., Publishers, 1986.
51.
GreifI.Overview. In: GreifI (ed.) Computer-supported cooperative work: a book of readings. San Mateo, CA: Morgan Kaufmann Publishers, 1988, pp. 5–12.
52.
OviattS. Human-centered design meets cognitive load theory: designing interfaces that help people think. In: Proceedings of the 14th ACM international conference on multimedia, Santa Barbara, CA, 23–27 October 2006, pp. 871–880. New York: ACM.
53.
MacKenzieIS.Human-computer interaction: an empirical research perspective. Waltham, MA: Morgan Kaufmann Publishers, 2013.
54.
OviattS.Ten myths of multimodal interaction. Communications of the ACM1999; 42(11): 74–81. New York: ACM.
55.
WilsonP.Computer supported cooperative work (CSCW): origins, concepts and research initiatives. Computer Networks ISDN1991; 123(1–3): 91–95.
56.
PinelleDGutwinC.A review of groupware evaluations. In: Proceedings IEEE 9th international workshops on enabling technologies: infrastructure for collaborative enterprises (WET ICE2000), Gaithersburg, MD, 14–16 June 2000, pp. 86–91. New York: IEEE.
57.
WainerJBarsottiniC.Empirical research in CSCW —a review of the ACM/CSCW conferences from 1998 to 2004. J Brazil Comput Soc2007; 113(3): 27–35.
58.
WallaceJROjiSAnslowC.Technologies, methods, and values: changes in empirical research at CSCW 1990-2015. Proc ACM Hum Comput Int2017; 61: 106.
59.
SuchmanLA.Plans and situated actions: the problem of human-machine communication. Cambridge: Cambridge University Press, 1987.
60.
BlombergJKarastiH.Reflections on 25 years of ethnography in CSCW. Comp Support Coop W2013; 122(4–6): 373–423.
HarrisR.Rethinking writing. Bloomington, IN: Indiana University Press, 2000.
68.
GoodyJWattI.The consequences of literacy. Comp Stud Soc Hist1963; 5(3): 304–345.
69.
GoodyJGoodyJR.The domestication of the savage mind. New York: Cambridge University Press, 1977.
70.
HavelockEA.The literate revolution in Greece and its cultural consequences. Princeton, NJ: Princeton University Press, 2019.
71.
McLuhanM.The Gutenberg galaxy: the making of typographic man. New York: Mentor-NAL, 1962.
72.
LucyJA.Language diversity and thought: a reformulation of the linguistic relativity hypothesis. New York: Cambridge University Press, 1992.
73.
GumperzJJLevinsonSC.Introduction: linguistic relativity re-examined. In: GumperzJJLevinsonSC (eds) Rethinking Linguistic Relativity. New York: Cambridge University Press, 1996, pp. 1–18.
74.
NorrisS.Analyzing multimodal interaction: a methodological framework. New York: Routledge, 2004.
75.
GalisonP.Image and logic: a material culture of microphysics. Chicago, IL: University of Chicago Press, 1997.
76.
LoukissasY.Co-designers: cultures of computer simulation in architecture. New York: Routledge, 2012.
77.
PiconA.Architecture and the sciences: scientific accuracy or productive misunderstanding? In: MoravanszkyAFischerOW (eds) Precisions: architecture between sciences and the arts, Theoriebau Bd. 1. Berlin: Jovis, 2008, pp. 48–81.
78.
HolzerD. Sense-making across collaborating disciplines in the early stages of architectural design. PhD Thesis, Architecture and Design, RMIT University, Melbourne, VIC, Australia, 2009.
79.
Cardoso LlachD. Builders of the vision: software and the imagination of design. New York: Routledge, 2015.
DourishP.The stuff of bits: an essay on the materialities of information. Cambridge, MA: MIT Press, 2017.
83.
DourishP.Where the action is. Cambridge, MA: MIT press, 2001.
84.
WeiserM.The computer for the twenty-first century. Sci Am1991; 265(3): 94–104.
85.
Cardoso LlachD. Tracing design ecologies: collecting and visualizing ephemeral data as a method in design and technology studies. In: VertesiJRibesD (eds) DigitalSTS: a field guide for science & technology studies. Princeton, NJ: Princeton University Press, 2019, pp. 451–471.
