This paper introduces a new Tablet PC-based tool (called ‘ECOVRD,’ Event Coding and Visual Representation of Data) to facilitate real-time classification of live or video-recorded individual and team behavior. The tool is easy to use as its design exploits the possibilities that the touch-based interface of the tablet PC provides. ECOVRD is highly versatile: coding categories are user-defined and can capture instances of behavior or the duration of behavior. In addition, a note-pad feature enables users to enter observations as text. ECOVRD also includes a visualization module that provides users with graphic data summaries and basic statistics for immediate feedback. Thus, it will be useful both to the research community and in applied settings, for instance to support professional coaching or training. This paper discusses the salient design and interaction aspects of ECOVRD, and its improvements over existing systems.
Get full access to this article
View all access options for this article.
References
1.
Badke-SchaubP. (in press). Decision making processes of leaders in product development. In MosierK.FischerU. (eds.), Informed by knowledge: Expert performance in complex situations. New York, NY: Taylor & Francis.
2.
BalesR. F. (1976). Interaction process analysis: A method for the study of small groups (Revised). Chicago, IL: The University of Chicago Press.
3.
DursoF. T.CrutchfieldJ. M.HarveyC. M. (2007). The cooperative shift change: An illustration using air traffic control. Theoretical Issues in Ergonomics Science, 8(3), 213–232.
4.
EmmoreyK.FalgierB. (2004). Conceptual locations and pronominal reference in American Sign Language. Journal of Psycholinguistic Research, 33(4), 321–331.
5.
FischerU.McDonnellL.OrasanuJ. (2007). Linguistic correlates of team performance: Toward a tool for monitoring team functioning during space missions. Aviation, Space and Environmental Medicine, 78(5), II, B86–95.
6.
GuerlainS. (2005). Assessing team performance in the operating room: Development and use of a “black-box” recorder and other tools for the intraoperative environment. Journal of the American College of Surgeons, 200(1), 29–37.
7.
HeldJ.BrueschM.KruegerH.PaschT. H. (1999). The FIT-System: A new hand-held computer tool for ergonomic assessment. Medical & Biological Engineering & Computing, Supplement, 2(37), 862–863.
8.
HeldJ.ManserT. (2005). A PDA-based system for online recording and analysis of concurrent events in complex behavioral processes. Behavior Research Methods, 37(1), 155–164.
9.
HellwigB.Van UytvanckD.HulsboschM. (2009). ELAN: Linguistic Annotator, version 3.7. Retrieved on January 30, 2009 from http://www.lat-mpi.eu/tools/elan/.
10.
KaikkonenA.KekäläinenA.CankarM.KallioT.KankainenA. (2005). Usability testing of mobile applications: A comparison between laboratory and field testing. Journal of Usability Studies, 1, 4–16.
11.
KippM. (2001). Anvil: A generic annotation tool for multimodal dialogue. In Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech), 1367–1370.
LaucheK.BayerlP. S. (in press). Planning, monitoring, and trouble-shooting: Decision making in distributed drilling operations. In MosierK.FischerU. (eds.), Informed by knowledge: Expert performance in complex situations. New York, NY: Francis & Taylor.
14.
ManserT.HarrisonT. K.HowardS. K.GabaD. M. (2007). Coordination patterns and clinical performance levels in the management of a simulated anesthetic crisis. In Proceedings of the Human Factors and Ergonomics Society 51st Annual Meeting, 658–662.
15.
MillerG. A.1956. The magical number seven, plus or minus two: Some limits of our capacity to process information. Psychological Review, 63, 81–97.
16.
MosierK. L.SkitkaL. J.HeersS.BurdickM. D. (1998). Automation bias: Decision making and performance in high-tech cockpits. International Journal of Aviation Psychology, 8, 47–63.
17.
NoldusL. P. J. J. (1991). The Observer: A software system for collection and analysis of observational data. Behavior Research Methods, Instruments, & Computers, 23(3), 415–429.
18.
NoldusL. P.J. J.TrienesR. J. H.HendriksenA. H. M.JansenH.JansenR. G. (2000). The Observer Video-Pro: New software for the collection, management, and presentation of time-structured data from videotapes and digital media files. Behavior Research Methods, Instruments, & Computers, 32, 197–206.
19.
OrasanuJ.FischerU. (1992). Distributed cognition in the cockpit: Linguistic control of shared problem solving. In Proceedings of the Fourteenth Annual Conference of the Cognitive Science Society (pp.189–194). Hillsdale, NJ: Erlbaum.
20.
PattersonE. S.WoodsD. D. (2001). Shift changes, updates, and the on-call architecture in space shuttle mission control. Computer Supported Cooperative Work, 10, 317–346.
21.
RohlfingK.LoehrD.DuncanS.BrownA.FranklinA.KimbaraI. (2006). Comparison of multimodal annotation tools – a workshop report. Gesprächsforschung Online-Zeitschrift zur verbalen Interaktion, 99–123.
22.
SchraagenJ. M.LeijenhorstH. (1997). Searching for evidence: Knowledge and search strategies used by forensic experts. In SalasE.KleinG. (eds.), Linking expertise and naturalistic decision making (pp. 263–274). Mahwah, NJ: Erlbaum.
23.
SoriaC.BernsenN. O.CadéeN.CarlettaJ.DybkjæRL.EvertS. (2002). Advanced Tools for the Study of Natural Interactivity. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC1902), 357–363.
24.
UitterhoeveR.BensingJ.DilvenE.DondersR.DemulderP.Van AchterbergT. (2009). Nurse-patient communication in cancer care: Does responding to patient's cues predict patient satisfaction with communication. Psycho-Oncology, 18(10), 1060–1068.
25.
ZsambokC. E. (1997). Naturalistic decision making: Where are we now? In ZsambokC. E.KleinG. (eds.), Naturalistic decision making (pp. 3–16). Mahwah, NJ: Erlbaum.
26.
XiaoY.MilgramP.DoyleD. J. (1997). Capturing and modeling planning expertise in Anesthesiology: Results of a field study. In ZsambokC. E.KleinG. (eds.), Naturalistic decision making (pp. 197–205). Mahwah, NJ: Erlbaum.
