This paper describes shortcomings in current team performance measurement methodologies, discusses emerging observational and automated measurement techniques, and describes surrogate measurement concepts in the context of team performance. Research using surrogate approaches is suggested to improve the reliability of team assessment and to increase the sensitivity of team measures to conditions that are likely to improve or degrade team performance.
Get full access to this article
View all access options for this article.
References
1.
ARTEP (1985). FC7-13, Light Infantry Battalion and Brigade Operations and Battalion ARTEP Mission Training Plan (AMTP). Washington, DC: Government Printing Office.
2.
BiersD. W.SauerD. W. (1982). Job sample tests as predictors of M1 gunnery performance (Appendices A-E) (Report No. SRL-66391). Dayton, OH: Systems Research Labs. (NTIS No. AD A135879).
3.
CarrollJ. B. (1980). Individual difference relations in psychometric and experimental cognitive tasks.Chapel Hill, NC: L. L. Thurstone Psychometric Laboratory, University of North Carolina.
4.
Committee on the Performance of Military Personnel (1986). Assessing the performance of enlisted personnel: Evaluation of a joint-service research project.Washington, DC: National Academy Press.
5.
Defense Systems, Inc. (1984). HEAT Executive Summary.McLean, VA: Defense Systems, Inc.
6.
EysenckH. J. (Ed.) (1982). A model for intelligence.Heidelberg: Springer-Verlag.
7.
GuilfordJ. P. (1954). Psychometric methods (2nd ed.) New York: McGraw-Hill, 400–402.
8.
JensenA. R. (1986). G: Artifact or reality?Journal of Vocational Behavior, 29(3), 301–331. Duluth, MN: Academic Press, Inc.
9.
JohnsonJ. H.JonesM. B.KennedyR. S. (1984). A video test for the prediction of tank commander performance. Proceedings of the 28th Annual Meeting of the Human Factors Society.Santa Monica, CA: Human Factors Society, 502–503.
10.
KavanaghM. J.HedgeJ. W.BormanW. C.VanceR. J.KraigerK.DickinsonT.BanksC. (1987). Issues and directions in job performance measurement.Atlanta, GA: Presented at Annual Conference of the Society for Industrial and Organizational Psychology.
11.
LaneN. E. (1986). Issues in performance measurement for military aviation with applications to air combat maneuvering (NTSC TR-86008). Orlando, FL: Naval Training Systems Center.
12.
LaneN. E.KennedyR. S.JonesM. B. (1986). Overcoming unreliability in operational measures: The use of surrogate measure systems. Proceedings of the 30th Annual Meeting of the Human Factors Society.Santa Monica, CA: Human Factors Society.
13.
LinternG.NelsonB. E.SheppardD. J.WestraD. P.KennedyR. S. (1981). Visual technology research simulator (VTRS) human performance research: Phase III (NAVTRAEQUIPCEN 78-C-0060-11). Orlando, FL: Canyon Research Group.
14.
MixonT. R. (1982). An annotated bibliography of objective pilot performance measures, Part II (Technical Report No. NPS55-81-010PR). Monterey, CA: Naval Post Graduate School.
15.
MorganB. B.Jr.GlickmanA. S.WoodardE. A.BlaiwesA. S.SalasE. (1986). Measurement of team behaviors in a Navy training environment (NTSC TR-86-014). Norfolk, VA: Center for Applied Psychological Studies, Old Dominion University.
16.
ThomasG. S.BarberH. F.KaplanI. T. (1984). The impact of CATTS systems characteristics on selected measures of battalion command group performance (Final Technical Report 609, 20364744-A795). Alexandria, VA: Army Research Institute for the Behavioral and Social Sciences.
17.
TurnageJ. J.HouserT. L.HofmannD. A. (1987). An assessment of training performance measurement methodologies for collective military units with recommendations for future study (Contract N61339-85-D-0024 DO #0001). Orlando, FL: Institute for Simulation and Training, University of Central Florida.
18.
TurnageJ. J.KennedyR. S.OsteenM. K. (1987). Repeated measures analyses of selected psychomotor tests from PAB and APTS: Stability, reliability, and cross-task correlations (Report for Army Aeromedical Research Laboratory Contract DAMD 17-85-C-5095). Orlando, FL: Essex Corporation.
19.
WestraD. P.LinternG.SheppardD. J.ThomleyK. T.MaukR.WightmanD. C.ChambersW. (1986). Simulator design and instructional features for carrier landings: Transfer study (NAVTRASYSCEN 85-C-0044-2). Orlando, FL: Naval Training Systems Center.
