Sage Journals: Discover world-class research

Abstract

The CWS expert performance index was applied to participants' skill development in CTEAM (Controller Teamwork Evaluation and Assessment Methodology), an air traffic control microworld environment. CWS integrates discrimination and consistency such that larger CWS scores indicate better performance. Over eight weeks, participants gained mastery over the task, which involved routing aircraft to assigned destinations. Aircraft Density and Restricted Airspace affected performance such that more complex scenarios led to lower CWS scores. Furthermore, CWS scores increased with practice. Moderate correlations between CWS scores and objective measures of performance were obtained, validating the index. Potential applications to training are discussed.

Get full access to this article

View all access options for this article.

References

Bailey

L. L.

Broach

D. M.

Thompson

R. C.

Enos

R. J.

(1999). Controller teamwork evaluation and assessment methodology: (CTEAM): A scenario calibration study. (DOT/FAA/AAM-99/24). Washington, DC: Federal Aviation Administration Office of Aviation Medicine. Available from: National Technical Information Service, Springfield, VA 22161.

Cochran

W. G.

(1943). The comparison of different scales of measurement for experimental results. Annals of Mathematical Statistics, 14, 205–216.

Einhorn

H. J.

(1972). Expert measurement and mechanical combination. Organizational Behavior and Human Performance, 7, 86–106.

Einhorn

H. J.

(1974). Expert judgment: Some necessary conditions and an example. Journal of Applied Psychology, 59, 562–571.

Ettenson

(1984). A schematic approach to the examination of the search for and use of information in expert decision making. Unpublished doctoral dissertation, Kansas State University.

Hammond

K. R.

(1996). Human judgment and social policy. New York: Oxford University Press.

Nagy

R. H.

(1977). How are personnel selection decisions made? An analysis of decision strategies in a simulated personnel selection. Unpublished doctoral dissertation, Kansas State University.

Phelps

R. H.

Shanteau

(1978). Livestock judges: How much information can an expert use? Organizational Behavior and Human Performance, 21, 209–219.

Shanteau

Weiss

D. J.

Thomas

R. P.

Pounds

J. C.

(in press). Performance-based assessment of expertise: How to decide if someone is an expert or not. European Journal of Operations Research..

Utilizing CWS to Track the Longitudinal Development of Expertise

Abstract

Get full access to this article

References