The problem of measuring tracking proficiency is reviewed and analyzed. The five classes of measurements discussed are:
(1) single-axis error amplitude scores;
(2) multi-axis error amplitude scores;
(3) simple frequency scores; control effort;
(4) special engineering measurement techniques;
(5) adaptive tracking measurements.
The most widely used score in psychological investigations, time on target, is shown not to be an interval measurement of tracking error amplitude and, in addition, is shown to be unreliable. Seventeen equations for the measurement of tracking skill are described. Adaptive tracking measurement techniques are shown to be more effective than are techniques employing fixed-difficulty tasks.
BekeyG. A.MeissingerH. F.RoseR. E.A study of model matching techniques for the determination of parameters in human pilot models. T. R. W. Space Technology Labs., Inc.: Technical Report to NASA Langley Research Center, May 2, 1964.
3.
BellmanR. E.DreyfusS. E.Applied dynamic programming.Princeton, New Jersey: Princeton University Press, 1962.
4.
BirminghamH. P.ChernikoffR.ZieglerP. N.The design and use of “equalization” teaching machines. Paper presented at the IRE International Congress on Human Factors in Electronics, Long Beach, California, May 1962.
5.
ClarkH. J.Space rendezvous using visual cues only. Human Factors, 1965, 7, 63–70.
6.
HudsonE. M.An adaptive tracking simulator. Paper presented at the IRE International Congress on Human Factors in Electronics, Long Beach, California, May 1962.
7.
JexH. R.McdonnellJ. D.PhatakA. V.A “critical” tracking task for manual control research. IEEE Transactions on Human Factors in Electronics, HFE-7(4), December 1966, 183–145.
8.
JexH. R.Two applications of a critical instability task to secondary work load research. Hawthorne, California: Systems Technology, Inc., Technical Report No. 155–1, February 1967.
9.
KelleyC. R.BowenH. M.ElyJ. H.AndreasJ. L.Tracking training: III. Transfer of training. Port Washington, N.Y.: U.S. Naval Training Device Center, Technical Report 1908-00-3, January 1960.
10.
KelleyC. R.Self-adjusting vehicle simulators. In The predictor instrument: Final report and summary of project activities during 1961.Stamford, Connecticut: Dunlap and Associates, Inc., January 1962. Also presented as a paper at the IRE International Congress on Human Factors in Electronics, Long Beach, California, May 1962.
11.
KelleyC. R.Design applications of adaptive (self-adjusting) simulators. Second Annual NASA-University Conference on Manual Control, Cambridge, Massachusetts, February 28-March 2, 1966.Washington: Scientific and Technical Information Division, National Aeronautics and Space Administration, NASA SP-128, 1966, 379–402.
12.
KelleyC. R.Research applications of adaptive tasks. Paper presented at the Third International Congress on Ergonomics, Birmingham, England, September 1967.
13.
KelleyC. R.ProsinD. J.Frequency adaptive tracking systems. In KelleyC. R.Further research with adaptive tasks. Technical Report to the Office of Naval Research. Santa Monica, California: Dunlap and Associates, Inc. July 1967.
KelleyC. R.Engineering models of the human operator. Chapter 13 in Manual and automatic control.New York: John Wiley & Sons, 1968, in press.
16.
McnemarQ.Psychological statistics.New York: John Wiley & Sons, 1955.
17.
McruerD. T.JexH. R.A review of quasilinear pilot models. IEEE Transactions on Human Factors in Electronics, HFE-8 (3), September 1967.
18.
MillerD. C.The effects of performance-scoring criteria on compensatory tracking behavior. IEEE Transactions on Human Factors in Electronics, HFE-6 (1), 1965, 62–65.
19.
MitchellM. B.Systems analysis—the human element. Electro-Technology, 1966, 88, 59–72.
20.
ObermayerR. W.SwartzW. F.MucklerF. A.Interaction of information displays with control system dynamics and course frequency in continuous tracking. Perceptual and Motor Skills, 1962, 15, 199–215.
21.
ObermayerR. W.WebsterR. B.MucklerF. A.Studies in optimal behavior in manual control systems: The effect of four performance criteria in compensatory rate-control tracking. Second Annual NASA-University Conference on Manual Control, Cambridge, Massachusetts, February 28-March 2, 1966.Washington, D.C.: Scientific and Technical Information Division, National Aeronautics and Space Administration, NASA SP-128, 1966, 311–324.
22.
PetersC. C.Van VoorhisW. R.Statistical procedures and their mathematical basis.New York: McGraw-Hill, 1940, 148ff.
SheridanT. B. The human operator in control instrumentation. In Progress in control engineering.London, England: Heywood and Company, Ltd., 1962.
25.
WestbrookC. B.AndersonR. O.PietrzakP. E.Handling qualities and pilot work load. USAF: Air Force Flight Dynamics Laboratory Technical Report FDCC TM 66–5, Wright-Patterson AFB, Dayton, Ohio, September 1966.
