Field evaluation of human performance is rapidly assuming a role of major importance in system measurement. However, the special conditions under which such ecological tests must be performed impose certain limitations upon the evaluator which must be recognized. These limitations involve restrictions on the opportunity to manipulate variables, which lead to greater use of subjectively-oriented data collection tools: e.g. the human observer, the interview and checklists. Factors to be considered in the planning of a field test are discussed.
Get full access to this article
View all access options for this article.
References
1.
AckoffL.The development of operations research as a science. Cleveland, Ohio: Case Institute of Technology, 1956. (DDC Document No. AD 118741).
2.
BarnesR. M.Motion and time study. New York: John Wiley, 4th Ed., 1958.
3.
BerlinerC.AngellD.ShearerJ. W.Behaviors, measures and instruments for performance evaluation in simulated environments. Paper presented at the Symposium and Workshop on the Quantification of Human Performance. Albuquerque, N.M., August 17–19, 1964.
4.
ChapanisA.Research techniques in human engineering. Baltimore, Maryland: The Johns Hopkins Press, 1959.
5.
ChristensenJ. M.A sampling technique for use in activity analysis. Personnel Psychology, 1950, 3, 361–368.
6.
EchenbachA. E.Chm.. Minuteman ballistic missile workshop. Session presented at the Symposium and Workshop on the Quantification of Human Performance, Albuquerque, N.M., August 19, 1964.
7.
FeddersonG. J.PlattF. N.Driver performance: The Search for objective measurements. Paper presented at the Symposium and Workshop on the Quantification of Human Performance, Albuquerque, N.M., August 17–19, 1964.
8.
HaythornW. W.Information systems simulation and modelling. Paper presented at First Congress on the Information System Sciences, Hot Springs, Va., November 19, 1962.
9.
KempthorneO.The design and analysis of experiments. New York: John Wiley, 1952.
10.
KurkeM. I.StephensJ. A.System evaluation of the tank 76-mm Gun M41A1. Aberdeen Proving Ground, Maryland, Human Engineering Laboratories, 1957.
11.
MaynardH. B. (Ed.). Industrial engineering handbook. New York, McGraw-Hill, 1958.
12.
MeisterD.RabideauG. F.Human factors evaluation in system development. New York: Wiley, 1965.
13.
MillerR. B.A method for man–machine task analysis. USAF, Wright Air Development Center, Wright-Patterson Air Force Base, Ohio, WADC TR 53-137, June 1953.
14.
RabideauG. F.CooperJ. I.BatesC.Jr.A guide to the use of function and task analysis as a weapon system development tool. Northrop Corp., Contract AF33(616)-6336. Aerospace Medical Laboratory, Wright-Patterson Air Force Base, Ohio, January 1960.
15.
RappaportM.Further considerations about the what and how of field testing. Paper presented at Symposium on “Problems of Field Testing Complex Man–Machine Systems” Western Psychological Association Annual Meeting, Seattle, Washington, June 16, 1961.
16.
ShaperoA.BatesC.Jr.A method for performing human engineering analysis of weapon systems. USAF, Wright Air Development Center, Wright-Patterson Air Force Base, Ohio, WADC TR 59-784, September 1959.
17.
ShaperoA.EricksonC. J.Human factors testing in weapon system development. Paper presented at the Missile and Space Vehicle Testing Conference, American Rocket Society, Los Angeles, California, March 13-16, 1961.
18.
Van CottH. P.AltaianJ. W.Procedures for including human engineering factors in the development of weapon systems. USAF, Wright Air Development Center, Wright-Patterson Air Force Base, Ohio, WADC TR 56-488, October 1956.
19.
Air Force Regulation 80-14: Research and Development: Testing and Evaluation in support of the Operational and Technical Programs, and Engineering Services. Washington, D.C.: Department of the Air Force, August 19, 1958.