An Evaluation of Aviator Training Ability Requirements Scale Ratings

Abstract

The Ability Requirements Scales developed by Fleishman and his associates have been widely used as a job analysis technique. However, the ability ratings obtained with this technique may be confounded by rater bias effects. Fifteen instrument-phase instructor pilots rated the extent to which 32 basic abilities were required to perform 16 helicopter training tasks. Psychometric analyses showed significant differences in rater distributions. The method of successive intervals was used to transform the ratings to a common, equal-interval scale. Analyses of the transformed ratings indicate that significant task-ability discriminations were made that produced a logical, interpretable pattern of ability and task interrelationships.

Get full access to this article

View all access options for this article.

References

Ekstrom

R. B.

French

J. W.

Harman

H. H.

(1976). Manual for kit of factor-referenced cognitive tests. Princeton, NJ: Educational Testing Service.

Fleishman

E. A.

(1975a). Toward a taxonomy of human performance. American Psychologist, 30, 1127–1149.

Fleishman

E. A.

(1975b). Development of ability requirement scales for the analysis of Bell system jobs. Bethesda, MD: Management Research Institute.

Fleishman

E. A.

(1982). Systems for describing human tasks. American Psychologist, 37, 821–834.

Fleishman

E. A.

Hogan

J. C.

(1978). A taxonomic method for assessing the physical requirements of jobs: The physical abilities analysis approach. Washington, DC: Advanced Research Resources Organization.

Guilford

J. P.

(1954). Psychometric methods (2nd ed.). New York: McGraw-Hill.

Guilford

J. P.

(1967). The nature of human intelligence. New York: McGraw-Hill.

Hays

W. L.

(1967). Quantification in psychology. Belmont, CA: Brooks/Cole Publishing.

Landy

F. J.

Vance

R. J.

Barnes-Farrell

J. L.

Steele

J. W.

(1980). Statistical control of halo error in performance ratings. Journal of Applied Psychology, 65, 501–506.

10.

Mallamad

S. M.

Levine

J. M.

Fleishman

E. A.

(1980). Identifying ability requirements by decision flow diagrams. Human Factors, 22, 57–69.

11.

Myers

D. C.

Jennings

M. C.

Fleishman

E. A.

(1982). Validation of cognitive and perceptual-motor tests for assigning pilots to different missions: Job analysis findings (Interim Report 3075IR). Washington, DC: Advanced Research Resources Organization.

12.

Saal

Downey

Lahey

(1980). Rating the ratings: Assessing the psychometric quality of rating data. Psychological Bulletin, 88, 413–428.

13.

Shrout

P. E.

Fleiss

J. L.

(1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.