New Software for Courses in Test Construction'

Abstract

This paper describes a computer program developed as an aid to instruction in multivariate and measurement statistics. The program, ANALYSIS, was designed as a program for the traditional psychometric screening of test items. The program analyzes test data on three levels: respondent, item, and total score. ANALYSIS options include (a) item difficulty and discrimination, (b) correlation of each response (correct, distractor, and omit) with the total score, (c) item efficiency, (d) total score statistics such as mean, standard deviation, skewness, kurtosis, significance tests for skewness and kurtosis, (e) Hoyt (1941) partitions of variance components, (f) Kuder-Richard-son formula 21, Hoyt(1941), and Cronbach's alpha reliability indices (g) tests of the parametric properties and (h) a comprehensive graphics package.

Get full access to this article

View all access options for this article.

References

Alexander, H. W. The estimation of reliability when several trials are available, Psychometrika, 1947, 12, 79-99.

Bock, R. D. Multivariate statistical methods in behavioral research. New York: McGraw-Hill, 1975.

D'Agostino, R. B. and Tietjen, G. L. Simulation probability points of b2 in small samples, Biometrika, 1971, 58, 669-672.

David, H. A. , Hartley, H. O. , and Pearson, E. S. The distribution of the ratio, in a single normal sample, of range to standard deviation, Biometrika, 1954, 41, 482-493.

Ebel, R. L. Procedures for the analysis of classroom tests, EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT , 1954, 14, 352-364.

Ferguson, G. A. On the theory of test discrimination , Psychometrika, 1949, 14, 61-68.

Geary, R. C. Testing for normality, Biometrika , 1947, 34, 209-242.

Guilford, J. P. Psychometric Methods (2nd. ed.) New York: McGraw-Hill, 1954.

Gulliksen, H. Theory of mental tests. New York: Wiley, 1950 .

10.

Hashway, R. M. ANALYSIS: A comprehensive computer program for the analysis of achievement test data, Chestnut Hill, Mass.: Laboratory For Statistical And Policy Research, Boston College, 1977.

11.

Henryssen, S. Gathering, analyzing, and using data on test items, in Educational Measurement (2nd. ed.) In R. L. Thorndike (Ed.) American Council on Education, Washington, D. C. , 1971, p. 130-159.

12.

Hofmann, R. J. The concept of efficiency in item analysis. EDUCATIONAL PSYCHOLOGICAL MEASUREMENT, 35, 1975, 621-640.

13.

Hoyt, C. J. Test reliability estimated by analysis of variance, Psychometrika, 10, 1945, 127-131.

14.

Kaitz, H. B. A note on reliability, Psychometrika, 1945, 10, 127-131.

15.

Lovenger, J. A systematic approach to the construction and evaluation of tests of ability. Psychological Monographs, 61, 1947.

16.

Lord, F. M. and Novick, M. R. Statistical theories of mental test scores. (2nd. ed.) Reading, Mass.: Addison-Wesley, 1974.

17.

Nunnally, J. C. Psychometric theory. New York: McGraw-Hill, 1967.

18.

Pearson, E. S. and Hartley, H. O. (Eds.) Biometrika tables for statisticians. (Vol. I, 3rd. ed.). New York: Cambridge University Press, 1966.

19.

Rakow, E. Itemanal. Chestnut Hill, Mass.: Boston College, 1972 .

20.

Thurlow, W. R. Direct measures of discriminations among individuals performed by psychological tests, Journal of Psychology, 1950, 29, 281-314.

21.

Woodbury, M. A. On the standard length of a test. Psychometrika, 1951, 16, 103-106.