A Neglected Area of Accountability: The Failure of Instructional-Materials Evaluation and a Solution1

Abt, C. An evaluation model: How to compare curriculum materials. Nations Schools, 1970, 86, 21-28.

Adamson, G. , & Van Etten, C. Prescribing via analysis and retrieval of instructional materials in the Educational Modulation Center. Exceptional Children , 1970 , 36, 531-533.

Armstrong, Jenny R. A model for materials development and evaluation. Exceptional Children, 1971, 38, 327-334.

Armstrong, J. , & Senzig, K. Instructional materials used and preferred by Wisconsin teachers of the mentally retarded. Education and Training of the Mentally Retarded , 1970, 5, 73-86.

Bahlke, S. , & Feldhusen, J. Componential evaluation of creativity instructional materials. In V. Crockenberg (Ed.), Paper Abstracts , Washington, D.C.: American Educational Research Association , 1969, p. 68.

Baird, L. L. Prediction of academic and nonacademic achievement in two-year colleges from the ACT assessment. Educational and Psychological Measurement , 1969, 29, 421-430.

Block, J. Mastery learning: Theory and practice. New York : Holt, 1971.

Bogatz, B. E. An investigation of teacher expectancies of instructional materials . Exceptional Children, 1971, 38, 233-236.

Bolton, D. L. (Ed.) The use of simulation in educational administration. Columbus, Ohio: Merrill, 1971.

Boocock, S., & Schild, E. O. (Eds.) Simulation games in learning. Beverly Hills, Cal.: Sage Publications, 1968.

Borg, W.R. The balance between educational research and development: A question of strategy . Educational Technology, 1969 , 9(7), 5-11.

Campion, L.E. , & Komoskie, K. Evaluation practices used in the selection of educational materials and equipment . Albany, N.Y.: Division of Educational Communications, State University of New York and State Education Department, 1969.

Carfioli, J. , Comprehensive descriptive analysis of components of the instructional system. Educational Technology, 1973, in press.

Carlson, M. A., & Tillman, R. Selection and evaluation of learning materials . Childhood Education, 1967, 43, 266-270.

Carter, L.F. , The systems approach to education: Mystique and reality. Educational Technology, 1969, 9(4), 22-31.

Carter, H. L. Testing a technique for evaluating instructional materials. The Elementary School Journal, 1969, 70, 99-107.

Chahbazi, P. Use of projective tests in predicting college achievement. Educational and Psychological Measurement, 1956, 16, 538-542.

Chorafas, D.N. Systems and simulation. New York: Academic Press, 1965.

Cronbach, L. J. Course improvement through evaluation. Teachers College Record, 1963, 67, 672-681.

Drew, C. J., & Martinson, M.C. Educational methodology: An examination of approach. Exceptional Children, 1971, 38, 117-120.

Eash, M.J. Assessing curriculum materials: A preliminary instrument. Educational Product Report, 1969, 2(5), 18-24.

Finn, J.D. Institutionalization of evaluation. Educational Technology , 1969, 9(12), 14-23.

Franz, G. , David, J.A. , & Garcia, D. Prediction of grades from pre-admissions indices in Georgia tax-supported colleges. Educational and Psychological Measurement, 1958, 18, 841-844.

George Washington University. Proceedings of conference for the evaluation of instructional materials. Washington, D.C.: George Washington University, Special Education Instructional Materials Center, 1968. (ED-027-657).

Gorth, W. P., & Hambleton, R.K. Measurement considerations for criterion-referenced testing and special education. The Journal of Special Education , 1972, 6, 303-314.

Griessman, B.E. An approach to evaluating comprehensive social projects. Educational Technology, 1969, 9(2), 16-19.

Griffin, S.F. The crises games: Simulating international conflict. New York: Double-day, 1965.

Grobman, H. Evaluating activities of curriculum projects: A starting point. Chicago: Rand McNally, 1968 (AERA Monograph Series on Curriculum Evaluation, No. 2).

Guba, E.G. The failure of educational evaluation. Educational Technology , 1969, 9(5), 29-38.

Guetzkow, H. (Ed.) Simulation in social science: Readings. Englewood Cliffs, N.J.: Prentice-Hall, 1962.

Junkala, J. Teacher evaluation of instructional materials. Teaching Exceptional Children, 1970, 2, 73-76.

Kim, Y. , Anderson, H.E., Jr. , & Bashaw, W. L. Social maturity, achievement, and basic ability. Educational and Psychological Measurement , 1968, 28, 535-543.

Kurfman, D.G. Using questionnaire data to revise curriculum materials. Paper presented at the annual meeting of The American Educational Research Association, Minneapolis, March 1970.

Lance, W.D. Development and evaluation of instructional materials. In J. Arena (Ed.), Selected papers on learning disabilities: Progress in parent information, professional growth, and public policy. Pittsburgh, Pa.: Association for Children with Learning Disabilities. 1969.

Levine, S.J. Empirical study of instructional materials evaluation in special education . In Selected convention papers. Washington, D.C.: Council for Exceptional Children, 1969.

Lorge, I. Planning cooperative utilization of data on the mentally retarded . American Journal of Mental Deficiency, 1959, 64, 269-277.

Lilly, S. Evaluation of instructional materials: A child-centered approach. Eugene, Oregon: Northwest Regional Instructional Materials Center for Handicapped Children and Youth (University of Oregon) , 1969. Luce, R. D. , & Raiffa, H. Games and decisions: Introduction and critical survey. New York: Wiley, 1957.

Lumsdaine, A.A. Instruments and media of instruction. In N. L. Gage (Ed.), Handbook of Research on Teaching. Chicago: Rand McNally, 1962.

Mann, L. The ground game in special education. The Journal of Special Education, 1971, 5, 53-65.

Mann, L. , Proger, B.B. , & Cross, L.H. Aptitude-treatment interactions with handicapped children: A focus on the measurement of the aptitude component. Paper presented at the meeting of the American Educational Research Association, New Orleans, February 1973 (To be available from Educational Resources Information Center-ERIC).

McIntyre, R.B. , & Nelson, C.C. Empirical evaluation of instructional materials. Educational Technology, 1969, 9(2), 24-27.

Mehlinger, H.D. , & Patrick, J.J. The use of "formative" and "summative" evaluation in an experimental curriculum project: A case in the practice of instructional materials evaluation. Paper presented at the annual meeting of the American Educational Research Association, Minneapolis, March 1970.

Mehrens, W. A. National assessment of educational progress. Childhood Education, 1970, 46, 442-425.

Mize, J.H. , & Cox, J.G. Essentials of simulation. Englewood Cliffs, N.J. : Prentice-Hall, 1968.

Moss, M. H. Evaluation as a responsibility of the IMC network. Exceptional Children, 1968, 35, 303-306.

Nelson, C.C. , McIntyre, R.B. , & Watts, C.A. Sequential analysis as a means of evaluating instructional materials . Educational Technology, 1969, 9(10), 99-102.

Popham, W. J. (Ed.) Criterion referenced measurement: An introduction. Englewood Cliffs, N.J.: Educational Technology Publications, 1971.

Proger, B. B. Program evaluation: The model-building game. Journal of Learning Disabilities, 1971, 4, 292-306.

Proger, B. B., & Mann, L. Criterion-referenced measurement: The world of the black and white versus the gray. Journal of Learning Disabilities, 1973, 6, 72-84.

Proger, B.B. , Mann, L. , Burger, R.M. , & Cross, L.H. Adapting criterion-referenced measurement to individualization of instruction for handicapped children: Some issues and a first attempt. Paper presented at the meeting of the American Educational Research Association, Chicago, April 1972. (Available from Educational Resources Information Center-ERIC-as document ED-064-354).

Proger, B. B., McGowan, J. R., Bayuk, R. J., Jr., Mann, L., Trevorrow, R. L., & Massa, E. The relative predictive and construct validities of the Otis-Lennon Mental Ability Test, the Lorge-Thorndike Intelligence Test, and the Metropolitan Readiness Test in grades two and four: A series of multivariate analyses. Educational and Psychological Measurement, 1971, 31, 529-538.

Randall, R.S. An operational application of the CIPP model for evaluation. Educational Technology, 1969, 9(7), 40-44

Robertson, A. G. Applying systems analysis techniques to the evaluation of vocational programs. Journal of Industrial Teacher Education, 1969, 6, 30-36.

Schoenfeldt, L. F. Data archives as resources for research, instruction, and policy planning. American Psychologist, 1970, 25, 609-616.

Seymour, L.A. , & Proger, B.B. Formal evaluation of the effectiveness of performance contracting programs for learning disabilities. In J. I. Arena (Ed.), The child with learning disabilities: His right to learn; Selected papers on learning disabilities, 1971 . Pittsburgh, Pa.: Association for Children with Learning Disabilities, 1971.

Shoemaker, D. M. Improving criterion-referenced measurement. The Journal of Special Education, 1972, 6, 315-324.

Singh, S. , & Barnard, J. Evaluation of instructional materials: An approach. Tampa, Fla.: Southeastern Materials Center (University of South Florida), 1969. (ED-038-812).

Stake, R. E. Generalizability of program evaluation: The need for limits. Educational Product Report, 1969, 2, 39-40.

Stufflebeam, D.L. Evaluation as enlightenment for decision making. In W. H. Beatty (Ed.), Improving educational assessment and an inventory of measures of affective behavior. Washington, D.C.: Association for Supervision and Curriculum Development, National Education Association, 1969.

Taba, J. Curriculum development: Theory and practice. New York: Harcourt Brace Jovanovich. 1962.

Tate, M.W. Statistics in education and psychology: A first course. New York: Macmillan, 1965.

Twelker, P.A. (Ed.) Instructional simulation systems: An annotated bibliography. Corvallis, Oregon: Continuing Education Publications , 1969.

Tyler, R. W., Gagne, R. M., & Scriven, M. (Eds.) Perspectives of curriculum evaluation. Chicago : Rand McNally, 1967. ( AERA Monograph Series on Curriculum Evaluation, No. 1).

Von Neumann, J. , & Morgenstern, O. Theory of games and economic behavior. Princeton, N.J.: Princeton University Press , 1944.

Walken, Christine. An evaluation of some instructional materials used in a classroom for behaviorally disturbed children. In Selected convention papers. Washington, D.C.: Council for Exceptional Children , 1968.

Webb, S. C. The prediction of achievement for first year dental students. Educational and Psychological Measurement, 1956, 16, 543-548.

Weinthaler, Judith. The systematic selection of instructional materials based on an inventory of learning abilities and skills. Exceptional Children, 1970, 36, 615-619.

Welch, W.W. Curriculum evaluation. Review of Educational Research , 1969, 39, 429-443.