The present study describes how much and in what ways the authors of articles fail to include adequate information about data collection. The instrumentation reported in 220 articles from 22 randomly selected journals was coded and tabulated using a scheme based on criteria from current research textbooks that are consistent with American Educational Research Association/American Psychological Association/National Council on Measurement in Education (AERA/APA/NCME) standards. Results suggest that the quality of measurement reporting continues to be a problem. Eight of the most common reporting failures are identified. It is recommended that journal editors and referees more thoughtfully consider the quality of measurement reporting when reviewing and editing submitted articles.
Get full access to this article
View all access options for this article.
References
1.
Airasian, P. (1991). Perspectives on measurement instruction. Educational Measurement: Issues and Practice, 10(1), 13-16.
2.
American Association for Counseling and Development/Association for Measurement and Evaluation in Counseling and Development (AACD/AMECD). (1989, May). Responsibilities of users of standardized tests. Guidepost, pp. 12, 16, 18, 27, 28.
3.
American Educational Research Association/American Psychological Association/National Council on Measurement in Education (AERA/APA/NCME). (1985). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
4.
American Federation of Teachers, National Council on Measurement in Education, National Education Association (AFT, NCME, NEA). (1990). Standards for teacher competence in educational assessment of students. Educational Measurement: Issues and Practice, 9(4), 30-32.
5.
Borg, W. R. , Gall, J P., & Gall, M. D. (1993). Applying educational measurement: A practical guide (3rd ed.). White Plains, NY: Longman.
6.
Cabell, D.W.E. (1992). Cabell's directory of publishing opportunities in education. Beaumont, TX: Cabell.
7.
Dawis, R. V. (1987). Scale construction. Journal of Counseling Psychology, 34, 481-489.
8.
Drummond, R. J. (1996). Appraisal procedures for counselors and helping professionals. Columbus, OH: Merrill.
9.
Fraenkel, J. R. , & Wallen, N. E. (1993). How to design and evaluate research in education (2nd ed.). New York: McGraw-Hill.
10.
Frary, R. B. , Cross, L. M., & Weber, L. J. (1993). Testing and grading practices and opinions of secondary teachers of academic subjects: Implications for instruction in measurement. Educational Measurement: Issues and Practice, 12(3), 23-30.
11.
Frisbie, D. A. , & Friedman, S. J. (1987). Test standards-Some implications of the measurement curriculum. Educational Measurement: Issues and Practice, 6(3), 17-23.
12.
Gay, L. R. (1992). Educational research: Competencies for analysis and application (4th ed.). New York: Macmillan.
13.
Gullikson, A. R. , & Hopkins, K. D. (1987). The context of educational measurement instruction for preservice teachers: Professor perspectives. Educational Measurement: Issues and Practice, 6(3), 12-16.
14.
Hall, B. W. , Ward, A. W., & Comer, C. B. (1988). Published education research: An empirical study of its quality. Journal of Educational Research, 81(3), 182-190.
15.
Joint Committee on Standards for Educational Evaluation. (1988). The personnel evaluation standards. Newbury Park, CA: Sage.
16.
Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards: How to assess evaluations of educational programs (2nd ed.). Thousand Oaks, CA: Sage.
17.
Kerlinger, F N. (1986). Foundations of behavioral research (3rd ed.). New York: Holt, Rinehart & Winston.
18.
Krathwohl, D. R. (1993). Methods of educational and social science research: An integrated approach. White Plains, NY: Longman.
19.
Meier, S. T. , & Davis, S. R. (1990). Trends in reporting psychometric properties of scales used in counseling psychology research. Journal of Counseling Psychology, 37, 113-115.
20.
O'Sullivan, R. G. , & Chalnick, M. K. (1991). Measurement-related course work requirements for teacher certification and recertification. Educational Measurement: Issues and Practice, 10(1), 17-19.
21.
Pedhazur, E. J. , & SchmeLkin, L. P. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Lawrence Erlbaum.
22.
Plake, B. S. , Impara, J. C., & Fager, J. J. (1993). Assessment competencies of teachers: A national survey. Educational Measurement: Issues and Practice, 12(4), 10-12.
23.
Schafer, W. D. (1991). Essential assessment skills in professional education of teachers. Educational Measurement: Issues and Practice, 10(1), 3-6.
24.
Stiggins, R. J. (1991). Relevant classroom assessment training for teachers. Educational Measurement: Issues and Practice, 10(1), 7-12.
25.
Stiggins, R. J. , Conklin, N. F., & Bridgeford, N. J. (1986). Classroom assessment: A key to effective education. Educational Measurement: Issues and Practice, 5(2), 5-17.
26.
Stiggins, R. J. , Frisbie, D. A., & Griswold, P. A. (1989). Inside high school grading practices: Building a research agenda. Educational Measurement: Issues and Practice, 8(2), 5-14.
27.
Thompson, B. (1994a, April). Common methodology mistakes in dissertations, revisited. Paper presented at the annual meeting of the American Educational Research Association, New Orleans. (ERIC Document Reproduction Service No. ED 368 771)
28.
Thompson, B. (1994b). Guidelines for authors. Educational and Psychological Measurement, 54, 837-847.
29.
Thomdike, R. L. , & Hagen, E. (1977). Measurement and evaluation in psychology and education (4th ed.). New York: John Wiley.
30.
Ward, A. W. , Hall, B. W., & Schran, C. F. (1975). Evaluation of published educational research: A national survey. American Educational Research Journal, 12(2), 109-128.
31.
Wilson, V. L. (1980). Research techniques in AERJ articles: 1969 to 1978. Educational Researcher, 9(6), 5-10.
