The purpose of the present study is to provide a historical account and metasynthesis of which statistical techniques are most frequently used in the fields of education and psychology. Six articles reviewing the American Educational Research Journal from 1969 to 1997 and five articles reviewing the psychological literature from 1948 to 2001 resulted in a total number of 17,698 techniques recorded from the 12,012 articles reviewed. No prior study of analytic practices has considered this broad scope of time and articles. Trends are discussed for the education and psychology literature both individually and collectively.
Aiken, L.S., West, S.G., & Millsap, R.E. ( 2008). Doctoral training in statistics, measurement and methodology in psychology. American Psychologist, 63, 32-50.
2.
Aiken, L.S., West, S.G., Sechrest, L., Reno, R.R. (with Roediger, H.L., Scarr, S., Kazdin, A.E., & Sherman, S.J.). (1990). The training in statistics, methodology, and measurement in psychology. American Psychologist, 45, 721-734.
3.
Bagozzi, R.P., Fornell, C., & Larcker, D.F. ( 1981). Canonical correlation analysis as a special case of a structural relations model. Multivariate Behavioral Research , 16, 437-454.
4.
Bangert, A.W., & Baumberger, J.P. (2005). Research and statistical techniques used in the Journal of Counseling & Development: 1990-2001 . Journal of Counseling & Development, 83, 480-487.
5.
Capraro, R.M., & Capraro, M. ( 2002). Treatments of effect sizes and statistical significance tests in textbooks. Educational and Psychological Measurement , 62, 771-782.
6.
Capraro, R.M., & Thompson, B. ( 2008). The educational researcher defined: What will future researchers be trained to do? Journal of Educational Research , 10, 247-253.
7.
Cleveland, W.S., & Devlin, S.J. ( 1988). Locally-weighted regression: An approach to regression analysis by local fitting. Journal of the American Statistical Association, 83, 596-610.
8.
Cliff, N. ( 1987). Analyzing multivariate data. San Diego , CA: Harcourt Brace Jovanovich.
9.
Cohen, J. ( 1968). Multiple regression as a general data-analytic system . Psychological Bulletin, 70, 426-443.
10.
Cronbach, L.J. ( 1957). The two disciplines of scientific psychology. American Psychologist, 12, 671-684.
11.
Cronbach, L.J. ( 1975). Beyond the two disciplines of psychology. American Psychologist, 30, 116-127.
12.
Curtis, D.A., & Harwell, M. ( 1998). Training doctoral students in educational statistics in the United States: A national survey. Journal of Educational Statistics, 6, 1-22.
13.
David, H.A. ( 1995). First (?) occurrence of common terms in mathematical statistics. The American Statistician, 49, 121-133.
14.
Edgington, E.S. ( 1964). A tabulation of inferential statistics used in psychology journals. American Psychologist, 19, 202-203.
15.
Edgington, E.S. ( 1974). A new tabulation of statistical procedures used in APA journals. American Psychologist, 29, 25-26.
16.
Elmore, P.B., & Woehlke, P.L. ( 1988). Statistical methods employed in ‘‘American Educational Research Journal,’’ ‘‘Educational Researcher,’’ and ‘‘Review of Educational Research’’ from 1978-1987 . Educational Researcher, 17(9), 19-20.
17.
Elmore, P.B., & Woehlke, P.L. ( 1998, April). Twenty years of research methods employed in ‘‘American Educational Research Journal,’’ ‘‘Educational Researcher,’’ and ‘‘Review of Educational Research.’’Paper presented at the annual meeting of the American Educational Research Association, Carbondale, IL.
18.
Emmons, N.J., Stallings, W.M., & Layne, B.H. ( 1990, April). Statistical methods used in ‘‘American Educational Research Journal,’’ ‘‘Journal of Educational Psychology,’’ and ‘‘Sociology of Education’’ from 1972 through 1987. Paper presented at the annual meeting of the American Educational Research Association, Boston, MA.
19.
Fan, X. ( 1997). Canonical correlation analysis and structural equation modeling: What do they have in common? Structural Equation Modeling, 4, 65-79.
20.
Goodwin, L.D., & Goodwin, W.L. ( 1985a). An analysis of statistical techniques used in the Journal of Educational Psychology, 1979-1983. Educational Psychologist , 20(1), 13-21.
21.
Goodwin, L.D., & Goodwin, W.L. ( 1985b). Statistical techniques in AERJ articles, 1979-1983: The preparation of graduate students to read the educational research literature . Educational Researcher, 14(2), 5-11.
22.
Graham, J.M. ( 2008). The General Linear Model as structural equation modeling . Journal of Educational and Behavioral Statistics, 33, 485-506.
Henson, R.K., Hull, D.M., & Williams, C.S. (2009). Methodology in our education research culture: Towards a stronger collective quantitative proficiency. Educational Researcher, 39(3), 229-240.
25.
Henson, R.K., & Williams, C.S. (2006, April). Doctoral training in research methodology: A national survey of education-related degrees. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
26.
Humphreys, L.G. ( 1978). Doing research the hard way: Substituting analysis of variance for a problem in correlational analysis. Journal of Educational Psychology, 70, 873-876.
27.
Humphreys, L.G., & Fleishman, A. ( 1974). Pseudo-orthogonal and other analysis of variance designs involving individual-differences variables. Journal of Educational Psychology, 66, 464-472.
28.
Jöreskog, K.G. ( 1969). A general approach to confirmatory maximum likelihood factor analysis. Psychometrika, 34, 183-202.
29.
Keiffer, K.M., Reese, R.J., & Thompson, B. ( 2001). Statistical techniques employed in AERJ and JCP articles from 1988 to 1997: A methodological review. Journal of Experimental Education, 69, 280-309.
30.
Kerlinger, F.N. ( 1986). Foundations of behavioral research (3rd ed.). New York, NY: Holt, Rinehart, & Winston.
31.
Keselman, H.J., Huberty, C.J., Lix, L.M., Olejnik, S., Cribbie, R.A., Donahue, B., . . . & Levin, J.R. (1998). Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA, and ANCOVA analyses . Review of Educational Research, 68, 350-386.
32.
Knapp, T.R. ( 1978). Canonical correlation analysis: A general parametric significance testing system. Psychological Bulletin, 85, 410-416.
Pearson, K. ( 1901). On lines and planes of closest fit to systems of points in space. Philosophical Magazine, 6, 559-572.
35.
Pedhazur, E.J. ( 1982). Multiple regression in behavioral research: Explanation and prediction (2nd ed.). New York, NY: Holt, Rinehart, & Winston.
36.
Schinka, J.A., LaLone, L., & Broeckel, J.A. (1997). Statistical methods in personality assessment research. Journal of Personality Assessment , 68, 487-496.
37.
Schwartz-Shea, P. ( 2003). Is this the curriculum we want? Doctoral requirements and offerings in methods and methodology. PS: Political Science and Politics, 36, 379-386.
38.
Spearman, C. ( 1904). General intelligence, objectively determined and measured . American Journal of Psychology, 15, 201-293.
39.
Thompson, B. ( 1999). Five methodology errors in educational research: A pantheon of statistical significance and other faux pas. In B. Thompson (Ed.), Advances in social science methodology (Vol. 5, pp. 23-86). Stamford, CT : JAI Press.
40.
Thompson, B. ( 2000). Ten commandments of structural equation modeling. In L. Grimm & P. Yarnold (Eds.), Reading and understanding more multivariate statistics (pp. 261-284). Washington, DC: American Psychological Association.
41.
Thompson, B. ( 2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Washington, DC: American Psychological Association.
42.
Thompson, B. ( 2006). Foundations of behavioral statistics: An insight-based approach. New York, NY: Guilford Press.
43.
Willson, V. ( 1980). Research techniques in AERJ articles: 1969 to 1978. Educational Researcher, 9(6), 5-10.
44.
Wilkinson, L., & APA Task Force on Statistical Inference. ( 1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
45.
Zientek, L.R., & Thompson, B. ( 2009). Matrix summaries improve research reports: Secondary analyses using published literature. Educational Researcher , 38, 343-352.
