This article describes the statistical methods used in quantitative and mixed methods articles between 2006 and 2010 in five gifted education research journals. Results indicate that the most commonly used statistical methods are means (85.9% of articles), standard deviations (77.8%), Pearson’s r (47.8%), χ2 (32.2%), ANOVA (30.7%), t tests (30.0%), and MANOVA (23.0%). Approximately half (53.3%) of the articles included reliability reports for the data at hand; Cronbach’s alpha was the most commonly reported measure of reliability (41.5%). Some discussions of best statistical practice and implications for the field of gifted education are included.
AikenL. S.WestS. G.MillsapR. E. (2008). Doctoral training in statistics, measurement, and methodology in psychology: Replication and extension of Aiken, West, Sechrest, and Reno’s (1990) survey of PhD programs in North America. American Psychologist, 63, 32-50. doi:10.1037/0003-066X.63.1.3210.1037/0003-066X.63.1.32
2.
AgrestiA. (2007). An introduction to categorical data analysis. Hoboken, NJ: Wiley.
3.
American Educational Research Association. (2006). Standards for reporting on empirical social science research in AERA publications. Educational Researcher, 35, 33-40. doi:10.3102/0013189x03500603310.3102/0013189x035006033
4.
American Psychological Association. (1994). Publication manual of the American Psychological Association (4th ed.). Washington, DC: Author.
5.
American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
6.
American Psychological Association. (2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.
7.
APA Publications and Communications Board Working Group on Journal Article Reporting Standards. (2008). Reporting standards for research in psychology: Why do we need them? What might they be?American Psychologist, 63, 839-851. doi:10.1037/0003-066x.63.9.83910.1037/0003-066x.63.9.839
8.
BangertA. W.BaumbergerJ. P. (2005). Research and statistical techniques used in the Journal of Counseling & Development: 1990-2001. Journal of Counseling & Development, 83, 480-487.
9.
BaumbergerJ. P.BangertA. W. (1996). Research designs and statistical techniques used in the Journal of Learning Disabilities, 1989-1993. Journal of Learning Disabilities, 29, 313-316. doi:10.1177/00222194960290031010.1177/002221949602900310
10.
BrayJ. H.MaxwellS. E. (1985). Multivariate analysis of variance. Newbury Park, CA: Sage.
11.
BrownW. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3, 296-322. doi:10.1111/j.2044-8295-1910.tb00207.x10.1111/j.2044-8295-1910.tb00207.x
12.
CohenJ. (1968a). Multiple regression as a general data-analytic system. Psychological Bulletin, 70, 426-443. doi:10.1037/h002671410.1037/h0026714
13.
CohenJ. (1968b). Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213-220. doi:10.1037/h002625610.1037/h0026256
14.
CohenJ. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
15.
ColemanL. J.GuoA.DabbsC. S. (2007). The state of qualitative research in gifted education as published in American journals: An analysis and critique. Gifted Child Quarterly, 51, 51-63. doi:10.1177/001698620629665610.1177/0016986206296656
16.
CooperH. (2010). Research synthesis and meta-analysis (4th ed.). Thousand Oaks, CA: Sage.
17.
CostelloA. B.OsborneJ. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1-9.
18.
DaiD. Y.SwansonJ. A.ChengH. (2011). State of research on giftedness and gifted education: A survey of empirical studies published during 1998-2010 (April). Gifted Child Quarterly, 55, 126-138. doi:10.1177/001698621039783110.1177/0016986210397831
19.
Deditius-IslandH. K.CarusoJ. C. (2002). An examination of the reliability of scores from Zuckerman’s Sensation Seeking Scales, Form V. Educational and Psychological Measurement, 62, 728-734. doi:10.1177/001316440206200401210.1177/0013164402062004012
20.
DurlakJ. A. (2009). How to select, calculate and interpret effect sizes. Journal of Pediatric Psychology, 34, 917-928. doi:10.1093/jpepsy/jsp00410.1093/jpepsy/jsp004
21.
EdgingtonE. S. (1964). A tabulation of inferential statistics used in psychology journals. American Psychologist, 19, 202-203. doi:10.1037/h003917710.1037/h0039177
22.
EdgingtonE. S. (1974). A new tabulation of statistical procedures used in APA journals. American Psychologist, 29, 25-26. doi:10.1037/h003584610.1037/h0035846
23.
ElmoreP. B.WoehlkeP. L. (1988). Statistical methods employed in American Educational Research Journal, Educational Researcher, and Review of Educational Research from 1978 to 1987. Educational Researcher, 17, 19-20. doi:10.3102/0013189X01700901910.3102/0013189X017009019
24.
FerronJ. M.HogartyK. Y.DedrickR. F.HessM. R.NilesJ. D.KromreyJ. D. (2008). Reporting results from multilevel analyses. In O’ConnellA. A.McCoachD. B. (Eds.), Multilevel modeling of educational data (pp. 391-426). Charlotte, NC: Information Age.
25.
FidlerF. (2010). Statistical significance, result worthiness and evidence: What lessons are there for giftedness education in other disciplines? In ThompsonB.SubotnikR. F. (Eds.), Methodologies for conducting research on giftedness (pp. 71-88). Washington, DC: American Psychological Association.
26.
GentryM.PetersS. J. (2009). Effect sizes in gifted education research. Gifted Child Quarterly, 53, 219-222. doi:10.1177/001698620933497610.1177/0016986209334976
27.
GuttmanL. (1954). Some necessary conditions for common-factor analysis. Psychometrika, 19, 149-161. doi:10.1007/BF0228916210.1007/BF02289162
28.
HakstianA. R.RogersW. T.CattellR. B. (1982). The behavior of number-of-factors rules with simulated data. Multivariate Behavioral Research, 17, 193-219. doi:10.1207/s15327906mbr1702_310.1207/s15327906mbr1702_3
HoganT. P.BenjaminA.BrezinskiK. L. (2000). Reliability methods: A note on the frequency of use of various types. Educational and Psychological Measurement, 60, 523-531. doi:10.1177/0013164002197069110.1177/00131640021970691
31.
HoxJ. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Erlbaum.
32.
HubertyC. J. (1989). Problems with stepwise methods—better alternatives. In ThompsonB. (Ed.), Advances in social science methodology (Vol. 1, pp. 43-70). Greenwich, CT: JAI Press.
KiefferK. M.ReeseR. J. (2002). A reliability generalization study of the Geriatric Depression Scale. Educational and Psychological Measurement, 62, 969-994. doi:10.1177/001316440223808510.1177/0013164402238085
35.
KiefferK. M.ReeseR. J.ThompsonB. (2001). Statistical techniques employed in AERJ and JCP articles from 1988 to 1997: A methodological review. Journal of Experimental Education, 69, 280-309. doi:10.1080/0022097010959948910.1080/00220970109599489
36.
KlineR. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York, NY: Guilford Press.
37.
LarsenR.WarneR. T. (2010). Estimating confidence intervals for eigenvalues in exploratory factor analysis. Behavior Research Methods, 42, 871-876. doi:10.3758/BRM.42.3.87110.3758/BRM.42.3.871
38.
LipseyM. W.WilsonD. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
39.
MatthewsM. S.GentryM.McCoachD. B.WorrellF. C.MatthewsD.DixonF. (2008). Evaluating the state of a field: Effect size reporting in gifted education. Journal of Experimental Education, 77, 55-68. doi:10.3200/JEXE.77.1.55-6810.3200/JEXE.77.1.55-68
40.
McCoachD. B. (2010a). Dealing with dependence (Part II): A gentle introduction to hierarchical linear modeling. Gifted Child Quarterly, 54, 252-256. doi:10.1177/001698621037347510.1177/0016986210373475
41.
McCoachD. B. (2010b). Hierarchical linear modeling. In HancockG. R.MuellerR. O. (Eds.), The reviewer’s guide to quantitative methods in the social sciences (pp. 123-140). New York, NY: Routledge.
42.
McCoachD. B.AdelsonJ. L. (2010). Dealing with dependence (Part I): Understanding the effects of clustered data. Gifted Child Quarterly, 54, 152-155. doi:10.1177/001698621036307610.1177/0016986210363076
43.
McCoachD. B.SiegleD. (2009). The first word: A letter from the co-editors: Effect sizes—An explanation of JAA editorial policy. Journal of Advanced Academics, 20, 209-212. doi:10.1177/1932202X090200020110.1177/1932202X0902000201
44.
O’ConnorB. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32, 396-402. doi:10.3758/BF0320080710.3758/BF03200807
45.
ParkerM. R.JordanK. R.KirkE. R.AspirantiK. B.BainS. K. (2010). Publications in four gifted education journals from 2001 to 2006: An analysis of article types and authorship characteristics. Roeper Review, 32, 207-216.
46.
RaudenbushS. W.BrykA. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
47.
ShieldsA. L.CarusoJ. C. (2004). A reliability induction and reliability generalization study of the Cage Questionnaire. Educational and Psychological Measurement, 64, 254-270. doi:10.1177/001316440326181410.1177/0013164403261814
48.
SkidmoreS. T.ThompsonB. (2010). Statistical techniques used in published articles: A historical review of reviews. Educational and Psychological Measurement, 70, 777-795. doi:10.1177/001316441037932010.1177/0013164410379320
49.
SpearmanC. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3, 271-295. doi:10.111/j.2044-8295.1910.tb00206.x10.111/j.2044-8295.1910.tb00206.x
50.
StevensJ. P. (2002). Applied multivariate statistics for the social sciences (4th ed.). Mahwah, NJ: Erlbaum.
51.
SunJ. (2005). Assessing goodness of fit in confirmatory factor analysis. Measurement and Evaluation in Counseling and Development, 37, 240-256.
52.
ThompsonB. (1989). Why won’t stepwise methods die?Measurement and Evaluation in Counseling and Development, 21, 146-148.
53.
ThompsonB. (1995). Stepwise regression and stepwise discriminant analysis need not apply here: A guidelines editorial. Educational and Psychological Measurement, 55, 525-534. doi:10.1177/001316449505500400110.1177/0013164495055004001
54.
ThompsonB. (2001). Significance, effect sizes, stepwise methods, and other issues: Strong arguments move the field. Journal of Experimental Education, 70, 80-93. doi:10.1080/0022097010959949910.1080/00220970109599499
55.
ThompsonB. (2004). Exploratory and confirmatory factor analysis. Washington, DC: American Psychological Association.
56.
ThompsonB. (2006). Foundations of behavioral statistics. New York, NY: Guilford Press.
57.
ThompsonB.DiamondK. E.McWilliamR.SnyderP.SnyderS. W. (2005). Evaluating the quality of evidence from correlational research for evidence-based practice. Exceptional Children, 71, 181-194.
58.
Vacha-HaaseT.KoganL. R.ThompsonB. (2000). Sample compositions and variabilities in published studies versus those in test manuals: Validity of score reliability inductions. Educational and Psychological Measurement, 60, 509-522. doi:10.1177/0013164002197068210.1177/00131640021970682
59.
VelicerW. F.EatonC. A.FavaJ. L. (2000). Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In GoffinR. D.HelmesE. (Eds.), Problems and solutions in human assessment: Honoring Douglas N. Jackson at seventy (pp. 41-71). New York, NY: Kluwer Academic/Plenum.
60.
WarneR. T. (2011). A reliability generalization of the Overexcitability Questionnaire–Two (OEQII). Journal of Advanced Academics, 22, 671-692. doi:10.1177/1932202X1142488110.1177/1932202X11424881
61.
WarneR. T.LiY.McKyerE. L. J.CondieR.DiepC. S.MuranoP. S. (in press). Dealing with data dependence using hierarchical linear modeling. Journal of Nutrition Education and Behavior.
62.
WilkinsonL., & the Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604. doi:10.1037/0003-066X.54.8.59410.1037/0003-066X.54.8.594
63.
WillsonV. L. (1980). Research techniques in AERJ articles: 1969 to 1978. Educational Researcher, 9, 5-10. doi:10.3102/0013189X00900600510.3102/0013189X009006005
64.
ZwickW. R.VelicerW. F. (1982). Factors influencing four rules for determining the number of components to retain. Multivariate Behavioral Research, 17, 253-269. doi:10.1207/s15327906mbr1702_510.1207/s15327906mbr1702_5
65.
ZwickW. R.VelicerW. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432-442. doi:10.1037/0033-2909.99.3.43210.1037/0033-2909.99.3.432
