In the vast majority of psychological research utilizing multiple regression analysis, asymptotic probability values are reported. This paper demonstrates that asymptotic estimates of standard errors provided by multiple regression are not always accurate. A resampling permutation procedure is used to estimate the standard errors. In some cases the results differ substantially from the traditional least squares regression estimates.
Get full access to this article
View all access options for this article.
References
1.
AndersonM. J. (2001) Permutation tests for univariate or multivariate analysis of variance and regression. Canadian Journal of Fisheries and Aquatic Sciences, 58, 626–639.
2.
AndersonM. J.LegendreP. (1999) An empirical comparison of permutation methods for tests of partial regression coefficients in a linear model. Journal of Statistical Computation and Simulation, 62, 271–303.
3.
AndersonM. J.RobinsonJ. (2001) Permutation tests for linear models. Australian & New Zealand Journal of Statistics, 43, 75–88.
BrownB. M.MaritzJ. S. (1982) Distribution-free methods in regression. Australian Journal of Statistics, 24, 318–331.
6.
CadeB. S. (2005) Linear models: permutation methods. In EverittB. S.HowellD. C. (Eds.), Encyclopedia of statistics in behavioral science. Vol. 2. Chichester, UK: Wiley. Pp. 1049–1054.
7.
CollinsM. F. (1987) A permutation test for planar regression. Australian Journal of Statistics, 29, 303–308.
8.
FreedmanD.LaneD. (1983) A nonstochastic interpretation of reported significance levels. Journal of Business & Economic Statistics, 1, 292–298.
9.
HowellD. C. (2002) Statistical methods for psychology. (5th ed.) Pacific Grove, CA: Duxbury.
10.
KennedyP. E. (1995) Randomization tests in economics. Journal of Business & Economic Statistics, 13, 85–94.
11.
KennedyP. E.CadeB. S. (1996) Randomization tests for multiple regression. Communications in Statistics—Simulation and Computation, 25, 923–936.
12.
ManlyB. F. J. (1997) Randomization, bootstrap and Monte Carlo methods in biology. (2nd ed.) London: Chapman & Hall.
13.
OjaH. (1987) On permutation tests in multiple regression and analysis of covariance problems. Australian Journal of Statistics, 29, 91–100.
14.
ter BraakC. J. F. (1992) Permutation versus bootstrap significance tests in multiple regression and ANOVA. In JockelK-H.RotheG.SendlerW. (Eds.), Bootstrapping and related techniques. Berlin: Springer-Verlag. Pp. 79–86.
15.
WelchW. J. (1990) Construction of permutation tests. Journal of the American Statistical Association, 85, 693–698.
