Principle Assumptions of Regression Analysis: Testing,Techniques,and Statistical Reporting of Imperfect Data Sets

Abstract

The Problem

Journal pages are filled with articles that scarcely mention the assumptions behind the chosen statistical techniques and models. Based on questionable foundations, the ultimate conclusions are intended to shape academia and guide practitioners. Violations of the underlying assumptions can result in biased and misleading forecasts, confidence intervals, and scientific insights.

The Solution

The field of human resource development (HRD) is equipped to present these assumptions clearly and concisely to ensure the integrity of statistical analysis and subsequent conclusions. Testing the principle assumptions of regression analysis is a process. As such, the presentation of this process in a systems framework provides a comprehensive plan with step-by-step guidelines to help determine the optimal statistical model for a particular data set. The goal of this article is to provide practitioners a Regression Development System that can be adapted to organizational performance as well as information that can be used to evaluate the strength of journal articles.

The Stakeholders

Quantitative researchers, practitioners, instructors, and students.

Keywords

regression quantitative assumptions

Get full access to this article

View all access options for this article.

References

Anderson

Verkuilen

Johnson

(2012). Applied generalized linear mixed models: Continuous and discrete data. Retrieved from https://education.illinois.edu/docs/default-source/carolyn-anderson/edpsy587/GLM_GLMM_LMM.pdf

Angrist

Pischke

(2010). The credibility revolution in empirical economics: How better research design is taking the con out of Econometrics. Journal of Economic Perspectives, 24, 3-30. doi:10.1257/jep.24.2.3

Bhalla

(2015). Detect non-linear and non-monotonic relationship between variables. Retrieved from https://www.listendata.com/2015/03/detect-non-linear-and-non-monotonic.html

Chen

Ender

Mitchell

Wells

(2003a). Regression with SAS. https://stats.idre.ucla.edu/stat/sas/webbooks/reg/default.htm

Chen

Ender

Mitchell

Wells

(2003b). Regression with Stata. https://stats.idre.ucla.edu/stat/stata/webbooks/reg/default.htm

Chen

Ender

Mitchell

Wells

(2003c). Regression with SPSS. https://stats.idre.ucla.edu/stat/spss/webbooks/reg/default.htm

Choi

Y. J.

Lee

Jacobs

(2015). The hierarchical linear relationship among structured on-the-job training activities, trainee characteristics, trainer characteristics, training environment characteristics, and organizational characteristics of workers in small and medium-sized enterprises. Human Resource Development International, 18, 499-520. doi:10.1080/13678868.2015.1080046

Ernst

Albers

(2017). Regression assumptions in clinical psychology research practice—A systematic review of common misconceptions. PeerJ, 5, e3323. Retrieved from https://peerj.com/articles/3323.pdf

Flatt

(2019). Selected works of Candace Flatt. Retrieved from https://works.bepress.com/candace-flatt/

10.

Flatt

Jacobs

(2018). The relationship between participation in different types of training programs and gainful employment for formerly incarcerated individuals. Human Resource Development Quarterly, 29, 263-286. doi:10.1002/hrdq.21325

11.

Fletcher

(2016). Training perceptions, engagement, and performance: Comparing work engagement and personal role engagement. Human Resource Development International, 19, 4-26. doi:10.1080/13678868.2015.1067855

12.

Garavan

McCarthy

Sheehan

Lai

Saunders

Clarke

Shanahan

(2019). Measuring the organizational impact of training: The need for greater methodological rigor. Human Resource Development Quarterly, 2019, 1-19.

13.

Hoekstra

Kiers

Johnson

(2012). Are assumptions of well-known statistical techniques checked, and why (not)? Frontiers in Psychology, 3, 137. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3350940/pdf/fpsyg-03-00137.pdf

14.

IBM. (2016). Retrieved from http://www-01.ibm.com/support/docview.wss?uid=swg21476748

15.

Ismail

(2016). Training and organizational commitment: Exploring the moderating role of goal orientation in the Lebanese context. Human Resource Development International, 19, 152-177. doi:10.1080/13678868.2015.1118220

16.

Jacobs

R. L.

(2014). Chapter two: System theory and HRD. In Chalofsky

Rocco

Morris

(Eds.), Handbook of human resource development (pp. 21-39). New York, NY: Wiley.

17.

Liao

(1994). Interpreting probability models: Logit, probit, and other generalized linear models. Thousand Oaks, CA: SAGE publications.

18.

Moore

Gorman

(2009). The impact of training and demographics in WIA program performance: A statistical analysis. Human Resource Development Quarterly, 20, 381-396. doi:10.1002/hrdq.20029

19.

Nau

(2018). Statistical forecasting: Notes on regression and time series analysis. Retrieved from http://people.duke.edu/~rnau/testing.htm

20.

Nimon

(2011). Improving the quality of quantitative research reports: A call for action. Human Resource Development Quarterly, 22, 387-393. doi:10.1002/hrdq.20091

21.

Nimon

(2012). Statistical assumptions of substantive analyses across the general linear model: A mini review. Frontiers in Psychology, 3, 322. doi:10.3389/fpsyg.2012.00322

22.

Nimon

(2017). HRDQ submissions of quantitative research reports: Three common comments in decision letters and a checklist. Human Resource Development Quarterly, 28, 281-298. doi:10.1002/hrdq.21290

23.

Osborne

Waters

(2002). Four assumptions of multiple regression that researchers should always test. Practical Assessment, Research, & Evaluation, 8(2), 1-5. Retrieved from https://pareonline.net/getvn.asp?n=2&v=8

24.

Osbourne

(2013). Is data cleaning and the testing of assumptions relevant in the 21st century? Frontiers in Psychology, 4, 370. doi:10.3389/fpsyg.2013.00370

25.

Park

(2008). Univariate analysis and normality test using SAS, Stata, and SPSS (Working Paper). Retrieved from http://download.brookerobertshaw.com/normality_testing_sas_spss.pdf

26.

Perktold

Seabold

Taylor

(2018). Regression diagnostics and specification tests. Retrieved from https://www.statsmodels.org/dev/diagnostic.html

27.

Smith

(2012). Common mistakes in using statistics. Retrieved from https://web.ma.utexas.edu/users/mks/statmistakes/TOC.html

28.

Song

J. H.

Lim

D. H.

(2015). Mediating analysis approaches: Trends and implications for advanced applications in HRD research. Advances in Developing Human Resources, 17, 57-71. doi:10.1177/1523422314559807

29.

Turner

(2015). Hierarchical linear modeling: Testing multilevel theories. Advances in Developing Human Resources, 17, 88-101. doi:10.1177/1523422314559808

30.

West

Welch

Galecki

(2015). Linear mixed models: A practical guide using statistical software. Baca Raton, FL: CRC Press.

31.

Williams

(2015). Nonlinear relationships. Retrieved from https://www3.nd.edu/~rwilliam/stats2/l61.pdf

32.

Wooldridge

(2013). Introductory econometrics: A modern approach. Mason, OH: South-Western, Cengage Learning. Retrieved from http://economics.ut.ac.ir/documents/3030266/14100645/Jeffrey_M._Wooldridge_Introductory_Econometrics_A_Modern_Approach__2012.pdf

33.

Zientek

Nimon

Hammack-Brown

(2016). Analyzing data from a pretest-posttest control group design: The importance of statistical assumptions. European Journal of Training and Development, 40, 638-659. doi:10.1108/EJTD-08-2015-0066