Journal pages are filled with articles that scarcely mention the assumptions behind the chosen statistical techniques and models. Based on questionable foundations, the ultimate conclusions are intended to shape academia and guide practitioners. Violations of the underlying assumptions can result in biased and misleading forecasts, confidence intervals, and scientific insights.
The Solution
The field of human resource development (HRD) is equipped to present these assumptions clearly and concisely to ensure the integrity of statistical analysis and subsequent conclusions. Testing the principle assumptions of regression analysis is a process. As such, the presentation of this process in a systems framework provides a comprehensive plan with step-by-step guidelines to help determine the optimal statistical model for a particular data set. The goal of this article is to provide practitioners a Regression Development System that can be adapted to organizational performance as well as information that can be used to evaluate the strength of journal articles.
The Stakeholders
Quantitative researchers, practitioners, instructors, and students.
AngristJ.PischkeJ. (2010). The credibility revolution in empirical economics: How better research design is taking the con out of Econometrics. Journal of Economic Perspectives, 24, 3-30. doi:10.1257/jep.24.2.3
ChoiY. J.LeeC.JacobsR. (2015). The hierarchical linear relationship among structured on-the-job training activities, trainee characteristics, trainer characteristics, training environment characteristics, and organizational characteristics of workers in small and medium-sized enterprises. Human Resource Development International, 18, 499-520. doi:10.1080/13678868.2015.1080046
8.
ErnstA.AlbersC. (2017). Regression assumptions in clinical psychology research practice—A systematic review of common misconceptions. PeerJ, 5, e3323. Retrieved from https://peerj.com/articles/3323.pdf
FlattC.JacobsR. (2018). The relationship between participation in different types of training programs and gainful employment for formerly incarcerated individuals. Human Resource Development Quarterly, 29, 263-286. doi:10.1002/hrdq.21325
11.
FletcherL. (2016). Training perceptions, engagement, and performance: Comparing work engagement and personal role engagement. Human Resource Development International, 19, 4-26. doi:10.1080/13678868.2015.1067855
12.
GaravanT.McCarthyA.SheehanM.LaiY.SaundersM.ClarkeN.ShanahanV. (2019). Measuring the organizational impact of training: The need for greater methodological rigor. Human Resource Development Quarterly, 2019, 1-19.
IsmailH. (2016). Training and organizational commitment: Exploring the moderating role of goal orientation in the Lebanese context. Human Resource Development International, 19, 152-177. doi:10.1080/13678868.2015.1118220
16.
JacobsR. L. (2014). Chapter two: System theory and HRD. In ChalofskyN.RoccoT.MorrisL. (Eds.), Handbook of human resource development (pp. 21-39). New York, NY: Wiley.
17.
LiaoT. (1994). Interpreting probability models: Logit, probit, and other generalized linear models. Thousand Oaks, CA: SAGE publications.
18.
MooreR.GormanP. (2009). The impact of training and demographics in WIA program performance: A statistical analysis. Human Resource Development Quarterly, 20, 381-396. doi:10.1002/hrdq.20029
NimonK. (2011). Improving the quality of quantitative research reports: A call for action. Human Resource Development Quarterly, 22, 387-393. doi:10.1002/hrdq.20091
21.
NimonK. (2012). Statistical assumptions of substantive analyses across the general linear model: A mini review. Frontiers in Psychology, 3, 322. doi:10.3389/fpsyg.2012.00322
22.
NimonK. (2017). HRDQ submissions of quantitative research reports: Three common comments in decision letters and a checklist. Human Resource Development Quarterly, 28, 281-298. doi:10.1002/hrdq.21290
23.
OsborneJ.WatersE. (2002). Four assumptions of multiple regression that researchers should always test. Practical Assessment, Research, & Evaluation, 8(2), 1-5. Retrieved from https://pareonline.net/getvn.asp?n=2&v=8
24.
OsbourneJ. (2013). Is data cleaning and the testing of assumptions relevant in the 21st century?Frontiers in Psychology, 4, 370. doi:10.3389/fpsyg.2013.00370
SongJ. H.LimD. H. (2015). Mediating analysis approaches: Trends and implications for advanced applications in HRD research. Advances in Developing Human Resources, 17, 57-71. doi:10.1177/1523422314559807
29.
TurnerJ. (2015). Hierarchical linear modeling: Testing multilevel theories. Advances in Developing Human Resources, 17, 88-101. doi:10.1177/1523422314559808
30.
WestB.WelchK.GaleckiA. (2015). Linear mixed models: A practical guide using statistical software. Baca Raton, FL: CRC Press.
ZientekL.NimonK.Hammack-BrownB. (2016). Analyzing data from a pretest-posttest control group design: The importance of statistical assumptions. European Journal of Training and Development, 40, 638-659. doi:10.1108/EJTD-08-2015-0066
