This study focused on survey response, which was defined simply as the completion of a survey. It examined connections between survey response and college student characteristics. It also investigated whether survey response predicted educational outcomes, including retention. The study focused on a cohort of first-year students at a mid-size, 4-year public university. Eighty percent of the students responded to a survey administered during their first semester. Survey response was linked with high school percentile rank and sex. Survey response was also a significant predictor of first semester grade point average and retention to the second year. The findings suggest that survey non-response may be an early warning indicator for first-year students. Also, the findings suggest that research based on surveys may be overlooking a sub-population (non-responders) that could affect the validity of those models.
Get full access to this article
View all access options for this article.
References
1.
AikenL. R. (1988). The problem of nonresponse in survey research. Journal of Experimental Education, 56(3), 116–119.
2.
AlbaumG. S.EvangelistaF. & MedinaN. (1998). Role of response behavior theory in survey research: A cross-national study. Journal of Business Research, 42(2), 115–125.
3.
AstinA. W. (1993). What matters in college?San Francisco: Jossey-Bass, Inc.
4.
AstinA. W. (1997). How “good” is your institution's retention rate?Research in Higher Education, 38(6), 647–658.
5.
CaetanoR. (2001). Non-response in alcohol and drug surveys: A research topic in need of further attention. Addiction, 96(11), 1541–1545.
6.
CariniR. M.HayekJ. C.KuhG. D. & OiumetJ. A. (2001, June). College student responses to web and paper surveys: Does mode matter? [Electronic version]. Paper presented at the 2001 Association of Institutional Researchers Forum, Long Beach, CA.
7.
CavusgilS. T. & Elvey-KirkL. A. (1998). Mail survey response behavior: A conceptualization of motivating factors and an empirical study. European Journal of Marketing, 32(11–12), 1165–1192.
8.
Center for Postsecondary Research and Planning. (2002). National survey of student engagement: Viewpoint [Brochure]. Bloomington, IN: Indiana University.
9.
ChildersT. L. & SkinnerS. J. (1996). Toward a conceptualization of mail survey response behavior. Psychology and Marketing, 13(2), 185–209.
10.
ColomboR. (2000). A model for diagnosing and reducing nonresponse bias. Journal of Advertising Research, 40(1–2), 85–93.
11.
DeyE. L. (1997). Working with low survey response rates: The efficacy of weighting adjustments. Research in Higher Education, 38(2), 215–227.
12.
DillmanD. A. (1991). The design and administration of mail surveys. Annual Review of Sociology, 17, 225–249.
13.
DillmanD. A. (2000). Mail and internet surveys: The tailored design method. New York: J. Wiley & Sons, Inc.
14.
EvangelistaF.AlbaumG. & PoonP. (1999). An empirical test of alternative theories of survey response behavior. Journal of the Market Research Society, 41(2), 227–244.
15.
FoxR. J.CraskM. R. & KimJ. (1988). Mail survey response rate: A meta-analysis of selected techniques for inducing response. Public Opinion Quarterly, 52(4), 467–491.
16.
GreenK. E. (1996). Sociodemographic factors and mail survey response. Psychology and Marketing, 13(2), 171–184.
17.
HartmanB. W.FuquaD. R. & JenkinsS.J. (1986). The problems and remedies for nonresponse bias in educational surveys. Journal of Experimental Education, 54(2), 85–90.
18.
HelgesonJ. G.VossK. L. & TerpeningW. D. (2002). Determinants of mail-survey response: Survey design factors and respondent factors. Psychology and Marketing, 19(3), 303–328.
19.
JonesJ. (1996). The effects of non-response on statistical inference. Journal of Health and Social Policy, 8(1), 49–62.
20.
KrushatW. M. & MolnarJ. I. (1993). The effect of nonrespondents on a self-administered mail survey. Evaluation Practice, 14(1), 25–32.
21.
KuhG. D. (2001). The national survey of student engagement: Conceptual framework and overview of psychometric properties [Electronic version]. Bloomington, IN: Indiana University Center for Postsecondary Research and Planning.
22.
Martinez-EbersV. (1997). Using monetary incentives with hard-to-reach populations in panel surveys. International Journal of Public Opinion Quarterly, 9(1), 77–86.
23.
McDanielS. W.MaddenC. S. & VerilleP. (1987). Do topic differences affect survey non-response?Journal of the Market Research Society, 29(1), 55–66.
24.
PiltzA. & O'ReganW. (1957). Non-responses and non-quantifiable data in sample surveys. Journal of Educational Research, 51, 143–147.
25.
PourjalaliH. & KimbrellJ. (1994). Effects of four instrumental variables on survey response. Psychological Reports, 75(2), 895–898.
26.
SalantP. (1994). How to conduct your own survey. New York: J. Wiley & Sons, Inc.
27.
SaxL. J.KeupJ. R.GilmartinS. K.StolzenbergE. B. & HarperC. (2002). Findings from the 2000 administration of your first college year (YFCY): National aggregates. [Electronic version]. Los Angeles, CA: University of California, Los Angeles, Higher Education Research Institute.
28.
StrageA. A. (1999). Social and academic integration and college success: Similarities and differences as a function of ethnicity and family educational background. College Student Journal, 33(2), 198–205.
29.
TintoV. (1993). Leaving college: Rethinking the causes and cures of student attrition. Chicago and London: The University of Chicago Press.
30.
Van KenhoveP.WijnenK & De WulfK. (2002). The influence of topic involvement on mail-survey response behavior. Psychology and Marketing, 29(3), 293–301.
