The utility of online methods of data collection has led to the rapid adoption of Internet-based surveys for social sciences research. Given the potential problems of noncoverage and nonresponse when making use of this data collection method, the present study aimed to investigate differences between an online and a paper-based sample drawn from the same population and under the same conditions. The sample was composed of 597 undergraduate and postgraduate students from the University of the Witwatersrand in the 2010 academic year, the majority of whom (75.2%) chose to complete the paper-based version of the questionnaire. Results indicate that Internet access differs for both racial and socioeconomic groups in the sample but that demographic factors continue to affect the choice to complete online even after Internet access has been accounted for. Logistic regression analysis revealed that Black African respondents were less likely to complete online than other race groups while older respondents, those who spend more time online per day, those with higher levels of maternal education, those with lower levels of paternal education as well as female respondents were more likely to make use of the online completion option. Implications and alternatives to online data collection are discussed.
BarryB.ChukwumaV.PetitdidierM.CottrellL.BartonC. (January, 2009). Digital divide in sub-Saharan African Universities: Recommendations and monitoring. Paper presented at the atIST-Africa 2008 Conference & Exhibition, Windhoek, Namibia
2.
BoyerK. K.OlsonJ. R.CalantoneR. J.JacksonE. C. (2002). Print versus electronic surveys: A comparison of two data collection methodologies. Journal of Operations Management, 20, 357–373.
3.
CallasP. W.SolomonL. J.HughesJ. R.LivingstonA. E. (2010). The influence of response mode on study results: Offering cigarette smokers a choice of postal or online completion of a survey. Journal of Medical Internet Research, 12, 46. doi: 10.2196/jmir.1414
4.
ChurchA. H. (2001). Is there a method to our madness? The impact of data collection methodology on organizational survey results. Personnel Psychology, 54, 937–969.
5.
CookC.HeathF.ThompsonR. L. (2000). A meta-analysis of response rates in web- or internet-based surveys. Educational and Psychological Measurement, 60, 821–836.
6.
CouperM. P. (2000). Web surveys: A review of issues and approaches. The Public Opinion Quarterly, 64, 464–494.
7.
CouperM. P. (2007). Issues of representation in eHealth research (with a focus on web surveys). American Journal of Preventative Medicine, 32, S83–S89.
8.
CouperM. P.KapteynA.SchonlauM.WinterJ. (2007). Noncoverage and nonresponse in Internet survey. Social Science Research, 36, 138–148.
9.
DenscombeM. (2006). Web-based questionnaires and the mode effect: An evaluation on completion rates and data contents of near-identical questionnaires delivered in different modes. Social Science Computer Review, 24, 246–254.
10.
DuffyB.SmithK.TerhanianG.BremerJ. (2005). Comparing data from online and face-to-face surveys. International Journal of Market Research, 47, 615–639.
11.
EvansJ. R.MathurA. (2005). The value of online surveys. Internet Research, 15, 195–219.
12.
FanW.YanZ. (2010). Factors affecting response rates of the web survey: A systematic review. Computers in Human Behavior, 26, 132–139.
13.
FoxJ.MurrayC.WarmA. (2002). Conducting research using web-based questionnaires: Practical, methodological and ethical considerations. International Journal of Social Research Methodology, 6, 167–180.
14.
FrickerS.GalesicM.TourangeauR.YanT. (2005). An experimental comparison of web and telephone surveys. Public Opinion Quarterly, 69, 370–392.
15.
GillwaldA. (2005). Good intentions, poor outcomes: Telecommunications reform in South Africa. Telecommunications Policy, 29, 469–491.
16.
GoslingS. D.VazireS.SrivastavaS.JohnO. P. (2004). Should we trust web-based studies? A comparative analysis of six preconceptions about Internet questionnaires. American Psychologist, 59, 93–104.
17.
GushK.de VilliersR.SmithR.CambridgeG. (2010). Digital doorways. In Van BelleJ. P.MansillaE. V. (Eds.), ICT’s for global development and sustainability: Practice and applications (pp. 96–126). Pennsylvania, PA: Information Science Reference.doi: 10.4018/978-1-61520-997-2.ch005.
18.
HuangH. (2006). Do print and Web surveys provide the same results?. Computers in Human Behavior, 22, 334–350.
ManfredaK. L.BatageljZ.VehovarV. (2002). Design of Web survey questionnaires: Three basic experiments. Journal of Computer-Mediated Communication, 7. Retrieved December 8, 2010, fromhttp://www.ascusc.org/jcmc/vol7/issue3/vehovar.html
21.
MartinD. C. (1998). What’s in the name ‘coloured?’. Social Identities, 4, 523–540.
22.
McDonaldH.AdamS. (2003). A comparison on online and postal data collection methods in marketing research. Marketing Intelligence and Planning, 21, 85–95.
23.
McMorrisB. J.PetrieR. S.CatalanoR. F.FlemingR. F.HaggertyK. P.AbbottR. D. (2009). Use of Web and in-person survey modes to gather data from young adults on sex and drug use. An evaluation of cost, time, and survey error based on a randomized mixed-mode design. Evaluation Review, 33(2), 138–158.
24.
RanchodA.ZhouF. (2001). Comparing respondents of e-mail and mail surveys: Understanding the implications of technology. Marketing Intelligence & Planning, 19, 254–262.
25.
RosenthalR.RosnowR. L. (1991). Essentials of behavioral research: Methods and data analysis. Boston, MA: McGraw-Hill.
26.
SchonlauM.ZapertK.SimonL. P.SanstadK. H.MarcusS. M.AdamsJ.… BerryS. H. (2004). Comparison between responses from a propensity-weighted Web survey and an identical RDD survey. Social Science Computer Review, 22, 128–138.
27.
SCIC Monitoring Working Group. (2009). January 2009 Report of the ICFA-SCIC monitoring Working Group. Stanford, CA: ICFA-SCIC.
28.
ShihT.FanX. (2009). Comparing response rates in e-mail and paper surveys: A meta-analysis. Educational Research Review, 4, 26–40.
29.
SillsS.SongC. (2002). Innovations in survey research: An application of Web-based surveys. Social Science Computer Review, 20, 22–30.
30.
SkitkaL. J.SargisE. G. (2006). The Internet as a psychological laboratory. Annual Review of Psychology, 57, 529–555.
31.
TaylorH. (2000). Does Internet research “Work”? Comparing online survey results with telephone surveys. The International Journal of Market Research, 42, 1–7.
32.
World Bank Group, KAM. (2009). Knowledge assessment methodology custom report. Retrieved December 10, 2010, fromwww.worldbank.org/kam
33.
WrightK. B. (2005). Researching Internet based populations: Advantages and disadvantages of online survey research, online questionnaire authoring software packages, and web survey services. Journal of Computer-Mediated Communication, 10, article 11.
