Sage Journals: Discover world-class research

Abstract

Using a standardized campus climate survey that was disseminated across three modes of administration (N = 5,137), this study assesses the nonresponse bias of two web-based versions to a self-administered paper-and-pencil version conducted at a Southeastern 4-year university. Significant differences emerged across all three modes of administration and victimization measures (bullying, sexual assault, rape, emotional abuse, and intimate partner violence [IPV]). Respondents were more likely to report victimization in the web-based surveys administered to online-only classes and via mass email compared to the paper survey. Policy implications, especially as it relates to survey administration, are discussed.

Keywords

campus climate survey victimization sexual victimization nonresponse bias self-administered surveys

Get full access to this article

View all access options for this article.

References

Abbey

McAuslan

Zawacki

Clinton

A. M.

Buck

P. O.

(2001). Attitudinal, experiential, and situational prediction of sexual assault perpetration. Journal of Interpersonal Violence, 16(8), 784–807. https://doi.org/10.1177/088626001016008004

American Association for Public Opinion Research. (2016). Standard definitions: Final dispositions of case codes and outcome rates for surveys. https://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf

Association of American Universities. (2017). AAU Campus Survey on Sexual Assault and Misconduct: Key findings. https://www.aau.edu/sites/default/files/AAU-Files/Key-Issues/Campus-Safety/AAU-Campus-Climate-Survey-FINAL-10-20-17.pdf

Bodner

T. E.

(2008). What improves with increased missing data imputations? Structural Equation Modeling: A Multidisciplinary Journal, 15, 651–675. https://doi.org/10.1080/10705510802339072

Cantalupo

N. C.

(2011). Burying our heads in the sand: Lack of knowledge, knowledge avoidance, and the persistent problem of campus peer sexual violence. Loyola University Chicago Law Journal, 43(6), 205–266.

Cantalupo

N. C.

(2014). Institution-Specific Victimization Surveys: Addressing legal and practical disincentives to gender-based violence reporting on college campuses. Trauma, Violence, & Abuse, 15(3), 227–241. https://doi.org/10.1177/1524838014521323

Cantor

Fisher

Chibnall

S. H.

Townsend

Lee

Bruce

Thomas

(2015). Report on the AAU Campus Climate Survey on Sexual Assault and Sexual Misconduct. https://www.aau.edu/sites/default/files/%40%20Files/Climate%20Survey/AAU_Campus_Climate_Survey_12_14_15.pdf

Couper

M. P.

(2000). Web Surveys: A review of issues and approaches. Public Opinion Quarterly, 64(4), 464–494. https://doi.org/10.1086/318641

Curtin

Presser

Singer

(2000). The effects of response rate changes on the Index of Consumer Sentiment. Public Opinion Quarterly, 64(4), 413–428. https://doi.org/10.1086/318638

10.

Davidov

Depner

(2011). Testing for measurement equivalence of human values across online and Paper-and-Pencil Surveys. Quality & Quantity, 45(2), 375–390. https://doi.org/10.1007/s11135-009-9297-9

11.

Dillman

D. A.

Smyth

J. D.

Christian

L. M.

(2009). Internet, mail, and mixed-mode surveys: The tailored method. John Wiley.

12.

Evans

J. R.

Mathur

(2005). The value of online surveys. Internet Research, 15(2), 195–219. https://doi.org/10.1108/10662240510590360

13.

Fisher

B. S.

Cullen

F. T.

Turner

M. G.

(2000). The sexual victimization of college women (Report No. NCJ 182369). National Institute of Justice, Bureau of Justice Statistics.

14.

Fisher

B. S.

Daigle

L. E.

Cullen

F. T.

(2009). Unsafe in the ivory tower: The sexual victimization of college women. Sage.

15.

Fisher

B. S.

Daigle

L. E.

Cullen

F. T.

Turner

M. G.

(2003). Reporting sexual victimization to the police and others: Results from a national-level study of college women. Criminal Justice and Behavior, 30(1), 6–38. https://doi.org/10.1177/0093854802239161

16.

Fisher

B. S.

Hartman

J. L.

Cullen

F. T.

Turner

M. G.

(2002). Making campuses safer for students: The Clery Act as a symbolic legal reform. Stetson Law Review, 32, 61–89.

17.

Franklin

C. A.

(2016). Sorority affiliation and sexual assault victimization: Assessing vulnerability using path analysis. Violence Against Women, 22(8), 895–922. https://doi.org/10.1177/1077801215614971

18.

Franklin

C. A.

Franklin

T. W.

Nobles

M. R.

Kercher

G. A.

(2012). Assessing the effect of routine activity theory and self-control on property, personal, and sexual assault victimization. Criminal Justice and Behavior, 39(10), 1296–1315. https://doi.org/10.1177/0093854812453673

19.

Gardella

J. H.

Nichols-Hadeed

C. A.

Mastrocinque

J. M.

Stone

J. T.

Coates

C. A.

Sly

C. J.

Cerulli

(2015). Beyond Clery Act statistics: A closer look at college victimization based on self-report data. Journal of Interpersonal Violence, 30(4), 640–658. https://doi.org/10.1177/0886260514535257

20.

Groves

R. M.

(2004). Survey errors and survey costs. Wiley.

21.

Groves

R. M.

(2006). Nonresponse rates and nonresponse bias in Household Surveys. Public Opinion Quarterly, 70(5), 646–675. https://doi.org/10.1093/poq/nfl033

22.

Henry

W. J.

Fowler

S. R.

West

N. M.

(2011). Campus climate: An assessment of students’ perceptions in a college of education. Urban Education, 46(4), 689–718. https://doi.org/10.1177/0042085911399791

23.

Hughes-Miller

(2017). From sexual harassment to sexual violence: The evolution of Title IX’s response to sexual victimization. In Kaukinen

Miller

M. H.

Powers

(Eds.), Addressing violence against women on college campuses (pp. 97–112). Temple University Press.

24.

Jordan

(2001). True “lies” and false “truths”: Women, rape, and the police [Doctoral dissertation]. Victoria University of Wellington.

25.

Kahn

A. S.

Jackson

Kully

Badger

Halvorsen

(2003). Calling it rape: Differences in the experience of women who do or do not label their sexual victimization as rape. Psychology of Women Quarterly, 27(3), 233–242. https://doi.org/10.1111/1471-6402.00103

26.

Kirkpatrick

Kanin

(1957). Male sexual aggression on a university campus. American Sociological Review, 22(1), 52–58. https://doi.org/10.2307/2088765

27.

Koss

M. P.

(1989). Hidden rape: Sexual aggression and victimization in a national sample of students in higher education. In Burgess

A. W.

(Ed.), Rape and sexual assault II (pp. 3–25). Garland.

28.

Krebs

C. P.

Lindquist

C. H.

Berzofksy

Shook-Sa

Peterson

(2016). Campus Climate Survey Validation Study: Final technical report (Report No. NCJ 249545). Bureau of Justice Statistics, U.S. Department of Justice.

29.

Krebs

C. P.

Lindquist

C. H.

Warner

T. D.

Fisher

B. S.

Martin

S. L.

(2007). The Campus Sexual Assault (CSA) Study: Final report (Report No. 221153). National Institute of Justice, US Department of Justice.

30.

Kreuter

Presser

Tourangeau

(2008). Social desirability bias in CATI, IVR, and Web Surveys: The effects of mode and question sensitivity. Public Opinion Quarterly, 72(5), 847–865. https://doi.org/10.1093/poq/nfn063

31.

Lavrakas

P. J.

(2008). Encyclopedia of survey research methods. Sage.

32.

Lewis

I. M.

Watson

B. C.

White

K. A.

(2009). Internet versus Paper-and-Pencil Survey methods in psychological experiments: Equivalence testing of participant responses to health-related messages. Australian Journal of Psychology, 61(2), 107–116. https://doi.org/10.1080/00049530802105865

33.

Lind

L. H.

Schober

M. F.

Conrad

F. G.

Reichert

(2013). Why do survey respondents disclose more when computers ask the questions? Public Opinion Quarterly, 77(4), 888–935. https://doi.org/10.1093/poq/nft038

34.

Lindquist

Krebs

C. P.

(2017). Campus Climate Surveys. In Kaukinen

Hughes-Miller

Powers

(Eds.), Addressing violence against women on college campuses (pp. 217–229). Temple University Press.

35.

Luther

(2016). Unsportsmanlike conduct: College football and the politics of rape. Akashic Books.

36.

Maxfield

M. G.

Babbie

E. R.

(2016). Basic of research methods for criminal justice and criminology. Cengage Learning.

37.

McCauley

J. L.

Calhoun

K. S.

Gidycz

C. A.

(2010). Binge drinking and rape: A prospective examination of college women with a history of previous sexual victimization. Journal of Interpersonal Violence, 25(9), 1655–1668. https://doi.org/10.1177/0886260509354580

38.

McMahon

Stepleton

Cusano

O’Connor

Gandhi

McGinty

(2018). Beyond Sexual Assault Surveys: A model for comprehensive campus climate assessments. Journal of Student Affairs Research and Practice, 55(1), 78–90. https://doi.org/10.1080/19496591.2017.1358629

39.

Office of the Assistant Secretary. (2011). Dear colleague letter. Office for Civil Rights, United States Department of Education.

40.

Pickett

Cullen

Bushway

S. D.

Chiricos

Alpert

(2018). The response rate test: Nonresponse bias and the future of survey research in criminology and criminal justice (SSRN Scholarly Paper ID 3103018). Social Science Research Network. https://papers.ssrn.com/abstract=3103018

41.

Porter

S. R.

Whitcomb

M. E.

Weitzer

W. H.

(2004). Multiple surveys of students and survey fatigue. New Directions for Institutional Research, 2004(121), 63–73. https://doi.org/10.1002/ir.101

42.

Rubin

D. B.

(1987). Multiple imputation for nonresponse in surveys. John Wiley.

43.

Schonlau

Fricker

R. D.

Elliott

M. N.

(2001). Conducting Research Surveys via e-mail and the web. Rand Corporation.

44.

Sue

V. M.

Ritter

L. A.

(2007). Conducting online surveys. Sage.

45.

Tourangeau

Conrad

F. G.

Couper

M. P.

(2013). The science of web surveys. Oxford University Press.

46.

Tourangeau

Yan

(2007). Sensitive questions in surveys. Psychological Bulletin, 133(5), 859–883. https://doi.org/10.1037/0033-2909.133.5.859

47.

University of Kentucky. (2015). C.A.T.S—Campus attitudes toward safety, 2016. Center for Research on Violence against Women, University of Kentucky. https://www.uky.edu/CATSseesafety/

48.

Van der Heijden

G. J.

Donders

A. R. T.

Stijnen

Moons

K. G.

(2006). Imputation of missing values is superior to complete case analysis and the missing-indicator method in multivariable diagnostic research: A clinical example. Journal of Clinical Epidemiology, 59(10), 1102–1109. https://doi.org/10.1016/j.jclinepi.2006.01.015

49.

Warschauer

(2004). Technology and social inclusion: Rethinking the digital divide. MIT Press.

50.

Wells

Cavanaugh

M. R.

Bouffard

J. A.

Nobles

M. R.

(2012). Non-response bias with a Web-Based Survey of college students: Differences from a classroom Survey About Carrying Concealed Handguns. Journal of Quantitative Criminology, 28(3), 455–476. https://doi.org/10.1007/s10940-011-9148-4

51.

Wood

Nosko

Desmarais

Ross

Irvine

(2006). Online and traditional paper-and-pencil survey administration: Examining experimenter presence, sensitive material, and long surveys. Canadian Journal of Human Sexuality, 15(3–4), 147–155.

52.

Wood

Sulley

Kammer-Kerwick

Follingstad

Busch-Armendariz

(2017). Climate Surveys: An inventory of understanding sexual assault and other crimes of interpersonal violence at institutions of higher education. Violence Against Women, 23(10), 1249–1267. https://doi.org/10.1177/1077801216657897

53.

Woodlock

(2016). The abuse of technology in domestic violence and stalking. Violence Against Women, 23(5), 584–602. https://doi.org/10.1177/1077801216646277

Differences in Nonresponse Bias and Victimization Reports Across Self-Administered Web-Based and Paper-and-Pencil Versions of a Campus Climate Survey

Abstract

Keywords

Get full access to this article

References