Sage Journals: Discover world-class research

Abstract

One of the implicit assumptions in survey research is lower response rates by sexual minorities than by nonminorities. With rapidly changing public attitudes toward same-sex marriage, we reconsider this assumption. We used data from the 2013 and 2014 National Health Interview Survey that include contact history data for all sample families as well as sexual orientation information about adults sampled from responding families. We created proxy nonresponse indicators based on contact efforts and reluctance from contact history data and linked them to sexual orientation of the sample adult and simulated nonresponse. The data did not support the assumption: Straight adults were more difficult to get cooperation from than nonstraights. With female sexual minorities showing higher nonresponse than their male counterparts, special considerations are required. Replication analyses may provide insights into what factors influence study participation decisions, which will inform how nonresponse may impact the accuracy of research findings.

Get full access to this article

View all access options for this article.

References

Catania

J. A.

Gibson

D. R.

Chitwood

D. D.

Coates

T. J.

. 1990. Methodological problems in AIDS behavioral research: Influences on measurement error and participation bias in studies of sexual behavior. Psychological Bulletin 108:339–62.

Clift

J. B.

Kirby

. 2012. Health care access and perceptions of provider care among individuals in same-sex couples: Findings from the Medical Expenditure Panel Survey (MEPS). Journal of Homosexuality 59:839–50.

Cochran

S. D.

Mays

V. M.

. 2000. Relation between psychiatric syndromes and behaviorally defined sexual orientation in a sample of the US population. American Journal of Epidemiology 151:516–23.

Curtin

Presser

Singer

. 2000. The effects of response rate changes on the index of consumer sentiment. Public Opinion Quarterly 64:413–28.

Curtin

Presser

Singer

. 2005. Changes in telephone survey nonresponse over the past quarter century. Public Opinion Quarterly 69:87–98.

Dahlhamer

J. M.

Galinsky

A. M.

Joesti

S. S.

Ward

B. W.

. 2014. Sexual orientation in the 2013 National Health Interview Survey: A quality assessment. https://www.cdc.gov/nchs/data/series/sr_02/sr02_169.pdf (accessed January 5, 2017).

Dahlhamer

J. M.

Galinsky

A. M.

Joesti

S. S.

Ward

B. W.

. 2016. Barriers to health care among adults identifying as sexual minorities: A US national study. American Journal of Public Health 106:1116–22.

Davern

. 2013. Nonresponse rates are a problematic indicator of nonresponse bias in survey research. Health Services Research 48:905–12.

Dilley

J. A.

Wynkoop Simmons

Boysun

M. J.

Pizacani

B. A.

Stark

M. J.

. 2010. Demonstrating the importance and feasibility of including sexual orientation in public health surveys: Health disparities in the Pacific northwest. American Journal of Public Health 100:460–67.

10.

Flores

A. R.

2015. Examining variation in surveying attitudes on same-sex marriage: A meta-analysis. Public Opinion Quarterly 79:580–93.

11.

Fredriksen-Goldsen

K. I.

Kim

H.-J.

. 2015. Count me in: Response to sexual orientation measures among older adults. Research on Aging 37:464–80.

12.

Fredriksen-Goldsen

K. I.

Kim

H.-J.

Barkan

S. E.

Muraco

Hoy-Ellis

C. P.

. 2013. Health disparities among lesbian, gay, and bisexual older adults: Results from a population-based study. American Journal of Public Health 103:1802–9.

13.

Groves

R. M.

2006. Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly 70:646–75.

14.

Herold

E. S.

Way

. 1998. Sexual self-disclosure among university women. Journal of Sex Research 24:1–14.

15.

Jans

Viana

Grant

Cochran

S. D.

Lee

A. C.

Ponce

N. A.

. 2015. Trends in sexual orientation missing data over a decade of the California Health Interview Survey. America Journal of Public Health 105:e43–50.

16.

Johnson

T. P.

Wislar

. 2012. Response rates and nonresponse errors in surveys. Journal of the American Medical Association 307:1805–6.

17.

Keeter

Miller

Kohut

Groves

R. M.

Presser

. 2000. Consequences of reducing nonresponse in a national telephone survey. Public Opinion Quarterly 64:125–48.

18.

Kessler

R. C.

Andrews

Colpe

L. J.

Hiripi

Mroczek

D. K.

Normand

S.-L.T.

Walters

E. E.

Zas

A. M.

. 2002. Short screening scales to monitor population prevalences and trends in nonspecific psychological distress. Psychological Medicine 32:959–76.

19.

Kim

H.-J.

Fredriksen-Goldsen

K. I.

. 2012. Hispanic lesbians and bisexual women at heightened risk for [corrected] health disparities. America Journal of Public Health 102:e9–15.

20.

Kreuter

Couper

M. P.

Lyberg

L. E.

. 2009. The use of paradata to monitor and manage survey data collection. In Proceedings of the Joint Statistical Meetings, Survey Research Methods Section, 282–96. Alexandria, VA: American Statistical Association.

21.

Kreuter

Olson

Wagner

Yan

Ezzati-Rice

T. M.

Casas-Cordero

Lemay

Peytchev

Groves

R. M.

Raghunathan

T. E.

. 2010. Using proxy measures and other correlates of survey outcomes to adjust for nonresponse: Examples from multiple surveys. Journal of the Royal Statistical Society: Series A (Statistics in Society) 173:389–407.

22.

Lee

Brown

E. R.

Grant

Belin

T. R.

Brick

J. M.

. 2009. Exploring nonresponse bias in a health survey using neighborhood characteristics. America Journal of Public Health 99:1811–17.

23.

Lin

I.-F.

Schaeffer

N. C.

. 1995. Using survey participants to estimate the impact of nonparticipation. Public Opinion Quarterly 59:236–58.

24.

Magnani

Sabin

Saidel

Heckathorn

D. D.

. 2005. Review of sampling hard-to-reach and hidden populations for HIV surveillance. AIDS 19:S67–72.

25.

Meyer

I. H.

Wilson

P. A.

. 2009. Sampling lesbian, gay, and bisexual populations. Journal of Counseling Psychology 56:23–31.

26.

National Health Interview Survey (NHIS). 2013. Public-use data file and documentation. https://www.cdc.gov/nchs/nhis/nhis_2013_data_release.htm (accessed March 1, 2016).

27.

National Health Interview Survey (NHIS). 2014. Public-use data file and documentation. https://www.cdc.gov/nchs/nhis/nhis_2014_data_release.htm (accessed March 1, 2016).

28.

National Center for Health Statistics. 2014. A brief quality assessment of the NHIS sexual orientation data. http://www.cdc.gov/nchs/data/nhis/qualityso2013508.pdf (accessed March 1, 2016).

29.

National Center for Health Statistics. 2015. Paradata file description, National Health Interview Survey, 2014. http://ftp://ftp.cdc.gov/pub/Health_Statistics/NCHS/Dataset_Documentation/NHIS/2014/srvydesc_paradata.pdf (accessed March 1, 2016).

30.

Pew Research Center. 2016. Changing attitudes on gay marriage. http://www.pewforum.org/2016/05/12/changing-attitudes-on-gay-marriage/ (accessed May 17, 2017).

31.

Peytchev

Peytcheva

Groves

R. M.

. 2010. Measurement error, unit nonresponse, and self-reports of abortion experiences. Public Opinion Quarterly 74:319–27.

32.

Raboud

D. S.

Burchell

A. N.

Gardner

Walmsley

Bayoumi

A. M.

Blitz

Cooper

Salit

Cohen

Rourke

S. B.

Loutfy

M. R.

. 2013. Representativeness of an HIV cohort of the sites from which it is recruiting: Results from the Ontario HIV Treatment Network (OHTN) cohort study. BMC Medical Research Methodology 13. http://bmcmedresmethodol.biomedcentral.com/articles/10.1186/1471-2288-13-31 (accessed January 5, 2017).

33.

Sell

R. L.

Holliday

M. L.

. 2014. Sexual orientation data collection policy in the United States: Public health malpractice. American Journal of Public Health 104:967–69.

34.

Tourangeau

2014. Defining hard-to-survey populations. In Hard-to-survey populations, eds. Tourangeau

Edwards

Johnson

T. P.

Wolter

K. M.

Bates

, 3–20. Cambridge: Cambridge University Press.

35.

U.S. Federal Committee on Statistical Methodology. 2001. Measuring and reporting sources of errors in surveys. Statistical Policy Working Paper 31, Office of Management and Budget, Washington, DC. https://s3.amazonaws.com/sitesusa/wp-content/uploads/sites/242/2014/04/spwp31.pdf (accessed January 26, 2018).

36.

Whitman

J. R. B.

Halbesleben

M. V.

. 2013. Evaluating survey quality in health services research: A decision framework for assessing nonresponse bias. Health Research and Educational Trust 48:913–30.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.15 MB

Are Sexual Minorities Less Likely to Participate in Surveys? An Examination of Proxy Nonresponse Measures and Associated Biases with Sexual Orientation in a Population-based Health Survey

Abstract

Get full access to this article

References

Supplementary Material