In the Mode. . .Text-to-Web Survey Data Collection: An Exploratory Study in Preelection Polling of the U.S. Presidential Election

Abstract

As our society rapidly employs new forms of communication, new modes of data collection are challenging the best practices developed over years of polling. Preelection polling must simultaneously evolve, as new modes have emerged in the past few decades, including computer-mediated communication, mobile texting, and the use of touch tone keypads to communicate information. A tension exists between traditional and novel means of interpersonal communication, and researchers are struggling to determine which traditional methods of data collection still have a place in the modern industry. This study examined three relatively new modes of preelection poll data collection, online, mobile, and IVR (interactive voice recognition) to determine what relationships exist, if any, between the mode of data collection and the composition of a sample across eight demographic variables: age, education, gender, political affiliation, race, region, 2016 Vote History, and 2020 Vote Intention. Twenty-six preelection polls were used in the study, with each poll ranging in collection dates between August 30 and October 31, 2020. The total combined sample size for this study is n = 19,886; 49% were IVR respondents (n = 9,795), 25% was collected from online panels (n = 5,039), and 25% was collected from short message service (SMS)-to-web respondents (n = 5,052). A χ² (chi-square) test for association was conducted using a significance level of p < .05 and a 95% confidence interval (CI) and found a significant difference between each mode of data collection across the eight aforementioned variables. A significant difference between political party affiliation/registration and mode of data collection was attributed to the educational attainment of individuals participating in each preelection polls based on the mode of data collection. This study suggests that underlying variables within the sample composition of different modes of data collection can have an impact on the accuracy of preelection polls.

Keywords

SMS-to-web survey research 2020 election sample design preelection polling

Get full access to this article

View all access options for this article.

References

Aristotle International. (2021), Aristotle VoterListsOnline (VLO). Retrieved July 29, 2021, from https://www.aristotle.com/

Cassino

(2016, August 1). How today’s political polling works. Harvard Business Review. https://hbr.org/2016/08/how-todays-political-polling-works

Collins

(2019, May 16–19). Evaluating text message surveys for pre-election polling [Conference Presentation]. AAPOR 2019 Convention, Toronto, Canada. https://www.aapor.org/AAPOR_Main/media/MainSiteFiles/AAPOR-19-Web-Version-Update-5-8-19.pdf

Conrad

F. G.

Hupp

Schober

(2020, June 10). Text messaging for conducting survey interviews [Conference Presentation]. AAPOR 2020 Virtual Conference Short Course, Online.

Consumer and Governmental Affairs Bureau Seeks Comment on Interpretation of the Telephone Consumer Protection Act in Light of the D.C. Circuit’s ACA International Decision (2018, June 6). Federal Register.

Gallup

(1953). The future direction of election polling. Public Opinion Quarterly, 17(2). https://doi.org/10.1086/266454

Harris

Hillebrand

Holley

Trosby

(2010). Short Message Service (SMS): The creation of personal global text messaging. Wiley. https://doi-org.proxy.emerson.edu/10.1002/9780470689899

Kimball

(2019). Survey data collection; online panel efficacy. A comparative study of amazon MTurk and research now SSI/Survey Monkey/Opinion access. Journal of Business Diversity, 19(2), 16–45.

Kimball

(2019, May 16–19). Mixed mode pre-election polling; comparing online panels and IVR samples in 2018 midterm elections. [Conference Presentation]. AAPOR 2019 Convention, Toronto, Ontario, Canada. https://www.aapor.org/AAPOR_Main/media/MainSiteFiles/AAPOR-19-Web-Version-Update-5-8-19.pdf

10.

Lamm

(2015, August 5). Gallup settles TCPA Lawsuit. LinkedIn. https://www.linkedin.com/pulse/gallup-settles-tcpa-lawsuit-michael-lamm/

11.

Montellaro

(2019, May 21). What replaces telephone polls. POLITICO. https://www.politico.com/newsletters/morning-score/2019/05/21/what-replaces-telephone-polls-627447

12.

Rules and Regulations Implementing the Telephone Consumer Protection Act of 1991, 18 FCC Rcd 14014 (2003).

13.

Rules and Regulations Implementing the Telephone Consumer Protection Act of 1991, CG Docket No. 02-278 (2012).

14.

Steiger

D. M.

Tourangeau

Wilson

(2002). Self-administered questions by telephone: Evaluating interactive voice response. The Public Opinion Quarterly, 66(2), 265–278.

15.

Telephone Consumer Protection Act, 47 U.S.C. § 227. (1991).

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.19 MB