Establishing an Open Probability-Based Mixed-Mode Panel of the General Population in Germany

Abstract

Various open probability-based panel infrastructures have been established in recent years, allowing researchers to collect high-quality survey data. In this report, we describe the processes and deliverables of setting up the GESIS Panel, the first probability-based mixed-mode panel infrastructure in Germany open for data collection to the academic research community. The reference population for the GESIS Panel is the German-speaking population aged between 18 and 70 years permanently residing in Germany. In 2013, approximately 5,000 panelists had been recruited from a random sample drawn from municipal population registers. We describe the outcomes of the sampling strategy and the multistep recruitment process, involving computer-aided personal interviews conducted at respondents’ homes. Next, we describe the outcomes of the two self-administered survey modes (online and paper-and-pencil) of the GESIS Panel used for the initial profile survey and all subsequent bimonthly data collection waves. Across all stages of setting up the GESIS Panel, we report sample composition discrepancies for key demographic variables between the GESIS Panel and established benchmark surveys. Overall, the findings highlight the usefulness of pursuing a mixed-mode strategy when building a probability-based panel infrastructure in Germany.

Keywords

mixed-mode panel panel recruitment probability-based surveys

Get full access to this article

View all access options for this article.

References

Blohm

Koch

(2015). Führt eine höhere Ausschöpfung zu anderen Umfrageergebnissen? Eine experimentelle Studie zum ALLBUS 2008. In Schupp

Wolf

C. W.

(Eds.), Nonresponse Bias, Schriftenreihe der ASI – Arbeitsgemeinschaft Sozialwissenschaftlicher Institute. Wiesbaden, Germany: Springer Fachmedien. doi:10.1007/978-3-658-10459-7_3

Blom

A. G.

Bosnjak

Cornilleau

Cousteaux

A.-S.

Das

Douhou

Krieger

(2016). A comparison of four probability-based online and mixed-mode panels in Europe. Social Science Computer Review, 34, 8–25.

Blom

A. G.

Gathmann

Krieger

(2015). Setting up an online panel representative of the general population the German internet panel. Field Methods, 27, 391–408.doi:10.1177/1525822X15574494

Blumenstiel

J. E.

Gummer

(2015). Prävention, Korrektur oder beides? Drei Wege zur Reduzierung von Nonresponse Bias mit Propensity Scores [Prevention, correction, or both? Three approaches to reduce nonresponse using propensity scores]. In Schupp

Wolf

(Eds.), Nonresponse bias: Qualitätssicherung sozialwissenschaftlicher Umfragen [Nonresponse bias: Quality assurance in social science surveys] (pp. 13–44). Wiesbaden, Germany: Springer VS.

Bosnjak

Das

Lynn

(2016). Methods for probability-based online and mixed-mode panels: Selected recent trends and future perspectives. Social Science Computer Review, 34, 3–7.

Callegaro

DiSogra

(2008). Computing response metrics for online panels. Public Opinion Quarterly, 72, 1008–1032. doi:10.1093/poq/nfn065

Chang

Krosnick

J. A.

(2009). National surveys via RDD telephone interviewing versus the internet comparing sample representativeness and response quality. Public Opinion Quarterly, 73, 641–678.

Cochran

W. G.

(1977). Sampling techniques (3rd ed.). New York, NY: John Wiley.

Das

(2012). Innovation in online data collection for scientific research: The Dutch MESS project. Methodological Innovations Online, 7, 7–24.

10.

Das

Kapteyn

Bosnjak

(2017). Open probability-based panel infrastructures. In Vannette

D. L.

Krosnick

J. A.

(Eds.), The future of survey research: Challenges and opportunities (pp. 199–209). New York, NY: Palgrave MacMillan.

11.

De Leeuw

(2005). To mix or not to mix data collection modes in surveys. Journal of Official Statistics, 21, 233–255.

12.

DiSogra

Callegaro

(2016). Metrics and design tool for building and evaluating probability-based online panels. Social Science Computer Review, 34, 26–40. doi:10.1177/0894439315573925

13.

Duncan

O. D.

Duncan

(1955). A methodological analysis of segregation indexes. American Sociological Review, 20, 210–217.

14.

Hays

R. D.

Liu

Kapteyn

(2015). Use of Internet panels to conduct surveys. Behavior Research Methods, 47, 685–690.

15.

Koch

Halbherr

Stoop

I. A. L.

Kappelhof

J. W. S.

(2014). Assessing ESS sample quality by using external and internal criteria. Mannheim, Germany: European Social Survey, GESIS.

16.

Knudsen

D. C.

Fotheringham

A. S.

(1986). Matrix comparison, goodness-of-fit, and spatial interaction modeling. International Regional Science Review, 10, 127–147.

17.

Lipps

Pekari

Roberts

(2015). Undercoverage and nonresponse in a list-sampled telephone election survey. Survey Research Methods, 9, 71–82.

18.

Lohr

S. L.

(2010). Sampling: Design and analysis (2nd ed.). Boston, MA: Cengage Learning.

19.

Revilla

Cornilleau

Cousteaux

Legleye

de Pedraza

(2015). What is the gain in a probability-based online panel of providing internet access to sampling units who previously had no access? Social Science Computer Review, 1–18. doi:10.1177/0894439315590206

20.

Saris

W. E.

(1998). Ten years of interviewing without interviewers: The telepanel. In Couper

M. P.

Baker

R. P.

Bethlehem

Clark

C. Z. F.

Martin

Nicholls

W. L.

II O’Reilly

J. M.

(Eds.), Computer assisted survey information collection (pp. 409–429). New York: Wiley.

21.

Schaurer

Struminskaya

Enderle

(2014). GESIS Panel Technical Report Welcome Survey (Wave a12). Mannheim, Germany: GESIS—Leibniz Institute for the Social Sciences.

22.

Scherpenzeel

Das

(2011). True longitudinal and probability-based internet panels: Evidence from the Netherlands. In Das

Ester

Kaczmirek

(Eds.), Social and behavioral research and the internet: Advances in applied methods and research strategies (pp. 77–104). New York, NY: Taylor & Francis.

23.

Scherpenzeel

A. C.

Toepoel

(2012). Recruiting a probability sample for an online panel: Effects of contact mode, incentives, and information. Public Opinion Quarterly, 76, 470–490.

24.

Shao

(1995). The jackknife and bootstrap. New York, NY: Springer-Verlag.

25.

Sitter

R. R.

(1992). A resampling procedure for complex survey data. Journal of the American Statistical Association, 91, 1278–1288.

26.

Steinacker

Schmidt

(2014). Rekrutierung der ersten Kohorte des GESIS Panels: Feldbericht zur Erhebung 2013 [Recruitment of the first cohort of the GESIS Panel: Field report for 2013 survey]. Munich, Germany: TNS Infratest.