Population-based surveys are of limited utility to estimate rare or low-incidence groups, particularly for those defined by religion or ethnicity not included in the U.S. Census. Methods of cross-survey analysis and small area estimation, however, can be used to provide reliable estimates of such low-incidence groups. To illustrate these methods, data from 50 national surveys are combined to examine the Jewish population in the United States. Hierarchical models are used to examine clustering of respondents within surveys and geographic regions. Bayesian analyses with Monte Carlo simulations are used to obtain pooled, state-level estimates poststratified by sex, race, education, and age to obtain certainty intervals about the estimates. This cross-survey approach provides a useful and practical analytic framework that can be generalized both to more extensive study of religion in the United States and to other social science problems in which single data sources are insufficient for reliable statistical inference.
Arrow, Kenneth, Samuel Bowles , and Steven Durlauf, eds. 2000. Meritocracy and Economic Inequality. Princeton, NJ: Princeton University Press .
2.
Bates, Douglas.2005. ‘‘Fitting Linear Mixed Models in R.’’R News: The Newsletter of the R Project5:27-30.
3.
Brick, J. Michael and Clyde Tucker.2007. ‘‘Mitofsky-Waksberg: Learning From the Past.’’Public Opinion Quarterly71:703-16.
4.
Gelman, Andrew.2007. ‘‘Struggles with Survey Weighting and Regression Modeling.’’Statistical Science22:153-64.
5.
Gelman, Andrew.2008. Red State, Blue State, Rich State, Poor State: Why Americans Vote the Way They Do. Princeton, NJ: Princeton University Press.
6.
Ghosh, Malay, Kannan Natarajan, T.W.F. Stroud, and Bradley P. Carlin .1998. ‘‘Generalized Linear Models for Small-Area Estimation.’’Journal of the American Statistical Association93:273-82.
7.
Groeneman, Sid and Gary Tobin.2004. ‘‘The Decline of Religious Identity in the United States.’’San Francisco, CA: Institute for Jewish and Community Research.
8.
Groves, Robert M., F.J. Fowler, Mick P. Couper, James M. Lepkowski, Eleanor Singer, and R. Tourangeau.2004. Survey Methodology. New York: Wiley.
9.
Hedges, L.V. and Ingram Olkin ( 1985). Statistical Methods for Meta-Analysis. New York, NY: Academic Press, Inc.
10.
Hox, Joop J.2002. Multilevel Analysis: Techniques and Applications . Mahwah, NJ: Lawrence Erlbaum .
11.
Jorm, A.F. and D. Jolley.1998. ‘‘The Incidence of Dementia: A Meta-Analysis .’’ Neurology51:728-33.
12.
Jorm, A.F., A.E. Korten, and A.S. Henderson.1987. ‘‘The Prevalence of Dementia: A Quantitative Integration of the Literature.’’ Acta Psychiatrica Scandinavica76:465-79.
13.
Kadushin, Charles, Peter D. Killworth, H. Russell Bernard, and Andrew A. Beveridge .2006. ‘‘Scale-up Methods as Applied to Estimates of Heroin Use.’’Journal of Drug Issues36:417-40.
14.
Kadushin, Charles, Benjamin Phillips, and Leonard Saxe.2005. ‘‘National Jewish Population Survey 2000-01: A Guide for the Perplexed.’’ Contemporary Jewry25:1-32.
15.
Keeter, Scott, Courtney Kennedy, Michael Dimock, Jonathan Best, and Peyton Craighill .2006. ‘‘Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey.’’Public Opinion Quarterly70:759-79.
16.
Kosmin, Barry A., Egon Mayer, and Ariela Keysar.2001. ‘‘American Religious Identification Survey.’’New York: Graduate Center of the City University of New York.
17.
Kotler-Berkowitz, Laurence, Steven M. Cohen, Jonathon Ament, Vivian Klaff, Frank Mott, and Danyelle Peckerman-Neuman .2004. ‘‘The National Jewish Population Survey 2000-01: Strength, Challenge and Diversity in the American Jewish Population.’’ Rev. ed. New York: United Jewish Communities.
18.
Larsen, Klaus, Jorgen Holm Petersen, Esben Budtz-Jorgensen, and Lars Endahl.2000. ‘‘Interpreting Parameters in the Logistic Regression Model With Random Effects.’’ Biometrics56:909-14.
19.
Lohr, Sharon L. and N. G. Narasimha Prasad.2003. ‘‘Small Area Estimation With Auxiliary Survey Data.’’Canadian Journal of Statistics31:383-96.
20.
Malec, Donald, J. Sedransk, Christopher L. Moriarity, and Felicia B. LeClere .1997. ‘‘Small Area Inference for Binary Variables in the National Health Interview Survey.’’Journal of the American Statistical Association92:815-26.
21.
Massey, James T., Dan O’Connor, and Karol Krotski.1998. ‘‘Response Rates in Random Digit Dialing (RDD) Telephone Surveys.’’ Pp. 707-12 in 1997 Proceedings of the Survey Research Methods Section, American Statistical Association . Arlington, VA: American Statistical Association.
22.
Mattis, Jacqueline S.2001. ‘‘Religion and African American Political Life.’’Political Psychology22:263-78.
23.
O’Hara, Brett, Joana Turner, Mark Bauder, Steven Riesz, and David Waddington .2006. ‘‘Initial Assessment of Small Area Estimation of the Number of Eligible Women for the CDC’s NBCCEDP.’’Atlanta, GA: Centers for Disease Control and Prevention.
24.
O’Neil, Michael J.1979. ‘‘Estimating the Nonresponse Bias Due to Refusals in Telephone Surveys.’’Public Opinion Quarterly43:218-32.
25.
Olson, Daniel V. A. and Jackson W. Carroll.1992. ‘‘Religiously Based Politics: Religious Elites and the Public.’’Social Forces70:765-86.
26.
Park, David K., Andrew Gelman, and Joseph Bafumi.2004. ‘‘Bayesian Multilevel Estimation with Poststratification: State-Level Estimates from National Polls.’’Political Analysis12:375-85.
27.
Park, David K., Andrew Gelman, and Noah Kaplan.2006. ‘‘R2WinBUGS: Running WinBUGS From R.’’Political Methodologist14:5-10.
28.
Pew Research Center. 2007. ‘‘Muslim Americans: Middle-class and Mostly Mainstream.’’Washington, DC: Pew Research Center. Retrieved August 29, 2008 (http://pewresearch.org/assets/pdf/muslim-americans.pdf).
29.
Pew Research Center.2008. ‘‘U.S. Religious Landscape Survey.’’Washington, DC : Pew Research Center. Retrieved August 29, 2008 (http://religions.pewforum.org/pdf/report2-religious-landscape-study-full.pdf ).
30.
Pfeffermann, Danny.2002. ‘‘Small Area Estimation: New Developments and Directions.’’ International Statistical Review70:125-43.
31.
Phillips, Benjamin.2006. ‘‘Numbering the Jews: Evaluating and Improving American Jewish Population Studies.’’ PhD dissertation , Department of Sociology, Brandeis University, Waltham, MA.
32.
Public Law 94-521, HR 11337, 90 Stat 2459 (1976).
33.
Rao, J.N.K. and Mingyu Yu.1994. ‘‘Small-Area Estimation by Combining Time-Series and Cross-Sectional Data.’’Canadian Journal of Statistics22:511-28.
34.
Sheerkat, Darren E. and Christopher G. Ellison.1999. ‘‘Recent Developments and Current Controversies in the Sociology of Religion.’’Annual Review of Sociology25:363-94.
35.
Shriver, Peggy L.1985. ‘‘Religion’s Very Public Presence.’’Annals of the American Academy of Political and Social Science480:142-53.
36.
Smith, Tom W.1994. Trends in Non-Response Rates. Chicago, IL: National Opinion Research Center.
37.
Smith, Tom W.2002. ‘‘Religious Diversity in America: The Emergence of Muslims, Buddhists, Hindus, and Others.’’Journal for the Scientific Study of Religion41:577-85.
38.
Smith, Tom W.2005. Jewish Distinctiveness in America. New York: The American Jewish Committee.
39.
Stevens-Arroyo, Anthony M.1998. ‘‘The Latino Religious Resurgence.’’Annals of the American Academy of Political and Social Science558:163-77.
40.
U.S. Census Bureau.2010. Statistical Abstract of the United States: 2010. 129th ed. Washington, DC: U.S. Census Bureau. (http://www.census.gov/compendia/statab/2010/tables/10s0075.pdf ), accessed April 6, 2010.
41.
U.S. General Accounting Office.1998. Alzheimer’s Disease: Estimates of Prevalence in the United States. Washington, DC: U.S. General Accounting Office.
42.
Wuthnow, Robert.1999. Arts and Religion Survey. Princeton, NJ: Gallup Organization.
43.
Zheng, Tian, Matthew J. Salganik, and Andrew Gelman.2006. ‘‘How Many People Do You Know in Prison? Using Overdispersion in Count Data to Estimate Social Structure in Networks.’’Journal of the American Statistical Association101:409-23.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
