Complex Sampling Designs and Statistical Issues in Secondary Analysis

Abstract

Conducting secondary analysis using large national survey data sets to answer pressing research questions is gaining acceptance in the nursing science community. There are, however, challenges confronted by researchers who wish to apply secondary analysis to large data sets due to the incorporation of complex sampling designs. This article presents sampling design issues inherent in many large national surveys and explains the rationale for applying sample and variance estimation weights when conducting statistical analyses. In addition, the rationale for using statistical software packages capable of analyzing data derived from complex sampling designs is described. Examples of differences in statistical outcomes with and without weights using Stata and SPSS are provided using data from the Medical Expenditure Panel Survey (MEPS). Based on the example analyses, the implications of the statistical outcome differences for study findings are discussed.

Get full access to this article

View all access options for this article.

References

Carlson, B. L. , Johnson, A. E. , & Cohen, S. B. (1993). An evaluation of the use of personal computers for variance estimation with complex survey data. Journal of Official Statistics, 9(4), 795-814.

Cohen, S. (1996). Sample design of the 1996 Medical Expenditure Panel Survey Household Component (Pub. No. 97-0027). Rockville, MD: Agency for Health Care Policy and Research.

Cohen, S. B. (1997). An evaluation of alternative PC-based software packages developed for the analysis of complex survey data. The American Statistician, 51(3), 285-292.

Cohen, S. , Burt, V. , & Jones, G. (1986). Efficiencies for variance estimation for complex survey data. The American Statistician, 40, 157-164.

Flyer, P. (1987). Finite population correction for replication estimates of variance. Proceedings of the Section on Survey Research Methods of the American Statistical Association, 732-736.

Flyer, P. , Morganstein, D. , & Rust, K. (1989). Complex survey variance estimation and contingency tables analysis using replication. Proceedings of the Section on Survey Research Methods of the American Statistical Association, 110-119.

Jacobson, A. F. , Hamilton, P. , & Galloway, J. (1993). Obtaining and evaluating data sets for secondary analysis in nursing research. Western Journal of Nursing Research, 15(4), 483-494.

Judkins, D. , & Wright, D. (1990). National Health Interview Survey: Report on variance estimation. Rockville, MD: Westat.

Korn, E. L. , & Graubard, B. I. (1999). Analysis of Health Surveys. New York: John Wiley & Sons.

10.

Krauss, N. (1999, November). Understanding and using the Medical Expenditure Panel Survey. Continuing Education Institute course presented at the meeting of the American Public Health Association, Chicago.

11.

McArt, E. W. , & McDougal, L. W. (1985). Secondary data analysis—a new approach to nursing research. Image: The Journal of Nursing Scholarship, 17(2), 54-57.

12.

McCall, R. B. , & Appelbaum, M. I. (1991). Some issues ofconducting secondary analyses. Developmental Psychology, 27(6), 911-917.

13.

Moriarty, H. J. , Deatrick, J. A. , Mahon, M. M. , Feetham, S. L. , Carroll, R. M. , Shepard, M. P. , Orsi, A. J. (1999). Issues to consider when choosing and using large national databases for research of families. Western Journal of Nursing Research, 21(2), 143-153.

14.

Orsi, A. J. , Grey, M. , Mahon, M. M. , Moriarty, H. J. , Shepard, M. P. , & Carroll, R. M. (1999). Conceptual and technical considerations when combining large data sets. Western Journal of Nursing Research, 21(2), 130-142.

15.

Wolter, K. (1985). Introduction to Variance Estimation. New York: Springer-Verlag.