Although researchers are aware that nonresponse and response bias may compromise the accuracy of estimates from survey data, it is difficult to obtain estimates of these biases. In this article, we estimate nonresponse and response bias for a particular case—child support awards and payments. The sample of divorced resident and nonresident parents was drawn from Wisconsin court records and subsequently interviewed by telephone in 1987. The court records provide the criterion to use in estimating nonresponse and response bias. The analysis shows that those not interviewed are less likely to have awards or to pay support than participants, and the average award and average amount paid are lower for them than for survey participants. Both resident mothers and nonresident fathers overreport the amount of support owed and paid, but the bias is larger for fathers. Nonparticipation bias is greater for measures of paying support than for measures of owing support. Response bias contributes more to total nonsampling bias than does nonparticipation bias for reports of amounts of support owed and paid (including direct payments). Only for resident mothers' reports of the amount paid (omitting direct payments) is the total nonsampling bias less than 3 times the standard error.
Get full access to this article
View all access options for this article.
References
1.
Andersen, Ronald
, Judith Kasper, and Martin R. Frankel. 1979. “A Model of Survey Error.” Pp. 1-14 in Total Survey Error: Applications to Improve Health Surveys, edited by Ronald Andersen, Judith Kasper, Martin R. Frankel, and Associates. San Francisco: Jossey-Bass.
2.
Beller, Andrea H.
and John W. Graham. 1987. “The Effect of Child Support Enforcement on Child Support Payments.” Paper presented at the annual meetings of the American Sociological Association, Chicago. August.
3.
Belson, William A.
1986. Validity in Survey Research. Aldershot, England: Gower.
4.
Blair, Edward
, and Scot Burton. 1987. “Cognitive Processes Used by Survey Respondents to Answer Behavioral Frequency Questions.”Journal of Consumer Research14:280-288.
5.
Borus, Michael E.1966. “Response Error in Survey Reports of Earnings Information.”Journal of the American Statistical Association61:729-738.
6.
Bumpass, Larry
, Teresa Castro Martin, and James A. Sweet. 1991. “The Impact of Family Background and Early Marital Factors on Marital Disruption.”Journal of Family Issues12(1):22-42.
7.
Cannell, Charles F.
, Peter V. Miller, and Lois Oksenberg. 1981. “Research on Interviewing Techniques.” Pp. 389-437 in Sociological Methodology 1981, edited by Samuel Leinhardt. San Francisco: Jossey-Bass.
8.
Cassetty, Judith
. 1978. Child Support and Public Policy. Lexington, MA: Lexington Books.
9.
Castro Martin, Teresa
and Larry Bumpass. 1989. “Recent Trends in Marital Disruption.”Demography26:37-51.
10.
Cherlin, Andrew, J. Griffith
, and J. McCarthy. 1983. “A Note on Maritally-Disrupted Men's Reports on Child Support in the June 1980 Current Population Survey.”Demography20:385-389.
11.
Collins, Linda M.
, John W. Graham, William B. Hansen, and C. Anderson Johnson. 1985. “Agreement Between Retrospective Accounts of Substance Use and Earlier Reported Substance Use.”Applied Psychological Measurement9:301-309.
12.
Duncan, Greg J.
, and Daniel H. Hill. 1985. “An Investigation of the Extent and Consequences of Measurement Error in Labor-Economics Survey Data.”Journal of Labor Economics3:508-532.
13.
Duncan, Greg J.
, and Nancy A. Mathiowetz. 1985. A Validation Study of Economic Data. Ann Arbor: Institute for Social Research, University of Michigan.
14.
Fitzgerald, Robert
, and Linda Fuller. 1982. “I Hear You Knocking But You Can't Come In: The Effects of Reluctant Respondents and Refusers on Sample Survey Estimates.”Sociological Methods & Research11(1):3-32.
15.
Furstenberg, Frank
, Christine Winquist Nord, James L. Peterson, and Nicholas Zill. 1983. “The Life Course of Children of Divorce: Marital Disruption and Parental Contact.”American Sociological Review48:656-668.
16.
Garfinkel, Irwin
and Sara S. McLanahan. 1986. Single Mothers and Their Children: A New American Dilemma. Washington, DC: Urban Institute Press.
17.
Garfinkel, Irwin
and Donald Oellerich. 1989. “Noncustodial Fathers' Ability to Pay Child Support.”Demography26:219-234.
18.
Groves, Robert M.
1989. Survey Errors and Survey Costs. New York: Wiley.
19.
Groves, Robert M.
and Lou Magilavy. 1984. “An Experimental Measurement of Total Survey Error.”Proceedings of the Section on Survey Research Methods, pp. 698-703. Washington, DC: American Statistical Association.
20.
Hamilton, Lawrence C.1981. “Self-Reports of Academic Performance: Response Errors Are Not Well Behaved.”Sociological Methods & Research10:165-185.
21.
Isen, Alice M.
1984. “Toward Understanding the Role of Affect in Cognition.” Pp. 179-235 in Handbook of Social Cognition. Vol. 3, edited by R. Wyer and T. Srull. Hillsdale, NJ: Lawrence Erlbaum.
22.
Kish, Leslie
. 1965. Survey Sampling. New York: Wiley.
23.
Kish, Leslie
. 1987. Statistical Design for Research. New York: Wiley.
24.
Kish, Leslie
, and John B. Lansing. 1954. “Response Errors in Estimating the Value of Homes.”Journal of the American Statistical Association49:520-538.
25.
Lerman, Robert I. 1987. “Child Support and Dependency.” Report prepared for the Assistant Secretary for Policy and Evaluation, U.S. Department of Health and Human Services. Heller School, Brandeis University, Waltham, MA.
26.
Lin, I-Fen. 1990. “Using Respondents as Proxies to Estimate the Characteristics of Nonrespondents.” Master's Thesis, Department of Sociology, University of Wisconsin, Madison.
27.
Maccoby, Eleanor E.
, Charlene E. Depner, and Robert H. Mnookin. 1988. “Custody of Children Following Divorce.” Pp. 91-114 in Impact of Divorce, Single Parenting, and Stepparenting on Children, edited by E. Mavis Hetherington and Josephine D. Arasteh. Hillsdale, NJ: Lawrence Erlbaum.
28.
Mathiowetz, Nancy A.
, and Greg J. Duncan. 1988. “Out of Work, Out of Mind: Response Errors in Retrospective Reports of Unemployment.”Journal of Business and Economic Statistics6:221-229.
29.
McLanahan, Sara S.1985. “Family Structure and the Reproduction of Poverty.”American Journal of Sociology90:873-901.
30.
McLanahan, Sara S.
, and Larry Bumpass. 1988. “Intergenerational Consequences of Family Disruption.”American Journal of Sociology94:130-152.
31.
Miller, Peter V.
, and Robert M. Groves. 1985. “Matching Survey Responses to Official Records: An Exploration of Validity in Victimization Reporting.”Public Opinion Quarterly49:366-380.
32.
O'Neil, Michael J.1979. “Estimating the Nonresponse Bias Due to Refusals in Telephone Surveys.”Public Opinion Quarterly43:218-232.
33.
Parry, Hugh J.
, and Helen M. Crossley. 1950. “Validity of Responses to Survey Questions.”Public Opinion Quarterly14:61-80.
34.
Peterson, James L., and Christine Winquist Nord. 1987. “The Regular Receipt of Child Support: A Multi-Step Process.” Final report prepared for the Office of Child Support Enforcement, Child Trends, Inc., New York.
35.
Presser, Stanley
. 1984. “Is Inaccuracy on Factual Survey Items Item-Specific or Respondent-Specific?”Public Opinion Quarterly48:344-355.
36.
Ross, Michael
, and Michael Conway. 1986. “Remembering One's Own Past: The Construction of Personal Histories.” Pp. 122-143 in Handbook of Motivation and Cognition: Foundations of Social Behavior, edited by R. M. Sorrentino and E. T. Higgins. Chichester, England: Wiley.
37.
Schaeffer, Nora Cate
. Forthcoming. “Errors of Experience: Response Errors in Reports About Child Support and Their Implications for Questionnaire Design.” In Autobiographical Memory and the Validity of Retrospective Reports, edited by Norbert Schwarz and Seymour Sudman. New York: Springer-Verlag.
38.
Schaeffer, Nora Cate
, Judith A. Seltzer, and Marieka Klawitter. 1989. “Nonresponse and Response Bias in Reports of Child Support.” Center for Demography and Ecology, Working Paper No. 89-12. University of Wisconsin, Madison, Wisconsin.
39.
Seltzer, Judith A.1990. “Legal and Physical Custody Arrangements in Recent Divorces.”Social Science Quarterly71:250-266.
40.
Seltzer, Judith A.
and Irwin Garfinkel. 1990. “Inequality in Divorce Settlements: An Investigation of Property Settlements and Child Support Awards.”Social Science Research19:82-111.
41.
Smith, Tom W.1984. “Estimating Nonresponse Bias with Temporary Refusals.”Sociological Perspectives27:473-498.
42.
Sonenstein, Freya L., and Charles C. Calhoun. 1988. “Survey of Absent Parents: Pilot Results.” Report from the Urban Institute, Washington, DC, June.
43.
Stinchcombe, Arthur L.
, Calvin Jones, and Paul V. Sheatsley. 1981. “Nonresponse Bias for Attitude Questions.”Public Opinion Quarterly45:359-376.
44.
Sudman, Seymour
and Norman M. Bradburn. 1974. Response Effects in Surveys. Chicago: Aldine.
45.
Sweet, James
, Larry Bumpass, and Vaughn Call. 1988. “The Design and Content of the National Survey of Families and Households.” National Survey of Families and Households Working Paper No. 1. Center for Demography and Ecology, University of Wisconsin, Madison.
46.
U.S. Bureau of the Census
. 1987. Child Support and Alimony: 1985. Current Population Reports, Series P-23, No. 152. Washington, DC: U.S. Government Printing Office.
47.
U.S. Bureau of the Census
. 1988. Who's Helping Out? Support Networks Among American Families. Current Population Reports, Series P-70, No. 13, Washington, DC: U.S. Government Printing Office.
48.
U.S. Bureau of the Census
. 1989. Marital Status and Living Arrangements: March 1988. Current Population Reports, Series P-20, No. 433. Washington, DC: U.S. Government Printing Office.
49.
Wyner, Gordon A.1980. “Response Errors in Self-Reported Number of Arrests.”Sociological Methods & Research9:161-177.
