In studies of educational achievement, students’ self-reported number of books in the family home is a frequently used proxy for social, cultural, and economic background. Absent hard evidence about what this variable captures or how well, its use has been motivated by strong associations with student outcomes. I show that these associations rest on two types of endogeneity: Low achievers accrue fewer books and are also prone to underestimate their number. The conclusion is substantiated both by comparing reports by students and their parents and by the fact that girls report on average higher numbers despite being similar to boys on other measures of social background. The endogenous bias is large enough to overturn classical attenuation bias; it distorts cross-country patterns and invalidates many common study designs. These findings serve as a caution against overreliance on standard regression assumptions and contribute to ongoing debates about the empirical robustness of social science.
AmmermuellerAndreasPischkeJörn-Steffen. 2009. “Peer Effects in European Primary Schools: Evidence from the Progress in International Reading Literacy Study.” Journal of Labor Economics27:315–48.
2.
AndersenAnetteKrølnerRikkeCurrieCandaceDallagoLorenzaDuePernilleRichterMatthiasÖrkényiAgotaHolsteinBjørn Evald. 2008. “High Agreement on Family Affluence between Children’s and Parents’ Reports.” Journal of Epidemiology and Community Health62:1092–94.
3.
BernardiFabrizioChakhaiaLelaLeopoldLiliya. 2017. “Sing Me a Song with Social Significance: The (Mis)Use of Statistical Significance Testing in European Sociological Research.” European Sociological Review33:1–15.
4.
BettsJulian R.2011. “The Economics of Tracking in Education.” Pp. 341–81 in Handbook of the Economics of Education, Vol. 3, edited byHanushekE. A.MachinS.WoessmannL.. Amsterdam, the Netherlands: North-Holland.
5.
BlackDanSandersSethTaylorLowell. 2003. “Measurement of Higher Education in the Census and Current Population Survey.” Journal of the American Statistical Association98:545–54.
6.
BohrnstedtGeorge W.2010. “Measurement Models for Survey Research.” Pp. 347–404 in Handbook of Survey Research, 2nd ed., edited by RossiP. H.WrightJ. D.AndersonA. B.. Academic Press, Bingley, UK: Emerald.
7.
BollenKenneth A.BiemerPaul P.KarrAlan F.TuellerStephenBerzofskyMarcus E.. 2016. “Are Survey Weights Needed? A Review of Diagnostic Tests in Regression Analysis.” Annual Review of Statistics and Its Application3:375–92.
8.
BreenRichardJonssonJan O.. 2005. “Inequality of Opportunity in Comparative Perspective: Recent Research on Educational Attainment and Social Mobility.” Annual Review of Sociology31:223–43.
9.
BreseFalkMirazchiyskiPlamen. 2013. Measuring Students’ Family Background in Large-scale International Education Studies. Hamburg, Germany: IEA-ETS Research Institute.
10.
BrunelloGiorgioChecchiDaniele. 2007. “Does School Tracking Affect Equality of Opportunity? New International Evidence.” Economic Policy22:782–861.
11.
BrunelloGiorgioWeberGuglielmoWeissChristoph T.. 2017. “Books Are Forever: Early Life Conditions, Education and Lifetime Earnings in Europe.” Economic Journal127:271–96.
12.
BuchmannClaudiaDiPreteThomas A.McDanielAnne. 2008. “Gender Inequalities in Education.” Annual Review of Sociology34:319–37.
13.
CaroDaniel H.LenkeitJenny. 2012. “An Analytical Approach to Study Educational Inequalities: 10 Hypothesis Tests in PIRLS 2006.” International Journal of Research & Method in Education35:3–30.
14.
ChecchiDanieleWerfhorstHerman G. van de. 2017. “Policies, Skills and Earnings: How Educational Inequality Affects Earnings Inequality.” Socio-Economic Review16:137–60.
15.
ChiuMing Ming. 2007. “Families, Economies, Cultures, and Science Achievement in 41 Countries: Country-, School-, and Student-level Analyses.” Journal of Family Psychology21:510–19.
16.
ChiuMing Ming. 2010. “Effects of Inequality, Family and School on Mathematics Achievement: Country and Student Differences.” Social Forces88:1645–76.
17.
ChudgarAmitaLuscheiThomas F.. 2009. “National Income, Income Inequality, and the Importance of Schools: A Hierarchical Cross-national Comparison.” American Educational Research Journal46:626–58.
18.
CohenRoberta S.OrumAnthony M.. 1972. “Parent-child Consensus on Socioeconomic Data Obtained from Sample Surveys.” Public Opinion Quarterly36:95–98.
19.
CookJohn R.StefanskiLeonard A.. 1994. “Simulation-extrapolation Estimation in Parametric Measurement Error Models.” Journal of the American Statistical Association89:1314–28.
20.
EngzellPerJonssonJan O.. 2015. “Estimating Social and Ethnic Inequality in School Surveys: Biases from Child Misreporting and Parent Nonresponse.” European Sociological Review31:312–25.
21.
EnsmingerMargaret E.ForrestChristopher B.RileyAnne W.KangMyungsaGreenBert F.StarfieldBarbaraRyanSheryl A.. 2000. “The Validity of Measures of Socioeconomic Status of Adolescents.” Journal of Adolescent Research15:392–419.
22.
EppleDennisRomanoRichard. 2011. “Peer Effects in Education: A Survey of the Theory and Evidence.” Pp. 1053–163 in Handbook of Social Economics, Vol. 1, edited byBenhabibJ.BisinA.JacksonM. O.. Amsterdam, the Netherlands: North-Holland.
23.
Esping-AndersenGøsta. 2009. The Incomplete Revolution. Cambridge, MA: Polity.
24.
EvansM. D. R.KelleyJonathanSikoraJoanna. 2014. “Scholarly Culture and Academic Performance in 42 Nations.” Social Forces92:1573–605.
25.
EvansM. D. R.KelleyJonathanSikoraJoannaTreimanDonald J.. 2010. “Family Scholarly Culture and Educational Success: Books and Schooling in 27 Nations.” Research in Social Stratification and Mobility28:171–97.
26.
EvansM. D. R.KelleyJonathanSikoraJoannaTreimanDonald J.. 2015. “Scholarly Culture and Occupational Success in 31 Societies.” Comparative Sociology14:176–218.
27.
FerreiraFrancisco H. G.GignouxJérémie. 2014. “The Measurement of Educational Inequality: Achievement and Opportunity.” World Bank Economic Review28:210–46.
28.
FrancoAnnieMalhotraNeilSimonovitsGabor. 2014. “Publication Bias in the Social Sciences: Unlocking the File Drawer.” Science345:1502–05.
29.
FreemanRichard B.ViarengoMartina. 2014. “School and Family Effects on Educational Outcomes Across Countries.” Economic Policy29:395–446.
30.
FreeseJeremyPetersonDavid. 2017. “Replication in Social Science.” Annual Review of Sociology43:147–65.
31.
GelmanAndrewLokenEric. 2014. “The Statistical Crisis in Science: Data-dependent Analysis—A ‘Garden of Forking Paths’—Explains Why Many Statistically Significant Comparisons Don’t Hold Up.” American Scientist102:460–65.
32.
HanushekEric A.WoessmannLudger. 2011. “The Economics of International Differences in Educational Achievement.” Pp. 89–200 in Handbook of the Economics of Education, Vol. 3, edited byHanushekE. A.MachinS.WoessmannL.. Amsterdam, the Netherlands: North-Holland.
33.
HolleyCharles E.1916. The Relationship Between Persistence in School and Home Conditions. Chicago, IL: University of Chicago Press.
34.
IoannidisJohn. 2012. “Why Science Is Not Necessarily Self-correcting.” Perspectives on Psychological Science7:645–54.
35.
JerrimJohnMicklewrightJohn. 2014. “Socio-economic Gradients in Children’s Cognitive Skills: Are Cross-country Comparisons Robust to Who Reports Family Background?” European Sociological Review30:766–81.
36.
KaneThomas J.RouseCecilia ElenaStaigerDouglas. 1999. “Estimating Returns to Schooling When Schooling Is Misreported.” Working Paper no. 7235, National Bureau of Economic Research, Cambridge: Massachusetts.
37.
KerckhoffAlan C.MasonWilliam M.PossSharon S.. 1973. “On the Accuracy of Children’s Reports of Family Social Status.” Sociology of Education46:219–47.
38.
KreuterFraukeEckmanStephanieMaazKaiWatermannRainer. 2010. “Children’s Reports of Parents’ Education Level: Does It Matter Whom You Ask and What You Ask About?” Survey Research Methods4:127–38.
39.
KüchenhoffHelmutMwaliliSamuel M.LesaffreEmmanuel. 2006. “A General Method for Dealing with Misclassification in Regression: The Misclassification SIMEX.” Biometrics62:85–96.
40.
LandisJ. RichardKochGary G.. 1977. “The Measurement of Observer Agreement for Categorical Data.” Biometrics33:159–74.
41.
LookerE. Dianne. 1989. “Accuracy of Proxy Reports of Parental Status Characteristics.” Sociology of Education62:257–76.
42.
MarksGary N.2005. “Cross-national Differences and Accounting for Social Class Inequalities in Education.” International Sociology20:483–505.
43.
MarksGary N.CresswellJohnAinleyJohn. 2006. “Explaining Socioeconomic Inequalities in Student Achievement: The Role of Home and School Factors.” Educational Research and Evaluation12:105–28.
44.
MartinsLurdesVeigaPaula. 2010. “Do Inequalities in Parents’ Education Play an Important Role in PISA Students Mathematics Achievement Test Score Disparities?” Economics of Education Review29:1016–33.
45.
MicklewrightJohnSchnepfSylke V.. 2010. “How Reliable Are Income Data Collected with a Single Question?” Journal of the Royal Statistical Society, Series A173:409–29.
46.
MullisIna V. S.MartinMichael O.FoyPierreDruckerKathleen T.. 2012. PIRLS 2011 International Results in Reading. Amsterdam, the Netherlands: IEA.
47.
MullisIna V. S.MartinMichael O.KennedyAnn M.TrongKathleen L.SainsburyMarian. 2009. PIRLS 2011 Assessment Framework. Amsterdam, the Netherlands: IEA.
48.
MuñozJohnYoungCristobal. 2018. “We Ran 9 Billion Regressions: Eliminating False Positives through Computational Model Robustness.” Sociological Methodology, early access. 48:1–33. doi:10.1177/0081175018777988.
49.
Open Science Collaboration. 2015. “Estimating the Reproducibility of Psychological Science.” Science349:aac4716.
50.
ParkHyunjoon. 2008. “Home Literacy Environments and Children’s Reading Performance: A Comparative Study of 25 Countries.” Educational Research and Evaluation14:489–505.
51.
RosenbaumPaul R.RubinDonald B.. 1983. “Assessing Sensitivity to an Unobserved Binary Covariate in an Observational Study with Binary Outcome.” Journal of the Royal Statistical Society, Series B45:212–18.
52.
RutkowskiLeslieRutkowskiDavid. 2010. “Getting It Better: The Importance of Improving Background Questionnaires in International Large-scale Assessments.” Journal of Curriculum Studies42:411–30.
53.
Salvi del PeroAngelicaBytchkovaAlexandra. 2013. “A Bird’s Eye View of Gender Differences in Education in OECD Countries.” OECD Social, Employment and Migration Working Papers, No. 149, OECD Publishing, Paris. doi:10.1787/5k40k706tmtb-en.
54.
SaylorRyan. 2013. “Concepts, Measures, and Measuring Well: An Alternative Outlook.” Sociological Methods & Research42:354–91.
55.
SchützGabrielaUrsprungHeinrich W.WoessmannLudger. 2008. “Education Policy and Equality of Opportunity.” Kyklos61:279–308.
56.
SilberzahnRaphaelUhlmannEric L.MartinDaniel P.AnselmiPasqualeAustFrederikAwtreyEli C.BahníkŠtěán. 2018. “Many Analysts, One Dataset: Making Transparent How Variations in Analytical Choices Affect Results.” Advances in Methods and Practices in Psychological Science1:337–356.
57.
SimmonsJoseph P.NelsonLeif D.SimonsohnUri. 2011. “False-positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant.” Psychological Science22:1359–66.
58.
StapletonLaura M.KangYoonjeong. 2018. “Design Effects of Multilevel Estimates from National Probability Samples.” Sociological Methods & Research47:430–57.
59.
The New York Times. 2011. “A Book in Every Home, and Then Some.” The Opinion Pages, David Bornstein. May 16, 2011.
60.
The New York Times. 2015a. “America’s Students Are Lagging. Maybe It’s Not the Schools.” Economic Scene, Eduardo Porter. November 4, 2015, B1.
61.
The New York Times. 2015b. “Our Bare Shelves, Our Selves.” Future Tense, Teddy Wayne. December 6, 2015, ST2.
62.
ThorndikeRobert L.1973. “The Relation of School Achievement to Differences in the Backgrounds of Children.” Pp. 93–104 in Educational Policy and International Assessment: Implications of the IEA Surveys of Achievement, edited by PurvesA. C.LevineD. U.. Berkeley, CA: McCutchan.
63.
van deWerfhorstHermanG.MijsJonathan J. B.. 2010. “Achievement Inequality and the Institutional Structure of Educational Systems: A Comparative Perspective.” Annual Review of Sociology36:407–28.
64.
VereeckenCarineVandegehuchteAnn. 2003. “Measurement of Parental Occupation: Agreement between Parents and Their Children.” Archives of Public Health61:141–49.
65.
WestPatrickSweetingHelenSpeedEwen. 2001. “We Really Do Know What You Do: A Comparison of Reports From 11 Year Olds and Their Parents in Respect of Parental Economic Activity and Occupation.” Sociology35:539–59.
66.
XuJunHampden-ThompsonGillian. 2012. “Cultural Reproduction, Cultural Mobility, Cultural Resources, or Trivial Effect? A Comparative Approach to cultural capital and Educational Performance.” Comparative Education Review56:98–124.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
