Restricted accessResearch articleFirst published online 2020-2
The Impact of Measurement Error on Wage Decompositions: Evidence From the British Household Panel Survey and the Household,Income and Labour Dynamics in Australia Survey
Test–retest reliability assessments rarely investigate whether reliability itself is stable or change in reliability affects findings from substantive models. Research across the social sciences often recognizes that measurement error could influence results, yet it rarely applies established error correction methods. Focusing on gender wage inequality, we address two questions. First, to what extent does reliability vary over time, across genders and across measurement protocols? Second, does correcting for measurement error influence substantive conclusions about gender wage inequality? Comparing British and Australian panel data, we find little temporal variability in reliability; however, measurement error effects are variable and sometimes substantial.
AlwinDuane F.2007. Margins of Error: A Study of Reliability in Survey Measurement. Hoboken, NJ: Wiley-Interscience.
2.
AlwinDuane F.KrosnickJon A.. 1991. “Aging, Cohorts, and the Stability of Sociopolitical Orientations over the Life Span.” American Journal of Sociology97:169–95.
3.
AlwinDuane F.ZeiserK.GensimoreD.. 2014. “Reliability of Self-reports of Financial Data in Surveys: Results from the Health and Retirement Study.” Sociological Methods & Research43:98–136.
4.
AngristShirley S.1971. “Measuring Women’s Career Commitment.” Sociological Focus5:29–39.
Australian Bureau of Statistics. 2006. The Australian and New Zealand Standard Classification of Occupations (Anzsco). Belconnen, Australia: Australian Bureau of Statistics.
7.
BarónJuan D.Cobb-ClarkDeborah A.. 2010. “Occupational Segregation and the Gender Wage Gap in Private- and Public-sector Employment: A Distributional Analysis.” The Economic Record86:227–46.
8.
BeckerGary S.1975. Human Capital. Chicago, IL: University of Chicago Press.
9.
BelliRobert F.1998. “The Structure of Autobiographical Memory and the Event History Calendar: Potential Improvements in the Quality of Retrospective Reports in Surveys.” Memory6:383–406.
10.
BielbyWilliam T.HauserRobert M.FeathermanDavid L.. 1977a. “Response Errors of Black and Nonblack Males in Models of the Intergenerational Transmission of Socioeconomic Status.” American Journal of Sociology82:1242–88.
11.
BielbyWilliam T.HauserRobert M.FeathermanDavid L.. 1977b. “Response Errors of Nonblack Males in Models of the Stratification Process.” Journal of the American Statistical Association72:723–35.
12.
BlackabyDavid H.ClarkK.LeslieD. G.MurphyP. D.. 1997. “The Distribution of Male and Female Earnings 1973-1991: Evidence for Britain.” Oxford Economic Papers49:256–72.
13.
BlauFrancine D.BrummundPeterLiuAlbert Yung-Hsu. 2012. “Trends in Occupational Segregation by Gender 1970-2009: Adjusting for the Impact of Changes in the Occupational Coding System.” Demography50:471–92.
14.
BlinderAlan S.1973. “Wage Discrimination: Reduced Form and Structural Estimates.” Journal of Human Resources8:436–55.
15.
BohrnstedtGeorge W.2010. “Measurement Models for Survey Research.” Pp. 347–404 in Handbook of Survey Research, edited by MarsdenP. V.WrightJ. D.. Bingley, UK: Emerald Group.
16.
BollingerChristopher R.2001. “Measurement Error and the Union Wage Differential.” Southern Economic Journal68:60–76.
17.
BollingerChristopher R.2003. “Measurement Error in Human Capital and the Black-White Wage Differential.” Review of Economics and Statistics85:578–85.
18.
BorlandJeff. 1999. “The Equal Pay Case—Thirty Years On.” The Australian Economic Review32:265–72.
19.
BrintonMary C.1988. “The Social-institutional Bases of Gender Stratification—Japan as an Illustrative Case.” American Journal of Sociology94:300–34.
20.
CantorDavid. 1989. “Substantive Implications of Longitudinal Design Features: The National Crime Survey as a Case Study.” Pp. 25–51 in Panel Surveys, edited by KasprzykD.DuncanG.KaltonG.SinghM. P.. New York: John Wiley.
21.
CernatAlexandruLugtigPeterNoah UhrigSCWatsonNicole. 2014. “Assessing and Relaxing Assumptions in Quasi Simplex Models.” Vol. ISER Working Papers 2014-09. Colchester, UK: University of Essex.
22.
Cobb-ClarkDeborah A.TanMichelle. 2011. “Noncognitive Skills, Occupational Attainment, and Relative Wages.” Labour Economics18:1–13.
23.
CohenPatriciaCohenJacobTeresiJeanneMarchiMargaretNoemi VelezC.. 1990. “Problems in the Measurement of Latent Variables in Structural Equations Causal Models.” Applied Psychological Measurement14:183–96.
24.
CorcoranMaryDuncanGregory J.. 1979. “Work History, Labor-force Attachment, and Earnings Differences between the Races and Sexes.” Journal of Human Resources14:1–20.
25.
CottonJeremiah. 1988. “On the Decomposition of Wage Differentials.” The Review of Economics and Statistics70:236–43.
26.
DeShonRichard P.1998. “A Cautionary Note on Measurement Error Corrections in Structural Equation Models.” Psychological Methods3:412–23.
27.
DexShirleyJoshiHeatherMcCranSusanMcCullochAndrew. 1998. “Women’s Employment Transitions around Child Bearing.” Oxford Bulletin of Economics and Statistics60:79–98.
28.
EnglandPaula. 1992. “From Status Attainment to Segregation and Devaluation.” Contemporary Sociology21:643–47.
29.
EnglandPaulaBudigMichelleFolbreNancy. 2002. “Wages of Virtue: The Relative Pay of Care Work.” Social Problems49:455–73.
30.
EnglandPaulaReidLori L.KilbourneBarbara Stanek. 1996. “The Effect of Sex Composition of Jobs on Starting Wages in an Organization: Findings from the NLSY.” Demography33:511–21.
31.
FendrichMichaelVaughnConnie M.. 1994. “Diminished Lifetime Substance Use over Time: An Inquiry into Differential Underreporting.” Public Opinion Quarterly58:96–123.
32.
FrostChrisThompsonSimon G.. 2000. “Correcting for Regression Dilution Bias: Comparison of Methods for a Single Predictor Variable.” Journal of the Royal Statistical Society Series A163:173–89.
33.
FullerWayne A.1987. Measurement Error Models. New York: John Wiley.
34.
GanzeboomHarry B. G.TreimanDonald J.. 2003. “Three Internationally Standardized Measures for the Comparative Research on Occupational Status.” Pp. 159–93 in Advances in Cross-national Comparison: A European Working Book for Demographic and Socio-economic Variables, edited by Hoffmeyer-ZlotnikJ. H. P.WolfC.. New York: Kluwer Academic/Plenum Publishers.
35.
GoldthorpeJohn H.HopeKeith. 1974. Social Grading of Occupations: A New Approach and Scale. Oxford, UK: Clarendon Press.
36.
HakimCatherine. 1996. “Labour Mobility and Employment Stability: Rhetoric and Reality on the Sex Differential in Labour-market Behaviour.” European Sociological Review12:1–31.
37.
HakimCatherine. 1998. Social Change and Innovation in the Labour Market. Oxford, UK: Oxford University Press.
38.
HanushekEric A.JacksonJohn E.. 1977. Statistical Methods for Social Scientists. Orlando, FL: Academic Press.
39.
HarknessSusan. 1996. “The Gender Earnings Gap: Evidence from the UK.” Fiscal Studies17:1–36.
40.
HausmanJerry. 2001. “Mismeasured Variables in Econometric Analysis: Problems from the Right and Problems from the Left.” The Journal of Economic Perspectives15:57–67.
41.
HeiseDavid R.1969. “Separating Reliability and Stability in Test–Retest Correlation.” American Sociological Review34:93–101.
42.
IamsHoward M.ThorntonArland. 1975. “Decomposition of Differences a Cautionary Note.” Sociological Methods & Research3:341–52.
43.
JacobsJerry A.SteinbergRonnie J.. 1990. “Compensating Differentials and the Male–Female Wage Gap: Evidence from the New York State Comparable Worth Study.” Social Forces69:439–68.
44.
JohnsonB. F.HochK.JohnsonJ.. 1991. “Variability in Psychometric Test-scores—The Importance of the Practice Effect in Patient Study Design.” Progress in Neuro-Psychopharmacology & Biological Psychiatry15:625–35.
45.
JonesFrank L.1983. “Sources of Gender Inequality in Income—What the Australian Census Says.” Social Forces62:134–52.
46.
JonesF. L.KelleyJonathan. 1984. “Decomposing Differences between Groups: A Cautionary Note on Measuring Discrimination.” Sociological Methods and Research12:323–43.
47.
JoshiHeatherDexShirleyMcCranSusan. 1996. “Employment after Childbearing and Women’s Subsequent Labour Force Participation: Evidence for the 1958 Birth Cohort.” Journal of Population Economics9:325–48.
48.
JoshiHeatherPaciPierella. 1998. Unequal Pay for Women and Men: Evidence from the British Birth Cohort Studies. Cambridge, MA: MIT Press.
49.
JoshiHeatherPaciPierellaWaldfogelJane. 1999. “The Wage of Motherhood: Better or Worse?” Cambridge Journal of Economics23:543–64.
50.
KeeHiau Joo. 2006. “Glass Ceiling or Sticky Floor? Exploring the Australian Gender Pay Gap.” The Economic Record82:408–27.
51.
KerckhoffAlan C.RaudenbushStephen W.GlennieElizabeth. 2001. “Education, Cognitive Skill, and Labor Force Outcomes.” Sociology of Education74:1–24.
52.
KilbourneBarbara StanekFarkasGeorgeBeronKurtWeirDorotheaEnglandPaula. 1994. “Returns to Skill, Compensating Differentials, and Gender Bias: Effects of Occupational Characteristics on the Wages of White Women and Men.” American Journal of Sociology100:689–719.
53.
KimChangHwanTamboriniChristopher R.. 2014. “Response Error in Earnings: An Analysis of the Survey of Income and Program Participation Matched with Administrative Data.” Sociological Methods & Research43:39–72.
54.
KreuterF.McCullochS.PresserS.TourangeauR.. 2011. “The Effects of Asking Filter Questions in Interleafed versus Grouped Format.” Sociological Methods & Research40:88–104.
55.
KreuterFraukeEckmanStephanieMaazKaiWatermannRainer. 2010. “Children’s Reports of Parents’ Education Level: Does It Matter Whom You Ask and What You Ask About?”. Survey Research Methods4:127–38.
56.
LaenenAnnouschkaAlonsoArielMolenberghsGeertVangeneugdenTony. 2007. “A Family of Measures to Evaluate Scale Reliability in a Longitudinal Setting.” Journal of the Royal Statistical Society Series A172:237–53.
57.
LordFrederic M.NovickMelvin R.. 1968. Statistical Theories of Mental Test Scores. Reading, MA: Addison-Wesley.
58.
LynnPeterBuckNicholasBurtonJonathanLaurieHeatherNoah UhrigS. C.. 2006. Quality Profile: British Household Panel Survey. Version 2: Waves 1 to 13, 1991-2003. Colchester, UK: University of Essex.
59.
MagnussonCharlotta. 2009. “Gender, Occupational Prestige, and Wages: A Test of Devaluation Theory.” European Sociological Review25:87–101.
60.
ManningAlanRobinsonHelen. 2004. “Something in the Way She Moves: A Fresh Look at an Old Gap.” Oxford Economic Papers56:169–88.
61.
MariniMargaret MooneyFanPi-Ling. 1997. “The Gender Gap in Earnings at Career Entry.” American Sociological Review62:588–604.
62.
McMillanJulieBeavisAdrianJonesFrank L.. 2009. “The AUSEI06: A New Socioeconomic Index for Australia.” Journal of Sociology45:123–49.
63.
MillerPaul W.1987. “The Wage Effect of the Occupational Segregation of Women in Britain.” The Economic Journal97:885–96.
64.
MillerPaul W.1994. “Occupational Segregation and Wages in Australia.” Economics Letters45:367–71.
65.
MillerPaul W.2005. “The Role of Gender among Low-paid and High-paid Workers.” The Australian Economic Review38:405–17.
66.
MuellerGerritPlugErik J. S.. 2006. “Estimating the Effect of Personality on Male and Female Earnings.” Industrial Labor Relations Review60:1–22.
67.
MumfordKarenSmithPeter N.. 2007. “The Gender Earnings Gap in Britain: Including the Workplace.” The Manchester School75:653–72.
68.
MunckIngrid M. E.1991. “Path Analysis of Cross-national Data Taking Measurement Errors into Account.” Pp. 599-616 inMeasurement Errors in Surveys, edited by BiemerP. P.GrovesR. M.LybergL. E.MathiowetzN. A.SudmanS.. New York: John Wiley.
69.
NandiAlitaNicolettiCheti. 2009. “Explaining Personality Pay Gaps in the UK.” ISER Working Paper Series No. 2009-22. Colchester, UK: University of Essex.
70.
NeumarkDavid. 1988. “Employers’ Discriminatory Behavior and the Estimation of Wage Discrimination.” Journal of Human Resources23:279–95.
71.
OaxacaRonald. 1973. “Male–Female Wage Differentials in Urban Labor Markets.” International Economic Review14:693–709.
72.
OaxacaRonald L.RansomMichael R.. 1994. “On Discrimination and the Decomposition of Wage Differentials.” Journal of Econometrics61:5–21.
73.
Office of Population Censuses and Surveys. 1990. Standard Occupational Classification. Vol. 1. London, UK: HMSO.
74.
OlsenWendyWalbySylvia. 2004. “Modelling Gender Pay Gaps.” Working Paper Series #17. Manchester, UK: Equal Opportunities Commission.
75.
PalmquistBradleyGreenDonald P.. 1992. “Estimation of Models with Correlated Measurement Errors from Panel Data.” Sociological Methodology22:119–46.
76.
PérezFrancisco Perales. 2010. “The Impact of Occupational Sex-segregation on Wages: Evidence from Britain.” Essex Graduate Journal of Sociology10:35–53.
77.
PolaviejaJavier G.2012. “Socially Embedded Investments: Explaining Gender Differences in Job-specific Skills.” American Journal of Sociology118:592–634.
78.
PrandyKen. 1990. “The Revised Cambridge Scale of Occupations.” Sociology24:629–55.
79.
PutzDavid W.2002. “Partisan Conversion in the 1990s: Ideological Realignment Meets Measurement Theory.” The Journal of Politics64:1199–209.
80.
ReidLori L.1998. “Devaluing Women and Minorities the Effects of Race/Ethnic and Sex Composition of Occupations on Wage Levels.” Work and Occupations25:511–36.
81.
ReimersCordelia W.1983. “Labour Market Discrimination against Hispanic and Black Men.” The Review of Economics and Statistics65:570–79.
82.
ReissAlbert J.1961. Occupations and Social Status. New York: The Free Press of Glencoe.
83.
RoosPatricia A.1983. “Marriage and Women’s Occupational Attainment in Cross-cultural Perspective.” American Sociological Review48:852–64.
84.
RuggieMary. 1984. The State and Working Women: A Comparative Study of Britain and Sweden. Princeton, NJ: Princeton University Press.
85.
RummerySarah. 1992. “The Contribution of Intermittent Labour Force Participation to the Gender Wage Differential.” The Economic Record68:351–64.
86.
SandellSteven H.ShapiroDavid. 1978. “An Exchange: The Theory of Human Capital and the Earnings of Women: A Reexamination of the Evidence.” Journal of Human Resources13:103–17.
87.
SummerfieldMichelleFreidinSimonHahnMarkusIttakPeterLiNingMacAlaladNinetteWatsonNicoleWilkinsRogerWoodenMark. 2012. HILDA User Manual—Release 11. Melbourne, Australia: Melbourne Institute of Applied Economic and Social Research.
88.
SwaffieldJoanna. 2000. “Gender, Motivation, Experience and Wages.” CEP Discussion Paper 0457 (May). London School of Economics, London, UK.
89.
TamTony. 1997. “Sex Segregation and Occupational Gender Inequality in the United States: Devaluation or Specialized Training.” American Journal of Sociology102:1652–92.
90.
ThornberryT.1989. “Panel Effects and the Use of Self-reported Measures of Delinquency in Longitudinal Studies.” Pp. 347–69 in Cross-national Research in Self-reported Crime and Delinquency, edited by KleinM. W.. Dordrecht, the Netherlands: Kluwer Academic.
91.
ThorntonArland. 1985. “Changing Attitudes toward Separation and Divorce: Causes and Consequences.” American Journal of Sociology90:856–72.
92.
TreimanDonald J.RoosPatricia A.. 1983. “Sex and Earnings in Industrial Society: A Nine-nation Comparison.” American Journal of Sociology89:612–50.
93.
UhrigS. C. Noah. 2013. “Understanding Panel Conditioning: An Examination of Social Desirability Bias in Self-reported Height and Weight in Panel Surveys Using Experimental Data.” Journal of Longitudinal and Life Course Studies3:120–36.
94.
VermuntJeroen K.2010. “Latent Class Modeling with Covariates: Two Improved Three-step Approaches.” Political Analysis18:450–69.
95.
WagstaffDavid A.KulisStephenElekElvira. 2009. “A Six-wave Study of the Consistency of Mexican/Mexican-American Preadolescents’ Lifetime Substance Use Reports.” Journal of Drug Education39:361–84.
96.
WaldfogelJane. 1995. “The Price of Motherhood: Family Status and Women’s Pay in a Young British Cohort.” Oxford Economic Papers47:584–610.
97.
WatsonIan. 2010. “Decomposing the Gender Pay Gap in The Australian Managerial Labour Market.” Australian Journal of Labour Economics13:49–79.
98.
WellingtonAlison J.1994. “Accounting for the Male/Female Wage Gap among Whites: 1976 and 1985.” American Sociological Review59:839–48.
99.
WertsCharles E.JöreskogKarl G.LinnRobert L.. 1971. “Comment on ‘the Estimation of Measurement Error in Panel Data’.” American Sociological Review36:110–13.
100.
WileyDavid E.WileyJames A.. 1970. “Estimation of Measurement Error in Panel Data.” American Sociological Review35:112–17.
101.
WilsonSven E.HowellBenjamin L.. 2005. “Do Panel Surveys Make People Sick? Us Arthritis Trends in the Health and Retirement Survey.” Social Science and Medicine60:2623–27.
102.
WinsboroughHalliman H.DickinsonPeter. 1971. “Components of Negro-White Income Differences.” Proceedings of the Social Statistics Section of the American Statistical Association63:6.
103.
WoodenMark. 1999. “Gender Pay Equity and Comparable Worth in Australia: A Reassessment.” The Australian Economic Review32:157–71.
104.
WrightRobert E.ErmischJohn F.. 1991. “Gender Discrimination in the British Labour Market: A Reassessment.” The Economic Journal101:508–22.
105.
YalchR. F.1976. “Pre-election Interview Effects on Voter Turnout.” Public Opinion Quarterly40:331–36.
106.
ZabalzaAntoniArrufatJ. L.. 1985. “The Extent of Sex Discrimination in Great Britain.” Pp. 70–96 in Women and Equal Pay: The Effects of Legislation on Female Employment and Wages in Britain, edited by ZabalzaA.TzannatosZ.. Cambridge, UK: Cambridge University Press.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
