The practice of giving certain life domains (such as health, family life) more weight in calculating an overall score, known as importance weighting, has been a subject of debate in subjective well-being (SWB) research for decades. In this paper, we present evidence by analyzing data from 513 Chinese adults to caution readers that findings of importance weighting in the SWB studies should be interpreted carefully. Given the many unsettled issues in assessing importance weighting, findings are often not clear-cut or definitive and overgeneralization can mislead our understanding of well-being. Future research on the topic of importance weighting should acknowledge study assumptions and limitations to avoid potential overgeneralization of findings.
BollenK.LennoxR.1991. “Conventional Wisdom on Measurement: A Structural Equation Perspective.” Psychological Bulletin110:305–14.
2.
CampbellA.ConverseP. E.RogersW. L.1976. The Quality of American Life: Perceptions, Evaluations, and Satisfactions. New York: Russell Sage Foundation.
3.
CheungF.LucasR. E.2014. “Assessing the Validity of Single-Item Life Satisfaction Measures: Results from Three Large Samples.” Quality of Life Research23:2809–18.
4.
ChinW. W.NewstedP. R.1999. “Structural Equation Modeling Analysis with Small Samples Using Partial Least Squares.” Pp. 307–41 in Statistical Strategies for Small Sample Research, edited by HoleR. H.Thousand Oaks, CA: Sage.
5.
CohenJ.1988. Statistical Power Analysis for the Behavioral Sciences. 2nd ed.Hillsdale, NJ: Lawrence Erlbaum.
6.
CohenP.CohenJ.TeresiJ.MarchiM.VelezC. N.1990. “Problems in the Measurement of Latent Variables in Structural Equations Casual Models.” Applied Psychological Measurement14:183–96.
7.
CumminsR. A.1996. “The Domains of Life Satisfaction: An Attempt to Order Chaos.” Social Indicators Research38:303–28.
8.
DienerE.EmmonsR. A.LarsenR. J.GriffinS.1985. “The Satisfaction with Life Scale.” Journal of Personality Assessment49:71–75.
9.
EvansD. R.1994. “Enhancing Quality of Life in the Population at Large.” Social Indicators Research33:47–88.
10.
EvansM. G.1991. “The Problem of Analyzing Multiplicative Composites: Interactions Revisited.” American Psychologist46:6–15.
11.
FerransC. E.PowersM. J.1985. “Quality of Life Index: Development and Psychometric Properties.”Advances in Nursing Science8: 15–24.
12.
GuardiolaJ.Picazo-TadeoA. J.2014. “Building Weighted-Domain Composite Indices of Life Satisfaction with Data Envelopment Analysis.” Social Indicators Research117:257–74.
13.
HagellP.WestergrenA.2006. “The Significance of Importance: An Evaluation of Ferrans and Powers’ Quality of Life Index.” Quality of Life Research15:867–76.
14.
HagertyM. R.CumminsR. A.FerrisA. L.LandK. C.MichalosA. C.PetersonM.SharpeA.SirgyJ.VogelJ.2001. “Quality of Life Indexes for National Policy: Review and Agenda for Research.” Social Indicators Research55:1–96.
15.
HagertyM. R.LandK. C.2007. “Constructing Summary Indices of Quality of Life: A Model for the Effect of Heterogeneous Importance Weights.” Sociological Methods & Research35:455–96.
16.
HardyL.MoriartyT.2006. “Shaping Self-Concept: The Elusive Importance Effect.”Journal of Personality74: 377–401.
17.
HsiehC. M.2003. “Counting Importance: The Case of Life Satisfaction and Relative Domain Importance.” Social Indicators Research61:227–40.
18.
HsiehC. M.2004. “To Weight or Not to Weight: The Role of Domain Importance in Quality of Life Measurement.” Social Indicators Research68:163–74.
19.
HsiehC. M.2012. “Should We Give Up Domain Importance Weighting on QOL Measures?” Social Indicators Research108:99–109.
20.
HsiehC. M.2013. “Issues in Evaluating Importance Weighting in Quality of Life Measures.” Social Indicators Research110:681–93.
21.
HsiehC. M.2015. “The Often Overlooked Issue of Statistical Power: This and Other Issues Regarding Assessing Importance Weighting in Quality of Life Measures.” Social Science Research50:303–10.
22.
HsiehC. M.2016. “Domain Importance in Subjective Well-Being Measures.” Social Indicators Research127:777–92.
23.
HsiehC. M.2017. “Synthesis of Indicators Through Weighting: The Experiences of Quality of Life Measures.” Pp. 231–49 in Complexity in Society: From Indicators Construction to Their Synthesis. Social Indicators Research Series, Vol. 70, edited by F.Maggino. Cham, Switzerland: Springer. doi:10.1007/978-3-319-60595-1_10.
24.
HsiehC. M.2018. “Importance Weighting in Client Satisfaction Measures: Lessons from the Life Satisfaction Literature.” Social Indicators Research138:45–60.
25.
HsiehC. M.KenagyG. P.2014. “Measuring Quality of Life: A Case for Re-Examining the Assessment of Domain Importance Weighting.” Applied Research in Quality of Life9:63–77.
26.
HsiehC. M.LiQ.2019. “What Importance? Importance Weighting and Subjective Well-Being.” Journal of Well-Being Assessment3:59–74.
27.
KaplanR. M.FeenyD.RevickiD. A.1993. “Methods for Assessing Relative Importance in Preference Based Outcome Measures.” Quality of Life Research2:467–75.
28.
KruegerA. B.SchkadeD. A.2008. “The Reliability of Subjective Well-Being Measures.” Journal of Public Economics92:1833–45.
29.
MastekaasaA.1984. “Multiplicative and Additive Models of Job and Life Satisfaction.” Social Indicators Research14:141–63.
30.
RohrerJ. M.SchmukleS. C.2018. “Individual Importance Weighting of Domain Satisfaction Ratings Does Not Increase Validity.” Collabra: Psychology4:6. doi:10.1525/collabra.116.
31.
RojasM.2006. “Life Satisfaction and Satisfaction in Domains of Life: Is It a Simple Relationship?” Journal of Happiness Studies7:467–97.
32.
RussellL. B.HubleyA. M.2005. “Importance Ratings and Weighting: Old Concerns and New Perspectives.” International Journal of Testing5:105–30.
33.
RussellL. B.HubleyA. M.PalepuA.ZumboB. D.2006. “Does Weighting Capture What’s Important? Revisiting Subjective Importance Weighting with a Quality of Life Measure.” Social Indicators Research75:146–67.
34.
SteigerJ. H.1980. “Test for Comparing Elements of a Correlation Matrix.” Psychological Bulletin87:245–51.
35.
ThorndikeR. M.Thorndike-ChristT. M.2010. Measurement and Evaluation in Psychology and Education. 8th ed.New York: Pearson.
36.
TiefenbachT.KohlbacherF.2015. “Individual Differences in the Relationship Between Domain Satisfaction and Happiness: The Moderating Role of Domain Importance.” Personality and Individual Differences86:82–87.
37.
WuC. H.2008a. “Can We Weight Satisfaction Score with Importance Ranks Across Life Domains?” Social Indicators Research86:468–80.
38.
WuC. H.2008b. “Examining the Appropriateness of Importance Weighting on Satisfaction Score from Range-of-Affect Hypothesis: Hierarchical Linear Modeling for Within-Subject Data.” Social Indicators Research86:101–11.
39.
WuC. H.YaoG.2006. “Do We Need to Weight Item Satisfaction by Item Importance? A Perspective from Locke’s Range-of-Affect Hypothesis.” Social Indicators Research79:485–502.
40.
WuC. H.YaoG.2007. “Examining the Relationship Between Global and Domain Measures of Quality of Life by Three Factor Structure Models.” Social Indicators Research84:189–202.
41.
YarkoniT.WestfallJ.2017. “Choosing Prediction Over Explanation in Psychology: Lessons from Machine Learning.”Perspectives on Psychological Science12: 1100–1122.
