The Scale of Positive and Negative Experience (SPANE) is widely used to measure emotional experiences, but not much is known about its cross-cultural utility. The present study evaluated the measurement invariance of the SPANE across adult samples (N = 12,635; age range = 18-85 years; 58.2% female) from 13 countries (China, Colombia, Germany, Greece, India, Italy, Japan, Poland, Portugal, Serbia, Spain, Turkey, and the United States). Configural and partial scalar invariance of the SPANE were supported. Three items capturing specific negative emotions (sad, afraid, and angry) were found to be culturally noninvariant. Our findings suggest that the SPANE’s positive emotion terms and general negative emotion terms (e.g., negative and unpleasant) might be more suitable for cross-cultural studies on emotions and well-being, whereas caution is needed when comparing countries using the SPANE’s specific negative emotion items.
BagozziR. P.WongN.YiY. (1999). The role of culture and gender in the relationship between positive and negative affect. Cognition and Emotion, 13(6), 641-672. https://doi.org/10.1080/026999399379023
3.
BeauducelA.HerzbergP. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling: A Multidisciplinary Journal, 13(2), 186-203. https://doi.org/10.1207/s15328007sem1302_2
4.
BusseriM. (2018). Examining the structure of subjective well-being through meta-analysis of the associations among positive affect, negative affect, and life satisfaction. Personality and Individual Differences, 122, 68-71. https://doi.org/10.1016/j.paid.2017.10.003
5.
ByrneB. M.ShavelsonR.MuthénB. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456-466. https://doi.org/10.1037/0033-2909.105.3.456
6.
ChenF. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464-504. https://doi.org/10.1080/10705510701301834
7.
ChenF. F.BaiL.LeeJ. M.JingY. (2016). Culture and the structure of affect: A bifactor modeling approach. Journal of Happiness Studies, 17, 1801-1824. https://doi.org/10.1007/s10902-015-9671-3
8.
CieciuchJ.DavidovE.SchmidtP.AlgesheimerR. (2019). How to obtain comparable measures for cross-national comparisons. Kölner Zeitschrift für Soziologie und Sozialpsychologie, 71, 157-186. https://doi.org/10.1007/s11577-019-00598-7
9.
CookeP. J.MelchertT. P.ConnorK. (2016). Measuring well-being: A review of instruments. The Counseling Psychologist, 44(5), 730-757. https://doi.org/10.1177/0011000016633507
10.
CrawfordJ. R.HenryJ. D. (2004). The Positive and Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 43(Pt. 3), 245-265. https://doi.org/10.1348/0144665031752934
11.
Daniel-GonzálezL.de la RubiaJ. M.Valle de laO. A.García-CadenaC. H.Martínez-MartíM. L. (2020). Validation of the Mexican Spanish version of the Scale of Positive and Negative Experience in a sample of medical and psychology students. Psychological Reports, 123(5), 2053-2079. https://doi.org/10.1177/0033294119896046
12.
DavisR. C.ArceM. A.TobinK. E.PalumboI. M.ChmielewskiM.MegreyaA. M.LatzmanR. D. (2020). Testing measurement invariance of the Positive and Negative Affect Schedule (PANAS) in American and Arab university students. International Journal of Mental Health and Addiction. Advance online publication. https://doi.org/10.1007/s11469-020-00411-z
DienerE.EmmonsR. A.LarsenR. J.GriffinS. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49(1), 71-75. https://doi.org/10.1207/s15327752jpa4901_13
DienerE.SuhE. M.LucasR. E.SmithH. L. (1999). Subjective well-being: Three decades of progress. Psychological Bulletin, 125(2), 276-302. https://doi.org/10.1037/0033-2909.125.2.276
17.
DienerE.WirtzD.TovW.Kim-PrietoC.ChoiD.-W.OishiS.Biswas-DienerR. (2010). New well-being measures: Short scales to assess flourishing and positive and negative feelings. Social Indicators Research, 97, 143-156. https://doi.org/10.1007/s11205-009-9493-y
18.
DodouD.de WinterJ. C. F. (2014). Social desirability is the same in offline, online, and paper surveys: A meta-analysis. Computers in Human Behavior, 36, 487-495. https://doi.org/10.1016/j.chb.2014.04.005
19.
du PlessisG. A.GuseT. (2017). Validation of the Scale of Positive and Negative Experience in a South African student sample. South African Journal of Psychology, 47(2), 184-197. https://doi.org/10.1177/0081246316654328
20.
EpsteinJ.SantoR. M.GuilleminF. (2015). A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. Journal of Clinical Epidemiology, 68(4), 435-441. https://doi.org/10.1016/j.jclinepi.2014.11.021
21.
EspejoB.ChecaI.Perales-PuchaltJ.LisónJ. F. (2020). Validation and measurement invariance of the Scale of Positive and Negative Experience (SPANE) in a Spanish general sample. International Journal of Environmental Research and Public Health, 17(22), 1-15. https://doi.org/10.3390/ijerph17228359
22.
FeldtL. S.WoodruD. J.SalihF. A. (1987). Statistical inference for coefficient alpha. Applied Psychological Measurement, 11(1), 93-103. https://doi.org/10.1177/014662168701100107
23.
FornellC.LarckerD. F. (1981). Structural equation models with unobservable variables and measurement error: Algebra and statistics. Journal of Marketing Research, 18(3), 382-388. https://doi.org/10.2307/3150980
24.
FouladiR. T.McCarthyC. J.MollerN. (2002). Paper-and-pencil or online? Evaluating mode effects on measures of emotional functioning and attachment. Assessment, 9(2), 204-215. https://doi.org/10.1177/10791102009002011
25.
GrossmannI.HuynhA. C.EllsworthP. C. (2016). Emotional complexity: Clarifying definitions and cultural correlates. Journal of Personality and Social Psychology, 111(6), 895-916. https://doi.org/10.1037/pspp0000084
26.
GiuntoliL.CeccariniF.SicaC.CaudekC. (2017). Validation of the Italian versions of the Flourishing Scale and of the Scale of Positive and Negative Experience. SAGE Open, 7(1), 1-12. https://doi.org/10.1177/2158244016682293
27.
HairJ.BlackW.BabinB.AndersonR. (2010). Multivariate data analysis (7th ed.). Prentice Hall, Inc.
28.
HelliwellJ. F.LayardR.SachsJ.De NeveJ-E. (2020). World happiness report 2020. Sustainable Development Solutions Network.
29.
HofstedeG.HofstedeG. J.MinkovM. (2010). Cultures and organizations: Software of the mind (3rd ed.). McGraw-Hill.
30.
JacksonP.AgunwambaC. (1977). Lower bounds for the reliability of the total score on a test composed of nonhomogeneous items: I: Algebraic lower bounds. Psychometrika, 42, 567-578. https://doi.org/10.1007/BF02295979
31.
JacksonJ. C.WattsJ.HenryT. R.ListJ.-M.ForkelR.MuchaP. J.GreenhillS. J.GrayR. D.LindquistK. A. (2019). Emotion semantics show both cultural variation and universal structure. Science, 366(6472), 1517-1522. https://doi.org/10.1126/science.aaw8160
32.
JangS.KimE. S.CaoC.AllenT. D.CooperC. L.LapierreL. M.O’DriscollM. P.SanchezJ. I.SpectorP. E.PeolmansS. A. Y.AbarcaN.AlexandrovaM.AntoniouA.-S.BehamB.BroughP.CarikciI.FerreiroP.FraileG.GeurtsS.. . .WooJ-M. (2017). Measurement invariance of the Satisfaction With Life Scale across 26 countries. Journal of Cross-Cultural Psychology, 48(4), 560-576. https://doi.org/10.1177/0022022117697844
33.
JoshanlooM.BakhshiA. (2016). The factor structure and measurement invariance of positive and negative affect: A study in Iran and the USA. European Journal of Psychological Assessment, 32(4), 265-272. https://doi.org/10.1027/1015-5759/a000252
34.
JovanovićV.BrdarI. (2018). The cross-national measurement invariance of the Satisfaction with Life Scale in a sample of undergraduate students. Personality and Individual Differences, 128, 7-9. https://doi.org/10.1016/j.paid.2018.02.010
35.
JovanovićV.LazićM.Gavrilov-JerkovićV.MolenaarD. (2020). The Scale of Positive and Negative Experience (SPANE): Evaluation of measurement invariance and convergent and discriminant validity. European Journal of Psychological Assessment, 36(4), 694-704. https://doi.org/10.1027/1015-5759/a000540
36.
KangY.McNeishD. M.HancockG. R. (2016). The role of measurement quality on practical guidelines for assessing measurement and structural invariance. Educational and Psychological Measurement, 76(4), 533-561. https://doi.org/10.1177/0013164415603764
37.
KlineR. B. (2016). Principles and practice of structural equation modeling (4th ed.). Guilford Press.
38.
Kööts-AusmeesL.RealoA.AllikJ. (2013). The relationship between life satisfaction and emotional experience in 21 European countries. Journal of Cross-Cultural Psychology, 44(2), 223-244. https://doi.org/10.1177/0022022112451054
39.
KraskoJ.GollanN.KochT. (2019). Digital Well-Being [Unpublished raw data].
40.
KraskoJ.IntelisanoS.LuhmannM. (2020). The complexity of happiness conceptualizations are associated with the success of well-being related intentions and behaviors in everyday life [Manuscript in preparation].
41.
KraskoJ.IntelisanoS.LuhmannM. (2021). When happiness is both joy and purpose: The complexity of lay definitions of happiness and well-being is related to actual well-being. PsyArXiv. https://doi.org/10.31234/osf.io/6c8fm
42.
KyriazosT. A.StalikasA.PrassaK.YotsidiV. (2018). A 3-faced construct validation and a bifactor subjective well-being model using the Scale of Positive and Negative Experience, Greek version. Psychology, 9(5), 1143-1175. https://doi.org/10.4236/psych.2018.95071
43.
LeeS. T.HartantoA.YongJ.KohB.LeungA. K. (2020). Examining the cross-cultural validity of the positive affect and negative affect schedule between an Asian (Singaporean) sample and a Western (American) sample. Asian Journal of Social Psychology, 23(1), 109-116. https://doi.org/10.1111/ajsp.12390
LiC.-H. (2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48, 936-949. https://doi.org/10.3758/s13428-015-0619-7
46.
LiF.BaiX.WangY. (2013). The Scale of Positive and Negative Experience (SPANE): Psychometric properties and normative data in a large Chinese sample. PLOS ONE, 8, Article e61137. https://doi.org/10.1371/journal.pone.0061137
47.
LintonM.DieppeP.Medina-LaraA. (2016). Review of 99 self-report measures for assessing well-being in adults: Exploring dimensions of well-being and developments over time. BMJ Open, 6, Article e010641. https://doi.org/10.1136/bmjopen-2015-010641
48.
LiuJ-D.YouR-H.LiuH.ChungP-K. (2020). Chinese version of the international positive and negative affect schedule short form: Factor structure and measurement invariance. Health and Quality of Life Outcomes, 18, Article 285. https://doi.org/10.1186/s12955-020-01526-6
49.
MairP. (2018). Modern psychometrics with R. Springer International.
50.
Martín-CarbonellM.ChecaI.Fernández-DazaM.PaterninaY.EspejoB. (in press). Adaptation and psychometric properties of the Scale of Positive and Negative Experience (SPANE) in the general Colombian population. International Journal of Environmental Research and Public Health.
51.
Martín-CarbonellM.EspejoB.ChecaI.Fernández-DazaM. (2021). Adaptation and measurement invariance by gender of the Flourishing Scale in a Colombian sample. International Journal of Environmental Research and Public Health, 18(5), 2664. https://doi.org/10.3390/ijerph18052664
52.
Martin-KrummC.FenouilletF.CsillikA.KernL.BesanconM.HeutteJ.PaquetT.DelasY.TrousselardM.LecorreB.DienerE. (2018). Changes in emotions from childhood to young adulthood. Child Indicators Research, 11, 541-561. https://doi.org/10.1007/s12187-016-9440-9
53.
McDonaldR. P. (1999). Test theory: A unified treatment. Erlbaum.
54.
MeadeA. W.JohnsonE. C.BraddyP. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93(3), 568-592. https://doi.org/10.1037/0021-9010.93.3.568
55.
MillsapR. E. (2012). Statistical approaches to measurement invariance. Routledge.
MitamuraC.LeuJ.CamposB.BoccagnoC.TugadeM. M. (2014). Traversing affective boundaries: Examining cultural norms for positive emotions. In TugadeM. M.ShiotaM. N.KirbyL. D. (Eds.), Handbook of positive emotions (pp. 229-240). Guilford Press.
58.
MiyamotoY.RyffC. D. (2011). Cultural differences in the dialectical and non-dialectical emotional styles and their implications for health. Cognition and Emotion, 25(1), 22-39. https://doi.org/10.1080/02699931003612114
59.
MroczekD. K.KolarzC. M. (1998). The effect of age on positive and negative affect: A developmental perspective on happiness. Journal of Personality and Social Psychology, 75(5), 1333-1349. https://doi.org/10.1037/0022-3514.75.5.1333
OishiS.GrahamJ.KesebirS.GalinhaI. C. (2013). Concepts of happiness across time and cultures. Personality and Social Psychology Bulletin, 39(5), 559-577. https://doi.org/10.1177/0146167213480042
62.
PeerE.VosgerauJ.AcquistiA. (2014). Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavior Research Methods, 46, 1023-1031. https://doi.org/10.3758/s13428-013-0434-y
63.
PutnickD. L.BornsteinM. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71-90. https://doi.org/10.1016/j.dr.2016.06.004
64.
RahmT.HeiseE.SchuldtM. (2017). Measuring the frequency of emotions-validation of the Scale of Positive and Negative Experience (SPANE) in Germany. PLOS ONE, 12, Article e0171288. https://doi.org/10.1371/journal.pone.0171288
65.
RasinskiK. A.LeeL.KrishnamurtyP. (2012). Question order effects. In CooperH.CamicP. M.LongD. L.PanterA. T.RindskopfD.SherK. J. (Eds.), APA handbooks in psychology®. APA handbook of research methods in psychology, Vol. 1. Foundations, planning, measures, and psychometrics (pp. 229-248). American Psychological Association.
66.
RaykovT. (1997). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 21(2), 173-184. https://doi.org/10.1177/01466216970212006
67.
RiceS. P. M. (2020a). Measuring well-being: A longitudinal psychometric investigation into the theoretical structures of well-being and implications for assessment (Publication No. 27739173) [Doctoral dissertation, Washington State University]. ProQuest Dissertations Publishing.
68.
RiceS. P. M. (2020b). Psychometric properties of well-being scales in and outside the workplace [Unpublished raw data]. Washington State University Vancouver.
69.
RiceS. P. M.Shorey-FennellB. R. (2020). Comparing the psychometric properties of measures of positive and negative emotional experiences: Implications for the assessment of subjective wellbeing. Journal of Well-Being Assessment, 4, 37-56. https://doi.org/10.1007/s41543-020-00025-1
70.
SaucierG.ThalmayerA. G.Bel-BaharT. S. (2014). Human attribute concepts: Relative ubiquity across twelve mutually isolated languages. Journal of Personality and Social Psychology, 107(1), 199-216. https://doi.org/10.1037/a0036492
71.
SchererK. R.ShumanV.FontaineJ. R. J.SorianoC. (2013). The GRID meets the wheel: Assessing emotional feeling via self-report. In FontaineJ. R. J.SchererK. R.SorianoC. (Eds.), Components of emotional meaning: A sourcebook (pp. 281-298). Oxford University Press.
72.
SchimmackU.OishiS.DienerE. (2002). Cultural influences on the relation between pleasant emotions and unpleasant emotions: Asian dialectic philosophies or individualism-collectivism?Cognition and Emotion, 16(6), 705-719. https://doi.org/10.1080/02699930143000590
73.
ScollonC. N.KohS.AuE. W. M. (2011). Cultural differences in the subjective experience of emotion: When and why they occur. Social and Personality Psychology Compass, 5(11), 853-864. https://doi.org/10.1111/j.1751-9004.2011.00391.x
74.
SilvaA. J.CaetanoA. (2013). Validation of the flourishing scale and scale of positive and negative experience in Portugal. Social Indicators Research, 110, 469-478. https://doi.org/10.1007/s11205-011-9938-y
75.
SinghK.JunnarkarM.KaurJ. (2016). Measures of positive psychology: Development and validation. Springer.
76.
Spencer-RodgersJ.PengK.WangL. (2010). Dialecticism and the co-occurrence of positive and negative emotions across cultures. Journal of Cross-Cultural Psychology, 41(1), 109-115. https://doi.org/10.1177/0022022109349508
77.
SumiK. (2014). Reliability and validity of Japanese versions of the Flourishing Scale and the Scale of Positive and Negative Experience. Social Indicators Research, 118, 601-615. https://doi.org/10.1007/s11205-013-0432-6
78.
TabachnickB. G.FidellL. S. (2015). Using multivariate statistics. Allyn & Bacon.
79.
ThompsonE. R. (2007). Development and validation of an internationally reliable short-form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227-242. https://doi.org/10.1177/0022022106297301
80.
ThompsonB.RobertsS.LupyanG. (2020). Cultural influences on word meanings revealed through large-scale semantic alignment. Nature Human Behaviour, 4, 1029-1038. https://doi.org/10.1038/s41562-020-0924-8
81.
TongK. K.WangY. Y. (2017). Validation of the flourishing scale and scale of positive and negative experience in a Chinese community sample. PLOS ONE, 12, Article e0181616. https://doi.org/10.1371/journal.pone.0181616
82.
United Nations Development Programme. (2020). Human development report 2020. The next frontier: Human development and the Anthropocene.
83.
VandenbergR. J.LanceC. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4-69. https://doi.org/10.1177/109442810031002
84.
WangJ.WangX. (2019). Structural equation modeling: Applications using Mplus. John Wiley & Sons.
85.
WatsonD.ClarkL. A.TellegenA. (1988). Development and validation of brief measures of positive and negative affect: The PANAS Scales. Journal of Personality and Social Psychology, 54(6), 1063-1070. https://doi.org/10.1037//0022-3514.54.6.1063
86.
WertsC. E.LinnR. N.JoreskogK. G. (1974). Interclass reliability estimates: Testing structural assumptions. Educational and Psychological Measurement, 34(1), 25-33. https://doi.org/10.1177/001316447403400104
87.
WilkenB.MiyamotoY. (2018). Dialectical emotions. In Spencer-RodgersJ.PengK. (Eds.), The psychological and cultural foundations of East Asian cognition: Contradiction, change, and holism (pp. 509-546). Oxford University Press.
88.
WuH.EstabrookR. (2016). Identification of confirmatory factor analysis models of different levels of invariance for ordered categorical outcomes. Psychometrika, 81, 1014-1045. https://doi.org/10.1007/s11336-016-9506-0
89.
YikM.RussellJ. A.SteigerJ. H. (2011). A 12-point circumplex structure of core affect. Emotion, 11(4), 705-731. https://doi.org/10.1037/a0023980
90.
YildirimM. (2019). Mediating role of resilience in the relationships between fear of happiness and affect balance, satisfaction with life, and flourishing. Europe’s Journal of Psychology, 15(2), 183-198. https://doi.org/10.5964/ejop.v15i2.1640
91.
YoonM.LaiM. H. C. (2018). Testing factorial invariance with unbalanced samples. Structural Equation Modeling: A Multidisciplinary Journal, 25(2), 201-213. https://doi.org/10.1080/10705511.2017.1387859
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
