By continuing to focus on the necessity for replication, psychological science misses an important and all-pervasive psychological phenomenon: the impact of social and cultural change on behavior. Or put otherwise, our discipline misinterprets failure to replicate behavioral results if we do not consider that social and cultural change can produce systematic shifts in behavior. Data on the connection between social change and behavioral change point to a new role for “replication”: not to show that results can be duplicated, but to reveal behavioral effects of sociodemographic and cultural change in the intervening years between original and replicated procedure, whether those be surveys, standardized behavioral procedures, or intelligence tests.
AttwoodA. S.WoodsA.EaseyK.Penton-VoakI. S.MunafoM. R. (2015). Replication of study “Perceptual mechanisms that characterize gender differences in decoding women’s sexual intent” by Farris, Treat, Viken, & McFall (2008, Psychological Science, 19, 348–354). In Open Science Collaboration (Eds.), Estimating the reproducibility of psychological science. Science, 349, 4716.
2.
ChenX.CenG.LiD.HeY. (2005). Social functioning and adjustment in Chinese children: The imprint of historical time. Child Development, 76, 182–195.
3.
DaleyT. C.WhaleyS. E.SigmanM. D.EspinosaM. P.NeumannC. (2003). IQ on the rise: The Flynn effect in rural Kenyan children. Psychological Science, 14, 215–219.
4.
DeWallC. N.PondR. S.CampbellW. K.TwengeJ. M. (2011). Tuning in to psychological change: Linguistic markers of psychological traits and emotions over time. Psychology of Aesthetics, Creativity, and the Arts, 5, 200–207.
5.
DonnellyK.TwengeJ. M. (2017). Masculine and feminine traits on the Bem Sex-Role Inventory. Sex Roles, 76, 556–565. doi:10.1007/s11199-016-0625-y
6.
FarrisC.TreatT. A.VikenR. J.McFallR. M. (2008). Perceptual mechanisms that characterize gender differences in decoding women’s sexual intent. Psychological Science, 19, 348–354.
7.
GarciaC.RiveraN.GreenfieldP. M. (2015). The decline of cooperation, the rise of competition: Developmental effects of long-term social change in Mexico. International Journal of Psychology, 50, 6–11.
8.
GentileB.TwengeJ. M.CampbellW. K. (2010). Birth cohort differences in self-esteem, 1988–2008: A cross-temporal meta-analysis. Review of General Psychology, 14, 261–268.
9.
GentileB.TwengeJ. M.FreemanE. C.CampbellW. K. (2012). The effect of social networking websites on positive self-views: An experimental investigation. Computers in Human Behavior, 28, 1929–1933.
10.
GreenfieldP. M. (2009). Linking social change and developmental change: Shifting pathways of human development. Developmental Psychology, 45, 401–418.
11.
GreenfieldP. M. (2013). The changing psychology of culture from 1800 through 2000. Psychological Science, 24, 1722–1731. doi:10.1177/0956797613479387
12.
GreenfieldP. M. (2016). Social change, cultural evolution, and human development. Current Opinion in Psychology, 8, 84–92.
13.
GrossmannI.VarnumM. E. W. (2015). Social structure, infectious diseases, disasters, and cultural change in America. Psychological Science, 26, 311–324. doi:10.1177/0956797614563765
14.
HauserD. J.SchwarzN. (2016). Attentive Turkers: MTurk participants perform better on online attention checks than subject pool participants. Behavior Research Methods, 48, 400–407. doi:10.3758/s13428-015-0578-z
15.
HenrichJ.HeineS. J.NorenzayanA. (2010). The weirdest people in the world?Behavioral and Brain Sciences, 33, 61–83. doi:10.1017/S0140525X0999152X
16.
HolubarT. (2015). Replication of “The rejection of moral rebels” Study 4, by Monin, Sawyer, & Marquez (2008, JPSP). In Open Science Collaboration (Eds.), Estimating the reproducibility of psychological science. Science, 349, 4716.
17.
InbarY. (2016). Association between contextual dependence and replicability in psychology may be spurious. Proceedings of the National Academy of Sciences USA, 113, E4933–E4944.
18.
InglehartR.NorrisP. (2003). Rising tide: Gender equality and cultural change around the world. Cambridge, England: Cambridge University Press.
19.
KagitcibasiC. (2007). Family, self, and human development across cultures: Theory and applications (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.
20.
KesebirP.KesebirS. (2012). The cultural salience of moral character and virtue declined in twentieth century America. Journal of Positive Psychology, 7, 471–480.
21.
KleinO.DoyenS.LeysC.MagahaesdeSaldanhadaGamaP. A.MillerS.QuestienneL.CleeransA. (2012). Low hopes, high expectations: Expectancy effects and the replicability of behavioral experiments. Perspectives on Psychological Science, 7, 572–584.
22.
KonrathT.O’BrienE. H.HsingC. (2011). Changes in dispositional empathy in American college students over time: A meta-analysis. Personality and Social Psychology Review, 15, 180–198.
23.
LeeC. T.BeckertT. E.GoodrichT. R. (2010). The relationship between individualistic, collectivistic, and transitional cultural value orientations and adolescents’ autonomy and identity status. Journal of Youth and Adolescence, 39, 882–893. doi:10.1007/s10964-009-9430-z
24.
LuriaA. R. (1976). Cognitive development: Its cultural and social foundations (ColeM., Ed.; Lopez-MorillasM.SolotaroffL., Trans.). Cambridge, MA: Harvard University Press.
25.
ManagoA. M. (2012). The new emerging adult in Chiapas, Mexico: Perceptions of traditional values and value change among first-generation Maya adolescents. Journal of Adolescent Research, 27, 663–713.
26.
ManagoA. M. (2014). Connecting societal change to value differences across generations: Adolescents, mothers, and grandmothers in a Maya community in Southern Mexico. Journal of Cross-Cultural Psychology, 45, 868–887.
27.
ManagoA. M.GreenfieldP. M. (2011). The construction of independent values among Maya women at the forefront of social change: Four case studies. Ethos, 39, 1–29.
28.
ManagoA. M.GreenfieldP. M.KimJ.WardL. M. (2014). Changing cultural pathways through gender role and sexual development: A theoretical framework. Ethos, 42, 198–221.
29.
ManagoA. M.TaylorT.GreenfieldP. M. (2012). Me and my 400 friends: The anatomy of college students’ Facebook networks, their communication patterns, and well-being. Developmental Psychology, 38, 369–380.
30.
MaynardA. E.GreenfieldP. M.ChildsC. P. (2015). Developmental effects of economic and educational change: Cognitive representation across 43 years in a Maya community. International Journal of Psychology, 50, 12–19.
31.
MoninB.SawyerP. J.MarquezM. J. (2008). The rejection of moral rebels: Resenting those who do the right thing. Journal of Personality and Social Psychology: Interpersonal Relations and Group Processes, 95, 76–93.
32.
OishiS.GrahamJ.KesebirS.GalinhaI. C. (2013). Concepts of happiness across time and cultures. Personality and Social Psychology Bulletin, 39, 559–577. doi:10.1177/0146167213480042
33.
Open Science Collaboration. (Eds.). (2015). Estimating the reproducibility of psychological science. Science, 349, 4716. doi:10.1126/science.aac.4716
34.
OrtnerS. B. (2003). New Jersey dreaming: Capital, culture, and the class of ’58. Durham, NC: Duke University Press.
35.
OysermanD.CoonH. M.KemmelmeierM. (2002). Rethinking individualism and collectivism: Evaluation of theoretical assumptions and meta-analyses. Psychological Bulletin, 128, 3–72. doi:10.1037/0033-2909.128.1.3
36.
ParkH.TwengeJ. M.GreenfieldP. M. (2014). The Great Recession: Implications for adolescent values and behavior. Social Psychological and Personality Science, 5, 310–318. doi:10.1177/1948550613495419
37.
PashlerH.HarrisC. R. (2012). Is the replicability crisis overblown? Three arguments examined. Perspectives on Psychological Science, 7, 531–536.
38.
PashlerH.WagenmakersE. J. (2012). Editors’ introduction to the special section on replicability in psychological science a crisis of confidence?Perspectives on Psychological Science, 7, 528–530.
39.
RedfieldR. (1941). The folk culture of Yucatan. Chicago, IL: University of Chicago Press.
40.
ShermanL. E.MichikyanM.GreenfieldP. M. (2013). The effects of text, audio, video, and in-person communication on bonding between friends. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 7(2), Article 3. doi:10.5817/CP2013-2-3
41.
TönniesF. (1955). Community and society (LoomisC. P., Trans.). London, England: Routledge & Kegan Paul. (Original work published 1887)
42.
TwengeJ. M. (2015). The age in which we live and its impact on the person. In ReynoldsK. J.BranscombeN. R. (Eds.), Psychology of change: Life contexts, experiences, and identities (pp. 44–58). New York, NY: Psychology Press.
43.
TwengeJ. M.CampbellW. K. (2001). Age and birth-cohort differences in self-esteem: A cross-temporal meta-analysis. Personality and Social Psychology Review, 5, 321–344.
44.
TwengeJ. M.CampbellW. K. (2008). Increases in positive self-views among high school students: Birth cohort changes in anticipated performance, self-satisfaction, self-liking, and self-confidence. Psychological Science, 19, 1082–1086.
45.
TwengeJ. M.CampbellW. K.FreemanE. C. (2012). Generational differences in young adults life goals, concern for others, and civic orientation, 1966–2009. Journal of Personality and Social Psychology, 102, 1045–1062.
46.
TwengeJ. M.CampbellW. K.GentileB. (2012a). Generational increases in agentic self-evaluations among American college students, 1966–2009. Self and Identity, 11, 409–427.
47.
TwengeJ. M.CampbellW. K.GentileB. (2012b). Increases in individualistic words and phrases in American books, 1960–2008. PLoS ONE, 7, e40181.
48.
TwengeJ. M.CarterN. T.CampbellW. K. (2015). Time period, generational, and age differences in tolerance for controversial beliefs and lifestyles in the United States, 1972–2012. Social Forces, 94, 379–399.
49.
TwengeJ. M.FosterJ. D. (2010). Birth cohort increases in narcissistic personality traits among American college students, 1982–2009. Social Psychological and Personality Science, 1, 99–106.
50.
TwengeJ. M.ShermanR. A.WellsB. E. (2015). Changes in American adults’ sexual behavior and attitudes, 1972–2012. Archives of Sexual Behavior, 44, 2273–2285.
51.
UhlsY. T.GreenfieldP. M. (2011). The rise of fame: An historical content analysis. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 5(1), Article 1.
52.
UhlsY. T.GreenfieldP. M. (2012). The value of fame: Preadolescent perceptions of popular media and their relationship to future aspirations. Developmental Psychology, 48, 315–326.
53.
UhlsY. T.MichikyanM.MorrisJ.GarciaD.SmallG. W.ZgourouE.GreenfieldP. M. (2014). Five days at outdoor education camp without screens improves preteen skills with nonverbal emotion cues. Computers in Human Behavior, 39, 387–392.
54.
UhlsY. T.ZgourouE.GreenfieldP. M. (2014). 21st century media, fame, and other future aspirations: A national survey of 9-15 year olds. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 8(4), Article 5.
55.
U.S. Census Bureau. (1992). 1990 census of population: Social and economic characteristics, United States (Table 1, p. 1). Washington, DC: Government Printing Office.
56.
U.S. Census Bureau. (2004). 2000 census of population and housing: United States summary: 2000: Population and housing counts (Table 3, p. 35). Washington, DC: Government Printing Office.
57.
Van BavelJ. J.Mende-SiedleckiP.BradyW. J.ReineroD. A. (2016a). Contextual sensitivity in scientific reproducibility. Proceedings of the National Academy of Sciences USA, 113, 6454–6459.
58.
Van BavelJ. J.Mende-SiedleckiP.BradyW. J.ReineroD. A. (2016b). Reply to Inbar: Contextual sensitivity helps explain the reproducibility gap between social and cognitive psychology. Proceedings of the National Academy of Sciences USA, 113, E4935–E4936. doi:10.1073/pnas.1609700113
59.
VarnumM. E. W.GrossmannI. (2016). Pathogen prevalence is associated with cultural changes in gender equality. Nature Human Behavior, 1, Article 0003.
60.
WeinstockM.GanayiemM.IgbariyaR.ManagoA. M.GreenfieldP. M. (2014). Societal change and values in Arab communities in Israel: Intergenerational and rural-urban comparisons. Journal of Cross-Cultural Psychology, 46, 19–38. doi:10.1177/00220221/1455/792
61.
WinermanL. (2016). How much of the psychology literature is wrong?Monitor on Psychology, 47, 14–16.
62.
ZengR.GreenfieldP. M. (2015). Cultural evolution over the last 40 years in China: Using the Google Ngram Viewer to study implications of social and political change for cultural values. International Journal of Psychology, 50, 47–55.
