Examining personality psychology to unpack the peer review system: Towards a more diverse,inclusive,and equitable psychological science

Abstract

Peer review serves to evaluate the scientific validity and quality of research by other researchers within the same field. Psychology, like many other disciplines, uses peer review to determine whether researchers’ work is published, where it is published, and in what form. However, the peer review system is imperfect, often perpetuating harm, exclusion, and inequities. We believe these problems hinder psychology from becoming a truly representative and valid science. In this paper, we uncover the historical roots of the peer review system in psychology and describe how these roots persist today. Then, using personality psychology as an exemplar, we leverage a social justice lens to: (1) document key contemporary problems in the peer review system; (2) identify global challenges in peer review; and (3) provide recommendations and guiding questions that might help the field become more equitable, diverse, just, and inclusive. To do so, we draw upon three sources of information: our personal experiences, qualitative and quantitative data from 104 self-identifying personality psychologists, and the prior literature. Ultimately, the goal of this work is to give voice to those who have been harmed in peer review, and to inform how we might reimagine peer review in personality psychology and beyond.

Plain language summary

Peer review is a common part of science and refers to the process in which researchers within the same field evaluate others’ work before it is published. Psychology uses peer review processes to determine whether researchers’ work is published, where it is published, and in what form. However, the peer review system is imperfect and can unfairly exclude or be harmful to some researchers. We believe these problems hinder psychology from becoming a truly diverse, equitable, representative, and valid science. In this paper, we discuss the history of the peer review system, document key problems in the peer review system, and provide solutions that may help minimize the problems and help psychology become more equitable, diverse, and inclusive.

Keywords

peer review personality psychology social justice open science equity

Get full access to this article

View all access options for this article.

References

Adler

J. M.

(2022). The next chapter at PSPR. Personality and Social Psychology Review, 26(2), 87–92. https://doi.org/10.1177/10888683211071122

Allen

Scott

Brand

Hlava

Altman

(2014). Publishing: Credit where credit is due. Nature, 508(7496), 312–313. https://doi.org/10.1038/508312a

Al-Mousawi

(2020, January 31). A brief history of peer review. F1000 Blognetwork. https://blog.f1000.com/2020/01/31/a-brief-history-of-peer-review/

Aly

Colunga

Crockett

M. J.

Goldrick

Gomez

Kung

F. Y.

McKee

P. C.

Pérez

Stilwell

S. M.

Diekman

A. B.

(2023). Changing the culture of peer review for a more inclusive and equitable psychological science. Journal of Experimental Psychology: General, 152(12), 3546–3565. https://doi.org/10.1037/xge0001461

American Psychological Association . (2021). Apology to people of color for APA’s role in promoting, perpetuating, and failing to challenge racism, racial discrimination, and human hierarchy in U.S. American Psychological Association. https://www.apa.org/about/policy/racism-apology

Arao

Clemens

(2013). From safe spaces to brave spaces. In Landreman

L. M.

(Ed.), The art of effective facilitation (pp. 135–150). Routledge. https://doi.org/10.4324/9781003447580-11

Arshad

Chung

J. M.

(2022). Practical recommendations for considering culture, race, and ethnicity in personality psychology. Social and Personality Psychology Compass, 16(2), Article e12656. https://doi.org/10.1111/spc3.12656

Association for Research in Personality . (2023, November). ARP: Dedicated to the multidisciplinary study of personality structure, processes, and development. Association for Research in Personality. https://www.personality-arp.org/

Atherton

O. E.

(2021, July). Deconstructing problematic peer reviews in personality psychology and some calls to action. [Conference presentation]. ARP 2021 Virtual Convention, Evanston, IL. https://www.youtube.com/watch?v=3xiHSWuiFBc&ab_channel=AssociationforResearchinPersonality

10.

Auerbach

(2021, June 03). Decolonial Science: Towards more equitable knowledge practices. University World News. Africa Edition. https://www.universityworldnews.com/post.php?story=20210602122154852

11.

Baldwin

(2020). Peer review. In Encyclopedia of the history of science. Springer. https://doi.org/10.34758/srde-jw27

12.

Barr

(2014). Vascular medicine and surgery in ancient Egypt. Journal of Vascular Surgery, 60(1), 260–263. https://doi.org/10.1016/j.jvs.2014.04.056

13.

Benda

W. G. G.

Engels

T. C. E.

(2011). The predictive validity of peer review: A selective review of the judgmental forecasting qualities of peers, and implications for innovation in science. International Journal of Forecasting, 27(1), 166–182. https://doi.org/10.1016/j.ijforecast.2010.03.003

14.

Bharat

Chenneville

Gabbidon

Foust

(2021). Considerations for psychological research with and for people of color and oppressed intersecting identities in the United States. Translational Issues in Psychological Science, 7(4), 363–377. https://doi.org/10.1037/tps0000285

15.

Bialas

A. J.

Kaczmarski

Kozak

Kempinska-Miroslawska

(2015). Pectus excavatum in relief from Ancient Egypt (dating back to circa 2400 BC). Interactive Cardiovascular and Thoracic Surgery, 20(4), 556–557. https://doi.org/10.1093/icvts/ivu440

16.

Bobowik

Valentim

J. P.

Licata

(2018). Introduction to the special issue: Colonial past and intercultural relations. International Journal of Intercultural Relations, 62, 1–12. https://doi.org/10.1016/j.ijintrel.2017.10.003

17.

Bordier

J. F.

(Director) (2010). People of the Savannah. (Video/DVD) ZED (Film production). https://video.alexanderstreet.com/watch/people-of-the-savannah

18.

Brand

Allen

Altman

Hlava

Scott

(2015). Beyond authorship: Attribution, contribution, collaboration, and credit. Learned Publishing, 28(2), 151–155. https://doi.org/10.1087/20150211

19.

Buchanan

N. T.

Perez

Prinstein

M. J.

Thurston

I. B.

(2021). Upending racism in psychological science: Strategies to change how science is conducted, reported, reviewed, and disseminated. American Psychologist, 76(7), 1097–1112. https://doi.org/10.1037/amp0000905

20.

Carnegie Institution of Washington . (1916, August). The Eugenical News, Vol. I, No. 8. Carnegie Institution of Washington.

21.

Carrero Pinedo

Caso

T. J.

Rivera

R. M.

Carballea

Louis

E. F.

(2022). Black, Indigenous, and trainees of color stress and resilience: The role of training and education in decolonizing psychology. Psychological Trauma: Theory, Research, Practice, and Policy, 14(S1), S140–S147. https://doi.org/10.1037/tra0001187

22.

Causadias

J. M.

Vitriol

J. A.

Atkin

A. L.

(2018). The cultural (mis) attribution bias in developmental psychology in the United States. Journal of Applied Developmental Psychology, 59, 65–74. https://doi.org/10.1016/j.appdev.2018.01.003

23.

Chami

F. A.

Kwekason

(2003). Neolithic pottery traditions from the islands, the coast and the interior of East Africa. African Archaeological Review, 20(2), 65–80. https://doi.org/10.1023/A:1024426830217

24.

Cortina

L. M.

Curtin

Stewart

A. J.

(2012). Where is social structure in personality research? A feminist analysis of publication trends. Psychology of Women Quarterly, 36(3), 259–273. https://doi.org/10.1177/0361684312448056

25.

Csiszar

(2016). Peer review: Troubled from the start. Nature, 532(7599), 306–308. https://doi.org/10.1038/532306a

26.

Davis

A. M.

Ernst

(2017). Racial gaslighting. Politics, Groups, and Identities, 7(4), 761–774. https://doi.org/10.1080/21565503.2017.1403934

27.

Demir

S. B.

(2018). Predatory journals? Who publishes in them and why. Journal of Informetrics, 12(4), 1296–1311. https://doi.org/10.1016/j.joi.2018.10.008

28.

Diop

C. A.

(1989). The African origin of civilization: Myth or reality. In Cook

(Ed.), Chicago Review Press.

29.

Dunbar-Ortiz

(2015). An indigenous peoples’ history of the United States. Beacon Press.

30.

Dutta

(2018). Decolonizing “community” in community psychology. American Journal of Community Psychology, 62(3-4), 272–282. https://doi.org/10.1002/ajcp.12281

31.

Dweck

C. S.

(2017). Is psychology headed in the right direction? Yes, no, and maybe. Perspectives on Psychological Science, 12(4), 656–659. https://doi.org/10.1177/1745691616687747

32.

Elmore

S. A.

Weston

E. H.

(2020). Predatory journals: What they are and how to avoid them. Toxicologic Pathology, 48(4), 607–610. https://doi.org/10.1177/0192623320920209

33.

Elsherif

M. M.

Middleton

S. L.

Phan

J. M.

Azevedo

Iley

B. J.

Grose-Hodge

Tyler

Kapp

S. K.

Gourdon-Kanhukamwe

Grafton-Clarke

Yeung

S. K.

Shaw

J. J.

Hartmann

Dokovova

(2022). Bridging neurodiversity and open scholarship: How shared values can guide best practices for research integrity, social justice, and principled education. MetaArXiv. https://doi.org/10.31222/osf.io/k7a9p

34.

Fanon

(2001). The wretched of the Earth. Les damnés de la terre (C. Farrington, Trans.). Penguin Classics.

35.

Farrell

P. R.

Magida Farrell

Farrell

M. K.

(2017). Ancient texts to PubMed: A brief history of the peer-review process. Journal of Perinatology: Official Journal of the California Perinatal Association, 37(1), 13–15. https://doi.org/10.1038/jp.2016.209

36.

Fish

(2022). Towards a Haudenosaunee developmental science: Perspectives from the two row wampum. Infant and Child Development, 31(1), 1–15. https://doi.org/10.1002/icd.2279

37.

Forscher

P. S.

Basnight-Brown

D. M.

Dutra

Adetula

Silan

Ijzerman

(2021). Psychological science needs the entire globe, part 3: Does psychological science deserve brilliant researchers from outside North America and Europe? APS Observer. https://www.psychologicalscience.org/observer/entire-globe-part-3

38.

Garcia Coll

Lamberty

Jenkins

McAdoo

H. P.

Crnic

Wasik

B. H.

Garcia

H. V.

Lamberty

Wasik

B. H.

Jenkins

Garcia

H. V.

McAdoo

H. P.

(1996). An integrative model for the study of developmental competencies in minority children. Child Development, 67(5), 1891–1914. https://doi.org/10.2307/1131600

39.

Gärtner

Leising

Schönbrodt

F. D.

(2024). Towards responsible research assessment: How to reward research quality. PLoS Biology, 22(2), Article e3002553. https://doi.org/10.1371/journal.pbio.3002553

40.

Gates

H. L.

Jr., (Writer) Quinn

Bates

(Directors) . (February 2017). Origins (season 1, episode 1) [TV series episode]. In Quinn

Bates

(Producers) , In Africa’s great civilizations. Inkwell Films, McGee Media, Kunhardt Films, & WETA. https://www.pbs.org/show/africas-great-civilizations/

41.

Ghai

(2021). It’s time to reimagine sample diversity and retire the WEIRD dichotomy. Nature Human Behaviour, 5(8), 971–972. https://doi.org/10.1038/s41562-021-01175-9

42.

Glassman

(Executive Producer) (2018). Native America. (Documentary). Providence Pictures, Inc.

43.

Gordon

L. R.

(2022). Fear or Black consciousness. Macmillan Audio.

44.

Green

C. D.

Feinerer

(2015). The evolution of The American Journal of Psychology 1, 1887–1903: A network investigation. American Journal of Psychology, 128(3), 387–401. https://doi.org/10.5406/amerjpsyc.128.3.0387

45.

Hall

G. S.

(1881). Aspects of German culture. JR Osgood.

46.

Hall

G. S.

(1903). The white Maw’s burden versus indigenous development of the lower races. Journal of Education, 58(4), 83. https://doi.org/10.1177/002205740305800415

47.

Hall

G. S.

(1905). Adolescence: Its psychology and its relations to physiology, anthropology, sociology, sex, crime, religion and education (Vol. 2). D. Appleton.

48.

Hall

G. S.

(1923). Jesus, the Christ. In The light of psychology. D. Appleton.

49.

Hartmann

W. E.

Kim

E. S.

Kim

J. H. J.

Nguyen

T. U.

Wendt

D. C.

Nagata

D. K.

Gone

J. P.

(2013). In search of cultural diversity, revisited: Recent publication trends in cross-cultural and ethnic minority psychology. Review of General Psychology, 17(3), 243–254. https://doi.org/10.1037/a0032260

50.

Isidro

Herrerin

(2017). Meningeal preservation in a child mummy from Ancient Egypt. World Neurosurgery, 100, 579–582. https://doi.org/10.1016/j.wneu.2017.01.058

51.

Jackson

Z. I.

(2020). Becoming human: Matter and meaning in an antiblack world. NYU Press.

52.

Jeftic

Lucas

M. Y.

Corral-Frias

Azevedo

(2024). Bridging the majority and minority worlds: Liminal researchers as catalysts for inclusive open and big-team science. In Forscher

P. S.

Schmidt

(Eds.), A better how: Notes on developmental meta research (pp. 48–64). Busara. https://doi.org/10.62372/ISCI6112

53.

Kahalon

Klein

Ksenofontov

Ullrich

Wright

S. C.

(2022). Mentioning the sample’s country in the article’s title leads to bias in research evaluation. Social Psychological and Personality Science, 13(2), 352–361. https://doi.org/10.1177/19485506211024036

54.

King

L. S.

(2005). Philomythy: Afrocentric analysis of the plausible Kemetic influences on and resonated Kemetic retentions in Greek creation stories. ProQuest Dissertations Publishing.

55.

Lawson

K. M.

Murphy

B. A.

Azpeitia

Lombard

E. J.

Pope

(2024). Citing decisions in psychology: A roadblock to cumulative and inclusive science. PsyArXiv. https://doi.org/10.31234/osf.io/6kvqg

56.

Lewis

J. E.

Harmand

(2016). An earlier origin for stone tool making: Implications for cognitive evolution and the transition to Homo. Philosophical Transactions of the Royal Society B: Biological Sciences, 371(1698), 20150233. https://doi.org/10.1098/rstb.2015.0233

57.

Manchikanti

Kaye

A. D.

Boswell

M. V.

Hirsch

J. A.

(2015). Medical journal peer review: Process and bias. Pain Physician, 18(1), E1–E14.

58.

Marshall

Reid

R. E. B.

Goldstein

Storozum

Wreschnig

Kiura

Shahack-Gross

Ambrose

S. H.

(2018). Ancient herders enriched and restructured African grasslands. Nature, 561(7723), 387–390. https://doi.org/10.1038/s41586-018-0456-9

59.

Mays

K. T.

(2021). An Afro-indigenous history of the United States. Beacon Press.

60.

McAdams

D. P.

(2012). Exploring psychological themes through life-narrative accounts. In Holstein

J. A.

Gubrium

J. F.

(Eds.), Varieties of narrative analysis (pp. 15–32). Sage Publications. https://doi.org/10.4135/9781506335117.n2

61.

McLean

K. C.

Syed

(2016). Personal, master, and alternative narratives: An integrative framework for understanding identity development in context. Human Development, 58(6), 318–349. https://doi.org/10.1159/000445817

62.

Moffitt

Juang

L. P.

Syed

(2020). Intersectionality and youth identity development research in Europe. Frontiers in Psychology, 11, 78. https://doi.org/10.3389/fpsyg.2020.00078

63.

Moffitt

Katsiaficas

Ghavami

Minor

Padilla

Rogers

L. O.

(2023). Intersectionality and identity: A systematic review and qualitative analysis of U.S. research in psychological science. Identity, 23(4), 288–313. https://doi.org/10.1080/15283488.2023.2223647

64.

Nash

S. E.

(2022, February 21). The story of George McJunkin, a hidden Figure in North American archaeology. Atlas Obscura. https://www.atlasobscura.com/articles/george-mcjunkin-folsom

65.

National Museum of the American Indian . (2009). Haudenosaunee guide for educators. Smithsonian. https://americanindian.si.edu/sites/1/files/pdf/education/HaudenosauneeGuide.pdf

66.

Nosek

B. A.

Alter

Banks

G. C.

Borsboom

Bowman

S. D.

Breckler

S. J.

Buck

Chambers

C. D.

Chin

Christensen

Contestabile

Dafoe

Eich

Freese

Glennerster

Goroff

Green

D. P.

Hesse

Humphreys

Yarkoni

(2015). SCIENTIFIC STANDARDS. Promoting an open research culture. Science, 348(6242), 1422–1425. https://doi.org/10.1126/science.aab2374

67.

Obenga

(1995). A lost tradition: African philosophy in world history. Source Editions.

68.

O’Grady

(2020, October 28). Delete offensive language? Change recommendations? Some editors say it’s OK to alter peer reviews. Science. https://doi.org/10.1126/science.abf4690

69.

Ojelade

I. I.

McCray

Meyers

Ashby

(2014). Use of Indigenous African healing practices as a mental health intervention. Journal of Black Psychology, 40(6), 491–519. https://doi.org/10.1177/0095798414533345

70.

Okazaki

David

E. J. R.

Abelmann

(2008). Colonialism and psychology of culture. Social and Personality Psychology Compass, 2(1), 90–106. https://doi.org/10.1111/j.1751-9004.2007.00046.x

71.

Otele

(2020). African Europeans: An untold history. Hurst.

72.

Oxford University Press . (2005). Peer review. Oxford English Dictionary. https://www.oed.com/dictionary/peer-review_n

73.

Peeples

(2015, February 23). George McJunkin and the discovery that changed American archaeology. Archaeology Southwest. https://www.archaeologysouthwest.org/2015/02/23/george-mcjunkin-and-the-discovery-that-changed-american-archaeology/

74.

Perkins

Jason

L. A.

(2022, March 29). “I’m sorry you feel that way” and other gaslighting tactics. The Mental Health Revolution, Psychology Today. https://www.psychologytoday.com/us/blog/the-mental-health-revolution/202203/i-m-sorry-you-feel-way-and-other-gaslighting-tactics

75.

Pillay

S. R.

(2016). Silence is violence: (critical) psychology in an era of Rhodes must fall and fees must fall. South African Journal of Psychology, 46(2), 155–159. https://doi.org/10.1177/0081246316636766

76.

Quinones-Vidal

Loźpez-García

J. J.

Peñaranda-Ortega

Tortosa-Gil

(2004). The nature of social and personality psychology as reflected in JPSP, 1965–2000. Journal of Personality and Social Psychology, 86(3), 435–452. https://doi.org/10.1037/0022-3514.86.3.435

77.

Raval

V. V.

Baiden

Espinosa-Hernandez

Magis-Weinberg

Nguyen

A. J.

Titzmann

P. F.

Zheng

(2024). Perspectives of researchers engaging in majority world research to promote diverse and global psychological science. American Psychologist, 79(3), 352–367. https://doi.org/10.1037/amp0001229

78.

Reis

H. T.

Stiller

(1992). Publication trends in JPSP: A three-decade review. Personality and Social Psychology Bulletin, 18(4), 465–472. https://doi.org/10.1177/0146167292184011

79.

Roberts

S. O.

(2022). Dealing with diversity in psychology: Science and ideology. PsyArXiv. https://doi.org/10.31234/osf.io/xk4yu

80.

Roberts

S. O.

Bareket-Shavit

Dollins

F. A.

Goldie

P. D.

Mortenson

(2020). Racial inequality in psychological research: Trends of the past and recommendations for the future. Perspectives on Psychological Science, 15(6), 1295–1309. https://doi.org/10.1177/1745691620927709

81.

Rogers

L. O.

Moffitt

McLean

K. C.

Syed

(2024). Research as resistance: Naming and dismantling the master narrative of “good” science. American Psychologist, 79(4), 484–496. https://doi.org/10.1037/amp0001246

82.

Rubin

J. D.

Bell

McClelland

S. I.

(2018). Graduate education in qualitative methods in U.S. psychology: Current trends and recommendations for the future. Qualitative Research in Psychology, 15(1), 29–50. https://doi.org/10.1080/14780887.2017.1392668

83.

Settles

I. H.

Jones

M. K.

Buchanan

N. T.

Dotson

(2021). Epistemic exclusion: Scholar(ly) devaluation that marginalizes faculty of color. Journal of Diversity in Higher Education, 14(4), 493–507. https://doi.org/10.1037/dhe0000174

84.

Shema

(2014, April 19). The birth of modern peer review. Scientific American. https://www.scientificamerican.com/blog/information-culture/the-birth-of-modern-peer-review/

85.

Siegel

J. A.

Calogero

R. M.

Eaton

A. A.

Roberts

T.-A.

(2021). Identifying gaps and building bridges between feminist psychology and open science. Psychology of Women Quarterly, 45(4), 407–411. https://doi.org/10.1177/03616843211044494

86.

Silan

Adetula

Basnight-Brown

D. M.

Forscher

P. S.

Dutra

Ijzerman

, (2021, October 26). Psychological science needs the entire globe, part 2: Let’s talk about the “c” word: Colonialism and the challenges of psychological science in the developing world. APS Observer. https://www.psychologicalscience.org/observer/psychological-science-needs-the-entire-globe-part-2

87.

Smith

L. T.

(2012). Decolonizing methodologies: Research and indigenous peoples (2nd ed.). Zed Books.

88.

Strauss

Gran-Ruaz

Osman

Williams

M. T.

Faber

S. C.

(2023). Racism and censorship in the editorial and peer review process. Frontiers in Psychology, 14, 1120938. https://doi.org/10.3389/fpsyg.2023.1120938

89.

Sweet

P. L.

(2019). The sociology of gaslighting. American Sociological Review, 84(5), 851–875. https://doi.org/10.1177/0003122419874843

90.

Syed

(2017). Why traditional metrics may not adequately represent ethnic minority psychology. Perspectives on Psychological Science, 12(6), 1162–1165. https://doi.org/10.1177/1745691617709590

91.

Syed

(2020). Whither the “white control group”? Benefits of a comparative ethnic minority psychology. PsyArXiv. https://doi.org/10.31234/osf.io/n4p73

92.

Syed

(2021). It’s 2 × 2 designs all the way down: Social psychology’s over-reliance on experiments needlessly restricts diversity in the field. PsyArXiv. https://doi.org/10.31234/osf.io/u89e2

93.

Syed

Kathawalla

U. K.

(2022). Cultural psychology, diversity, and representation in open science. In McLean

K. C.

(Ed.), Cultural methods in psychology: Describing and transforming cultures (pp. 427–454). Oxford University Press. https://doi.org/10.1093/oso/9780190095949.003.0015

94.

Syed

Nelson

S. C.

(2015). Guidelines for establishing reliability when coding narrative data. Emerging Adulthood, 3(6), 375–387. https://doi.org/10.1177/2167696815587648

95.

Tatum

(1992). Talking about race, learning about racism: The application of racial identity development theory in the classroom. Harvard Educational Review, 62(1), 1–25. https://doi.org/10.17763/haer.62.1.146k5v980r703023

96.

Tripp

(2021, December 21). Noisy ideologies—Unpacking assumptions about the significance of diversity [Video]. YouTube. https://www.youtube.com/watch?v=zx_C8NkCryo

97.

Tropini

Finlay

B. B.

Nichter

Melby

M. K.

Metcalf

J. L.

Dominguez-Bello

M. G.

Zhao

McFall-Ngai

M. J.

Geva-Zatorsky

Amato

K. R.

Undurraga

E. A.

Poinar

H. N.

Gilbert

J. A.

(2023). Time to rethink academic publishing: The peer reviewer crisis. mBio, 14(6), Article e0109123. https://doi.org/10.1128/mbio.01091-23

98.

United Nations Development Programme (2010, May). Marginalised minorities in development programming. A UNDP resource guide and toolkit. Democratic Governance Group Bureau for Development Policy. https://www.ohchr.org/sites/default/files/Documents/Issues/Minorities/UNDPMarginalisedMinorities.pdf

99.

Wessells

Kostelny

(2021). Do no harm issues in psychosocial support: Post-tsunami practitioner learning in Sri Lanka. Asian American Journal of Psychology, 12(3), 225–233. https://doi.org/10.1037/aap0000191

100.

West

S. G.

Newsom

J. T.

Fenaughty

A. M.

(1992). Publication trends in JPSP: Stability and change in topics, methods, and theories across two decades. Personality and Social Psychology Bulletin, 18(4), 473–484. https://doi.org/10.1177/0146167292184012

101.

Westberg

D. W.

Lawson

Atherton

Chung

Perkins

(2023, July 20-22). Unpacking the peer review system to build a better personality science. [Conference presentation]. ARP 2023 convention, Evanston, IL, United States.

102.

Wilkerson

(2020). Caste: The origins of our discontents. Random House.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.29 MB