The Index of Race-Related Stress-Brief: Further Validation,Cross-Validation,and Item Response Theory-Based Evidence

Abstract

The Index of Race-Related Stress-Brief (IRRS-B) is one of the most widely used measures to assess race-related stress among Black Americans. Despite a long history of use in research and clinical settings, there has been limited scholarship examining the factor structure of the IRRS-B. In this study, we evaluated the item functioning and structural performance of the IRRS-B scores in a nationally recruited sample of Black Americans using item response and confirmatory factor analyses. Item-level analyses illustrated that items on the IRRS-B, in general, tended to be most informative at moderate levels of the latent construct. The proposed three-factor structure yielded a comparable fit to the data in a validation and a cross-validation subsample but did not meet recommended cutoff values for adequate model fit. Findings are discussed in terms of the implications for future use of the IRRS-B in research and clinical contexts.

Keywords

Get full access to this article

View all access options for this article.

References

Bagozzi

Heatherton

(1994) A general approach to representing multifaceted personality constructs: Application to state self-esteem. Structural Equation Modeling: A Multidisciplinary Journal, 1, 35–67. https://doi.org/10.1080/10705519409539961

Baldwin

Jackson

Okoh

Cannon

(2011). Resiliency and optimism: An African American senior citizen’s perspective. Journal of Black Psychology, 37(1), 24-41. https://doi.org/10.1177/0095798410364394

Benson

(1998). Developing a strong program of construct validation: A test anxiety example. Educational Measurement: Issues and Practice, 17(1), 10-17. https://doi.org/10.1111/j.1745-3992.1998.tb00616.x

Bentley-Edwards

K. L.

Chapman-Hilliard

(2015). Doing race in different places: Black racial cohesion on Black and White college campuses. Journal of Diversity in Higher Education, 8(1), 43–60. https://doi.org/10.1037/a0038293

Bollen

K. A.

Long

J. S.

(1993). Testing structural equation models. Sage.

Bonilla

Rosa

(2015). #Ferguson: Digital protest, hashtag ethnography, and the racial politics of social media in the United States. American Ethnologist, 42(1), 4-17. https://doi.org/10.1111/amet.12112

Carter

R. T.

Reynolds

A. L.

(2011). Race-related stress, racial identity status attitudes, and emotional reactions of Black Americans. Cultural Diversity & Ethnic Minority Psychology, 17(2), 156-162. https://doi.org/10.1037/a0023358

Case

A. D.

Hunter

C. D.

(2014). Cultural racism-related stress in Black Caribbean immigrants: Examining the predictive roles of length of residence and racial identity. Journal of Black Psychology, 40(5), 410-423. https://doi.org/10.1177/0095798413493926

Charter

R. A.

(2003). A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability. Journal of General Psychology, 130(3), 290-304. https://doi.org/10.1080/00221300309601160

10.

Clark

L. A.

Watson

(2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412-1427. https://doi.org/10.1037/pas0000626

11.

Cokley

Awosogba

Taylor

(2014). A 12-year content analysis of the Journal of Black Psychology (2000-2011): Implications for the field of Black psychology. Journal of Black Psychology, 40(3), 215-238. https://doi.org/10.1177/0095798413486157

12.

Cruz

(2011). The psychological correlates of race-related stress and health among African-Americans and Latinos [Doctoral dissertation, Seton Hall University Dissertations and Theses]. Seton Hall University. https://scholarship.shu.edu/dissertations/1649

13.

Dailey

A. B.

Kasl

S. V.

Holford

T. R.

Lewis

T. T.

Jones

B. A.

(2010). Neighborhood- and individual-level socioeconomic variation in perceptions of racial discrimination. Ethnicity & Health, 15(2), 145-163. https://doi.org/10.1080/13557851003592561

14.

DeVellis

R. F.

(2012). Scale development: Theory and applications (3rd ed.). Sage.

15.

Driscoll

M. W.

Reynolds

J. R.

Todman

L. C.

(2015). Dimensions of race-related stress and African American life satisfaction: A test of the protective role of collective efficacy. Journal of Black Psychology, 41(5), 462-486. https://doi.org/10.1177/0095798414543690

16.

Essed

(1990). Everyday racism: Reports from women of two cultures. Hunter House.

17.

Ferguson

C. J.

(2009). An effect size primer: A guide for clinicians and researchers. Professional Psychology: Research and Practice, 40(5), 532-538. https://doi.org/10.1037/a0015808

18.

Fine

Freudenberg

Payne

Perkins

Smith

Wanzer

(2003). “Anything can happen with police around”: Urban youth evaluate strategies of surveillance in public places. Journal of Social Issues, 59(1), 141-158. https://doi.org/10.1111/1540-4560.t01-1-00009

19.

Fox-Williams

B. N.

(2019). The rules of (dis)engagement: Black youth and their strategies for navigating police contact. Sociological Forum, 34(1), 115-137. https://doi.org/10.1111/socf.12484

20.

Franklin

D. C.

(2002). Racism related stress, racial identity and psychological health for Blacks in America. Dissertation Abstracts International: Section B. Sciences and Engineering, 63(3-B), Article 1608.

21.

Franklin-Jackson

Carter

R. T.

(2007). The relationships between race-related stress, racial identity, and mental health for Black Americans. Journal of Black Psychology, 33(1), 5-26. https://doi.org/10.1177/0095798406295092

22.

George

Mallery

. (2003). SPSS for Windows step by step: A simple guide and reference. 11.0 update (4th ed.). Allyn & Bacon.

23.

Gold

M. S.

Bentler

P. M.

(2000). Treatments of missing data: A Monte Carlo comparison of RBHDI, iterative stochastic regression imputation, and expectation-maximization. Structural Equation Modeling, 7(3), 319-355. https://doi.org/10.1207/S15328007SEM0703_1

24.

Greer

T. M.

(2011). Coping strategies as moderators of the relation between individual race-related stress and mental health symptoms for African American women. Psychology of Women Quarterly, 35(2), 215-226. https://doi.org/10.1177/0361684311399388

25.

Greer

T. M.

Brondolo

Brown

(2013). Systemic racism moderates effects of provider racial biases on adherence to hypertension treatment for African Americans. Health Psychology, 33(1), 35-42. https://doi.org/10.1037/a003277

26.

Greer

T. M.

Laseter

Asiamah

(2009). Gender as a moderator of the relation between race-related stress and mental health symptoms for African Americans. Psychology of Women Quarterly, 33(3), 295-307. https://doi.org/10.1177/036168430903300305

27.

Harrell

S. P.

(1995). The Racism and Life Experience Scales-Brief version [Unpublished manuscript].

28.

Harrell

S. P.

(2000). A multidimensional conceptualization of racism-related stress: Implications for the well-being of People of Color. American Journal of Orthopsychiatry, 70(1), 42-57. https://doi.org/10.1037/h0087722

29.

Hokett

Duarte

(2019). Age and race-related differences in sleep discontinuity linked to associative memory performance and its neural underpinnings. Frontiers in Human Neuroscience, 13(176), 1-9. https://doi.org/10.3389/fnhum.2019.00176

30.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

31.

Hunter

C. D.

Case

A. D.

Joseph

Mekawi

Bokhari

(2017). The roles of shared racial fate and a sense of belonging with African Americans in Black immigrants’ race-related stress and depression. Journal of Black Psychology, 43(2), 135-158. https://doi.org/10.1177/0095798415627114

32.

IBM Corp. (2015). IBM SPSS statistics for Windows, Version 23.0. Author.

33.

Johnson

S. C.

Arbona

(2006). The relation of ethnic identity, racial identity, and race-related stress among African-American college students. Journal of College Student Development, 47(5), 495-507. https://doi.org/10.1353/csd.2006.0057

34.

Jones

J. M.

(1972). Prejudice and racism. Addison-Wesley.

35.

Joseph

Kuo

B. C.

(2009). Black Canadians’ coping responses to racial discrimination. Journal of Black Psychology, 35(1), 78-101. https://doi.org/10.1177/0095798408323384

36.

Keum

B. T.

Miller

M. J.

(2017). Racism in digital era: Development and initial validation of the Perceived Online Racism Scale (PORS v1.0). Journal of Counseling Psychology, 64(3), 310-324. https://doi.org/10.1037/cou0000205

37.

Keum

B. T.

Miller

M. J.

(2018). Racism on the internet: Conceptualization and recommendations for research. Psychology of Violence, 8(6), 782-791. https://doi.org/10.1037/vio0000201

38.

Kline

R. B.

(2011). Methodology in the Social Sciences. Principles and practice of structural equation modeling (3rd ed.). Guilford Press.

39.

Lazarus

R. S.

Folkman

(1984). Stress, appraisal, and coping. Springer.

40.

Lewis-Coles

M. E.

Constantine

M. G.

(2006). Racism-related stress, Africultural coping, and religious problem-solving among African Americans. Cultural Diversity & Ethnic Minority Psychology, 12(3), 334-346. https://doi.org/10.1037/1099-9809.12.3.433

41.

Little

R. J. A.

(1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198-1202. https://doi.org/10.1080/01621459.1988.10478722

42.

MacCallum

R. C.

(1995). Model specification: Procedures, strategies, and related issues. In Hoyle

R. H.

(Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 16-36). Sage.

43.

Matsueda

R. L.

Drakulich

(2009). Perceptions of criminal injustice, symbolic racism, and racial politics. Annals of the American Academy of Political and Social Science, 623(1), 163-178. https://doi.org/10.1177/0002716208330500

44.

Morling

(2012). Research methods in psychology: Evaluating a world of information. Norton.

45.

Mullins

(2012). Social and academic integration: Racial and cultural factors of African American college students [Doctoral dissertation]. ProQuest Dissertations and Theses database. (UMI No. 3477711)

46.

NPR, Robert Wood Johnson Foundation, & Harvard T. H. Chan School of Public Health. (2017). Discrimination in America: Experiences and views of African Americans. https://www.rwjf.org/en/library/research/2017/10/discrimination-in-america—experiences-and-views.html

47.

Odafe

M. O.

Salami

T. K.

Walker

R. L.

(2017). Race-related stress and hopelessness in community-based African American adults: Moderating role of social support. Cultural Diversity & Ethnic Minority Psychology, 23(4), 561-569. https://doi.org/10.1037/cdp0000167

48.

Perry

B. L.

Pullen

E. L.

Oser

C. B.

(2012). Too much of a good thing? Psychosocial resources, gendered racism, and suicidal ideation among low socioeconomic status African American women. Social Psychology Quarterly, 75(4), 334-359. https://doi.org/10.1177/0190272512455932

49.

Pieterse

A. L.

Todd

N. R.

Neville

H. A.

Carter

R. T.

(2012). Perceived racism and mental health among Black American adults: A meta-analytic review. Journal of Counseling Psychology, 59(1), 1-9. https://doi.org/10.1037/a0026208

50.

Pittman

Cho Kim

Hunter

Obasi

Pittman

(2017). The role of minority stress in second-generation Black emerging adult college students’ high-risk drinking behaviors. Cultural Diversity & Ethnic Minority Psychology, 23(3), 445-455. https://doi.org/10.1037/cdp0000135

51.

Pituch

K. A.

Stevens

J. P.

(2015). Applied multivariate statistics for the social sciences: Analyses with SAS and IBM’s SPSS. Routledge.

52.

Ponterotto

J. G.

Ruckdeschel

D. E.

(2007). An overview of coefficient alpha and a reliability matrix for estimating adequacy of internal consistency coefficients with psychological research measures. Perceptual and Motor Skills, 105(3), 997-1014. https://doi.org/10.2466/pms.105.3.997-1014

53.

Raykov

(2007). Reliability if deleted, not ‘alpha if deleted’: Evaluation of scale reliability following component deletion. British Journal of Mathematical and Statistical Psychology, 60(2), 201–216. https://doi.org/10.1348/000711006X115954

54.

Schlomer

G. L.

Bauman

Card

N. A.

(2010). Best practices for missing data management in counseling psychology. Journal of Counseling Psychology, 57(1), 1-10. https://doi.org/10.1037/a0018082

55.

Schmitt

Branscombe

Kobrynowicz

Owen

(2002). Perceiving discrimination against one’s gender group has different implications for well-being in women and men. Personality and Social Psychology Bulletin, 28(2), 197-210. https://doi.org/10.1177/0146167202282006

56.

Schreiber

J. B.

Stage

F. K.

King

Nora

Barlow

E. A.

(2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. Journal of Educational Research, 99(6), 323-337. https://doi.org/10.3200/joer.99.6.323-338

57.

Seaton

(2003). An examination of the factor structure of the Index of Race-Related Stress among a sample of African American adolescents. Journal of Black Psychology, 29(3), 292-307. https://doi.org/10.1177/0095798403254211

58.

Stevens

J. P.

(2009). Applied multivariate statistics for the social sciences (5th ed.). Routledge.

59.

Stevens-Watkins

Brown-Wright

Tyler

(2011). Brief report: The number of sexual partners and race-related stress in African American adolescents—preliminary findings. Journal of Adolescence, 34(1), 191-194. https://doi.org/10.1016/j.adolescence.2010.02.003

60.

Swank

J. M.

Mullen

P. R.

(2017). Evaluating evidence for conceptually related constructs using bivariate correlations. Measurement and Evaluation in Counseling and Development, 50(4), 270-274. https://doi.org/10.1080/07481756.2017.1339562

61.

Szymanski

D. M.

Lewis

(2015). Race-related stress and racial identity as predictors of African American activism. Journal of Black Psychology, 41(2), 170-191. https://doi.org/10.1177/0095798414520707

62.

Tabachnick

B. G.

Fidell

L. S.

(2007). Using multivariate statistics (5th ed.). Allyn & Bacon.

63.

Tynes

B. M.

Umaña-Taylor

A. J.

Rose

C. A.

Lin

Anderson

C. J.

(2012). Online racial discrimination and the protective function of ethnic identity and self-esteem for African American adolescents. Developmental Psychology, 48(2), 343-355. https://doi.org/10.1037/a0027032

64.

Umaña-Taylor

A. J.

Tynes

B. M.

Toomey

R. B.

Williams

D. R.

Mitchell

K. J.

(2015). Latino adolescents’ perceived discrimination in online and offline settings: An examination of cultural risk and protective factors. Developmental Psychology, 51(1), 87-100. https://doi.org/10.1037/a0038432

65.

Utsey

S. O.

(1998). Assessing the stressful effects of racism: A review of instrumentation. Journal of Black Psychology, 24(3), 269-288. https://doi.org/10.1177/00957984980243001

66.

Utsey

S. O.

(1999). Development and validation of a short form of the Inventory of Race-Related Stress (IRRS)-Brief Version. Measurement and Evaluation in Counseling and Development, 32(3), 149-167. https://doi.org/10.1080/07481756.1999.12068981

67.

Utsey

S. O.

Belvet

Hubbard

R. R.

Fischer

N. L.

Opare-Henaku

Gladney

L. L.

(2013). Development and validation of the Prolonged Activation and Anticipatory Race-Related Stress Scale. Journal of Black Psychology, 39(6), 532-559. https://doi.org/10.1177/0095798412461808

68.

Utsey

S. O.

Giesbrecht

Hook

Stanard

P. M.

(2008). Cultural, sociofamilial, and psychological resources that inhibit psychological distress in African Americans exposed to stressful life events and race-related stress. Journal of Counseling Psychology, 55(1), 49-62. https://doi.org/10.1037/0022-0167.55.1.49

69.

Utsey

S. O.

Hook

J. N.

(2007). Heart rate variability as a physiological moderator of the relationship between race-related stress and psychological distress in African Americans. Cultural Diversity & Ethnic Minority Psychology, 13(3), 250-253. https://doi.org/10.1037/1099-9809.13.3.250

70.

Utsey

S. O.

Lanier

William

Bolden

Lee

(2006). Moderator effects of cognitive ability and social support on the relation between race-related stress and quality of life in a community sample of Black Americans. Cultural Diversity & Ethnic Minority Psychology, 12(2), 334-346. https://doi.org/10.1037/1099-9809.12.2.334

71.

Utsey

S. O.

Ponterotto

J. G.

(1996). Development and validation of the Index of Race-Related Stress (IRRS). Journal of Counseling Psychology, 43(4), 490-501. https://doi.org/10.1037/0022-0167.43.4.490

72.

Vandiver

Fhagen-Smith

Cokley

Cross

Worrell

(2001). Cross’s Nigrescence model: From theory to scale to theory. Journal of Multicultural Counseling and Development, 29(3), 174-200. https://doi.org/10.1002/j.2161-1912.2001.tb00516.x

73.

White

S. M.

(2014). Resilience differences of Black Greek-lettered organization members and African American students at predominately white institutions [Doctoral dissertation, Scholarship]. East Carolina University. http://hdl.handle.net/10342/4337

74.

Yoo

H. C.

Pituc

S. T.

(2013). Assessments of perceived racial stereotypes, discrimination, and racism. In Geisinger

K. F.

Bracken

B. A.

Carlson

J. F.

Hansen

J.-I. C.

Kuncel

N. R.

Reise

S. P.

Rodriguez

M. C.

(Eds.), APA handbook of testing and assessment in psychology, Vol. 2: Testing and assessment in clinical and counseling psychology (pp. 427-451). American Psychological Association.