Cross-cultural Validation of Achievement Motivation and General Mattering Measures in Latinx Culture

Abstract

The purpose of this study was to evaluate the psychometric evidence for Achievement Motivation and General Mattering scores among Latinx college students in Mexico and the United States based on degree of measurement invariance. Validating instruments in cross-cultural contexts is essential to ensure that psychological constructs are measured reliably across populations with distinct cultural experiences, such as family dynamics, schooling, mental health, and acculturation. A total of 505 participants, with 263 from Mexico and 242 from the United States, participated in the study (U.S. sample: 71.9% female, ages 18–57, M = 23.65; Mexican sample: 55.9% female, ages 15–56, M = 26.69). The results indicated that the Spanish version of the Achievement Motivation scale had partial strict invariance, and the General Mattering scale had metric invariance when used with these two groups of Spanish-speaking Latinx college students. This study highlighted the need of using accurate, trustworthy, and culturally sensitive measures to comprehend the psychological experiences of Latinx college students.

Keywords

achievement motivation general mattering instrument validation measurement invariance Latinx

Get full access to this article

View all access options for this article.

References

Aguirre-Zazueta

A. G.

Ontiveros-Herrera

(2024). Motivación escolar y desempeño académico en estudiantes de Enfermería en Culiacán Sinaloa México [School motivation and academic performance in nursing students in Culiacán, Sinaloa, Mexico]. Revista De educación Y Cuidado Integral En enfermería Facultad Enfermería Culiacán, 1(1), 59–66. https://orcid.org/0000-0003-4329-3707

Alschuler

Irons

R. B.

(1973). Motivating adolescents’ achievements. Urban Education, 7(4), 323–340. https://doi.org/10.1177/004208597300700403

American Educational Research Association, American Psychological Association, & National Council of Measurement in Education. (2014). Standards for educational and psychological testing. Author.

Atik

Karaman

M. A.

Sari

H. I.

(2024). Examining the relationship between emotional intelligence, achievement motivation, and self-efficacy among pre-service teachers in Türkiye. Education Sciences, 14(5), 1–13. https://doi.org/10.3390/educsci14050526

Bataeva

E. V.

(2018). Motivational content analysis of primary school textbooks on literature in context of d. Mcclelland’s theory. The Education and Science Journal, 20(1), 136–151. https://doi.org/10.17853/1994-5639-2018-1-136-151

Castro

Pablo Doncel

Ledesma

R. D.

Montes

S. A.

Daniela Barragan

Oviedo-Trespalacios

Bianchi

Kauer

Padilla

J.-L.

(2024). Measurement invariance of the driving inattention scale (ARDES) across 7 countries. Accident Analysis and Prevention, 195, 107412. https://doi.org/10.1016/j.aap.2023.107412

Cavazos

A. G.

Karaman

M. A.

(2023). A preliminary development and validation of the translingual disposition questionnaire with Latinx students. Language Awareness, 32(1), 58–73. https://doi.org/10.1080/09658416.2021.1960557

Cervantes Arreola

D. I.

Valadez Sierra

M. D.

Valdés Cuervo

A. A.

Tánori Quintana

(2018). Diferencias en autoeficacia académica, bienestar psicológico y motivación al logro en estudiantes universitarios con alto y bajo desempeño académico. Psicología desde el Caribe, 35(1), 7–17.

Chen

C. C.

Lau

J. M.

Richardson

G. B.

Dai

C. L.

(2020). Measurement invariance testing in counseling. Journal of Professional Counseling: Practice, Theory, & Research, 47(2), 89–104. https://doi.org/10.1080/15566382.2020.1795806

10.

Chen

F. F.

(2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834

11.

Chen

S. Y.

(2015). The role of achievement motivations and achievement goals in Taiwanese college students' cognitive and psychological outcomes. Journal of College Student Development, 56(4), 397–412. https://doi.org/10.1353/csd.2015.0040

12.

Cienfuegos-Martínez

Y. I.

Saldívar-Garduño

Díaz-Loving

Avalos-Montoya

A. D.

(2016). Individualismo y colectivismo: Caracterización y diferencias entre dos localidades Mexicanas [Individualism and collectivism: Characterization and differences in two Mexican localities]. Acta de Investigación Psicológica, 6(3), 2534–2543.

13.

Cuellar

Arnold

Maldonado

(1995). Acculturation rating scale for Mexican Americans-ii: A revision of the original ARSMA scale. Hispanic Journal of Behavioral Sciences, 17(3), 275–304. https://doi.org/10.1177/07399863950173001

14.

Deckard

F. M.

Goosby

B. J.

Cheadle

J. E.

(2022). Debt stress, college stress: Implications for Black and Latinx students’ mental health. Race and Social Problems, 14(3), 238–253. https://doi.org/10.1007/s12552-021-09346-z

15.

Díaz Gaspar

Carmona García

Reyes Félix

(2024). Hábitos de estudio y motivación en estudiantes de licenciatura en una Universidad Pública [Study habits and motivation on bachelor’s degree students at a public university]. Ciencia Latina Revista Científica Multidisciplinar, 8(3), 5534–5552. https://doi.org/10.37811/cl_rcm.v8i3.11756.

16.

Dueñas

Gloria

A. M.

(2017). ¿Pertenezco a esta universidad?: The mediating role of belonging for collective self-esteem and mattering for Latin@ undergraduates. Journal of College Student Development, 58(6), 891–906. https://doi.org/10.1353/csd.2017.0070

17.

Dueñas

Gloria

A. M.

(2020). ¡Pertenecemos y tenemos importancia aquí! Exploring sense of belonging and mattering for first-generation and continuing-generation Latinx undergraduates. Hispanic Journal of Behavioral Sciences, 42(1), 95–116. https://doi.org/10.1177/0739986319899734

18.

Elfreich

(2019). From silence to stillness: Decolonial feminist ontologies and the mattering of history in educational research. International Journal of Qualitative Studies in Education, 32(1), 47–66. https://doi.org/10.1080/09518398.2018.1530396

19.

Elliott

G. C.

Cunningham

S. M.

Colangelo

Gelles

R. J.

(2011). Perceived mattering to the family and physical violence within the family by adolescents. Journal of Family Issues, 32(8), 1007–1029. https://doi.org/10.1177/0192513X11398932

20.

Elliott

Kao

Grant

A. M.

(2004). Mattering: Empirical validation of a social-psychological concept. Self and Identity, 3(4), 339–354. https://doi.org/10.1080/13576500444000119

21.

Elliott

J. G.

Bempechat

(2002). The culture and contexts of achievement motivation. New Directions for Child and Adolescent Development, 2002(96), 7–26. https://doi.org/10.1002/cd.41

22.

France

M. K.

Finney

S. J.

(2009). What matters in the measurement of mattering? A construct validity study. Measurement and Evaluation in Counseling and Development, 42(2), 104–120. https://doi.org/10.1177/0748175609336863

23.

Gizdarska

(2017). Achievement motivation in Hispanic university students: Associations with reasons for attending college [MA Thesis, Appalachian State University]. https://libres.uncg.edu/ir/listing.aspx?id=21747

24.

Gloria

A. M.

Castellanos

(2012). Desafíos y Bendiciones. Journal of Hispanic Higher Education, 11(1), 82–99. https://doi.org/10.1177/1538192711430382

25.

Gonzalez

(2024). Increasing Latino student college enrollment; a marketing perspective. Journal of Latinos and Education, 23(5), 1719–1816. https://doi.org/10.1080/15348431.2024.2333885

26.

Haktanir

Lenz

A. S.

Can

Watson

J. C.

(2016). Development and evaluation of Turkish language versions of three positive psychology assessments. International Journal for the Advancement of Counselling, 38(4), 286–297. https://doi.org/10.1007/s10447-016-9272-9

27.

Herrero

D. M.

(2014). The relationship among achievement motivation, hope, and resilience and their effects on academic achievement among first-year college students enrolled in a Hispanic-serving institution [PhD dissertation, Texas A&M University-Corpus Christi]. https://tamucc-ir.tdl.org/tamucc-ir/bitstream/handle/1969.6/601/Herrero%20Diane%20diss.pdf%3bsequence=3

28.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

29.

Ibañez

G. E.

Kuperminc

G. P.

Jurkovic

Perilla

(2004). Cultural attributes and adaptations linked to achievement motivation among Latino adolescents. Journal of Youth and Adolescence, 33(6), 559–568. https://doi.org/10.1023/b:joyo.0000048069.22681.2c

30.

Jorgensen

T. D.

Pornprasertmanit

Schoemann

A. M.

Rosseel

(2020). semTools: Useful tools for structural equation modeling [Computer software manual]. https://cran.r-project.org/package=semTools (R package version 0.5-3).

31.

Karaman

M. A.

Smith

Rasheed

Akkurt

M. N.

Adame

Karadaş

(2017, July 28). Achievement motivation in the cultural context [Paper presentation]. International Society for the Study of Individual Differences Conference, Warsaw, Poland.

32.

Karaman

M. A.

(2023). Comparison of levels of bullying, achievement motivation and resilience among Syrian refugee students and Turkish students. Journal of Psychologists and Counsellors in Schools, 33(1), 62–77. https://doi.org/10.1017/jgc.2021.22

33.

Karaman

M. A.

Cavazos Vela

Aguilar

A. A.

Saldana

Montenegro

M. C.

(2019). Psychometric properties of U.S.-Spanish versions of the grit and resilience scales with a Latinx population. International Journal for the Advancement of Counseling, 41(1), 125–136. https://doi.org/10.1007/s10447-018-9350-2

34.

Karaman

M. A.

Vela

J. C.

Garcia

(2020). Do hope and meaning of life mediate resilience and life satisfaction among Latinx students? British Journal of Guidance & Counselling, 48(5), 685–696. https://doi.org/10.1080/03069885.2020.1760206

35.

Karaman

M. A.

Watson

J. C.

(2017). Examining associations among achievement motivation, locus of control, academic stress, and life satisfaction: A comparison of U.S. And international undergraduate students. Personality and Individual Differences, 111, 106–110. https://doi.org/10.1016/j.paid.2017.02.006

36.

Kwak

Taylor

Z. E.

Anaya

L. Y.

Feng

Evich

C. D.

Jones

B. L.

(2017). Cumulative family stress and diurnal cortisol responses in Midwest Latino families. Hispanic Journal of Behavioral Sciences, 39(1), 82–97. https://doi.org/10.1177/0739986316684130

37.

Lenz

A. S.

Burgess

(2023). Psychometric evidence and measurement invariance for Georgia brief school climate inventory scores from a predominately Hispanic rurally-located sample. Measurement and Evaluation in Counseling and Development, 56(1), 1–12. https://doi.org/10.1080/07481756.2021.2018659

38.

Lenz

A. S.

Gerlach

Dell’Aquila

Pester

(2020). A mixed-methodological evaluation of a subjective well-being intervention program with elementary-age students. Journal of Counseling & Development, 98(2), 200–206. https://doi.org/10.1002/jcad.12314

39.

Leyva-Moral

J. M.

Aguayo-Gonzalez

Palmieri

P. A.

Guevara-Vasquez

Granel-Grimenez

Dalfó-Pibernat

(2021). Attitudes and beliefs of nurses and physicians about managing sexual health in primary care: A multi-site cross-sectional comparative study. Nursing Open, 8(1), 404–414. https://doi.org/10.1002/nop2.641

40.

Lindsey

E. W.

Sanchez

Castro

(2022). Variations in coparenting quality among Mexican American families based on generational status and acculturation. Hispanic Journal of Behavioral Sciences, 44(3), 196–215. https://doi.org/10.1177/07399863231183021

41.

Marcus

F. M.

(1991). Mattering: Its measurement and theoretical significance for social psychology [Paper presentation]. Paper presented at the Annual Meeting of the Eastern Sociological Association, Cincinnati.

42.

Martin

A. J.

Ginns

Papworth

(2017). Motivation and engagement: Same or different? Does it matter? Learning and Individual Differences, 55, 150–162. https://doi.org/10.1016/j.lindif.2017.03.013

43.

McClelland

D. C.

(1961). The achieving society. Free Press.

44.

McClelland

D. C.

(1965). Toward a theory of motive acquisition. American Psychologist, 20(5), 321–333. https://doi.org/10.1037/h0022225

45.

McClelland

D. C.

Atkinson

J. W.

Clark

R. A.

Lowell

E. L.

(1953). The achievement motive. Appleton-Century-Crofts.

46.

Rayle

A. D.

(2006). Mattering to others: Implications for the counseling relationship. Journal of Counseling & Development, 84(4), 483–487. https://doi.org/10.1002/j.1556-6678.2006.tb00432.x

47.

Rayle

A. D.

Myers

J. E.

(2004). Counseling adolescents toward wellness: The roles of ethnic identity, acculturation, and mattering. Professional School Counseling, 8(1), 81–90.

48.

Rosenberg

McCullough

B. C.

(1981). Mattering: Inferred significance and mental health among adolescents. Research in Community and Mental Health, 2(1), 163–182.

49.

Rosseel

(2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.

50.

Rybnicek

Bergner

Gutschelhofer

(2019). How individual needs influence motivation effects: A neuroscientific study on McClelland’s need theory. Review of Managerial Science, 13(2), 443–482. https://doi.org/10.1007/s11846-017-0252-1

51.

Safa

M. D.

White

R. M.

Mahrer

N. E.

Knight

G. P.

Gonzales

N. A.

Pasco

M. C.

(2018). U.S. Mexican-origin adolescents’ bicultural competence and mental health in context. Cultural Diversity & Ethnic Minority Psychology, 25(2), 299–310. https://doi.org/10.1037/cdp0000231

52.

Santiago

C. D.

Gudiño

O. G.

Baweja

Nadeem

(2014). Academic achievement among immigrant and U.S.-born Latino adolescents: Associations with cultural, family, and acculturation factors. Journal of Community Psychology, 42(6), 735–747. https://doi.org/10.1002/jcop.21649

53.

Sari

Yetkiner

(2020). Relationships between job satisfaction, motivation and life satisfaction in the teachers: A structural equation modeling study. International Journal of Progressive Education, 16(3), 211–222. https://doi.org/10.29329/ijpe.2020.248.16

54.

Savage

J. A.

(2011). Increasing adolescents’ subjective well-being: Effects of a positive psychology intervention in comparison to the effects of therapeutic alliance, youth factors, and expectancy for change [Doctoral dissertation, University of South Florida]. ProQuest Dissertations Publishing.

55.

Silas-Casillas

J. C.

Perales-Franco

(2014). Making a difference in poor communities: Relations among actors in Mexican schools. International Journal of Qualitative Studies in Education, 27(8), 992–1019. https://doi.org/10.1080/09518398.2014.924639

56.

Smith

R. L.

(1972). A measure of achievement motivation. Impact, Educational Resource Information Center-Eric Caps, University of Michigan.

57.

Smith

R. L.

(2011). Achievement motivation training: An evidence-based approach to enhancing performance. Ideas and Research You Can Use: VISTAS 2011. https://www.counseling.org/resources/library/vistas/2011-V-Online/Article_56.pdf

58.

Smith

R. L.

(2015). A contextual measure of achievement motivation: Significance for research in counseling. Ideas and Research You Can Use: VISTAS 2015. http://www.counseling.org/docs/default-source/vistas/a-contextual-measure-of-achievement-motivation-significance-for-research-in-counseling.pdf?sfvrsn=8

59.

Smith

R. L.

Karaman

M. A.

Balkin

R. S.

Talwar

(2020). Psychometric properties and factor analyses of the achievement motivation measure. British Journal of Guidance & Counselling, 48(3), 418–429. https://doi.org/10.1080/03069885.2019.1620173

60.

Smith

R. L.

Troth

W. A.

(1975). Achievement motivation: A rational approach to psychological education. Journal of Counseling Psychology, 22(6), 500–504. https://doi.org/10.1037//0022-0167.22.6.500

61.

Suarez-Orozco

C. E.

(1993). Generational discontinuities: A cross-culture study of familism and achievement motivation in Mexican, Mexican immigrant, Mexican American, and white non-Hispanic adolescents. California School of Professional Psychology-San Diego.

62.

Suldo

S. M.

(2016). Promoting student happiness: Positive psychology interventions in schools. The Guilford Press.

63.

Taylor

Turner

R. J.

(2001). A longitudinal study of the role and significance of mattering to others for depressive symptoms. Journal of Health and Social Behavior, 42(3), 310–325. https://doi.org/10.2307/3090217

64.

Triandis

H. C.

(1995). Individualism & collectivism. Westview Press.

65.

Triandis

H. C.

Ottati

Marin

(1982). Achievement motives of Hispanic and mainstream navy recruits (Technical Report No. 5). University of Illinois, Department of Psychology.

66.

Trumbull

Rothstein-Fisch

(2011). The intersection of culture and achievement motivation. The School Community Journal, 21(2), 25–53.

67.

Vela

J. C.

Karaman

M. A.

Garcia

Aguilar

(2020). Evaluation of Spanish versions of meaning in life and hope measures with Latinx students. Measurement and Evaluation in Counseling and Development, 53(2), 104–116. https://doi.org/10.1080/07481756.2019.1667246

68.

Vela

J. C.

M. T. P.

Gonzalez

S. L.

Smith

R. L.

Azadi-Setayesh

(2015). School counselors' perceptions of differences between successful and less successful Latina/o high school students. Journal of School Counseling, 13(14), 1–32.

69.

Vela

J. C.

Smith

W. D.

Rodriguez

Hinojosa

(2019). Exploring the impact of a positive psychology and creative journal arts intervention with Latina/o adolescents. Journal of Creativity in Mental Health, 14(3), 280–291. https://doi.org/10.1080/15401383.2019.1610535

70.

Villarreal

Blozis

S. A.

Widaman

K. F.

(2005). Factorial invariance of a Pan-Hispanic familism scale. Hispanic Journal of Behavioral Sciences, 27(4), 409–425. https://doi.org/10.1177/0739986305281125

71.

Magis-Weinberg

Jansen

B. R. J.

van Atteveldt

Janssen

T. W. P.

Lee

N. C.

van der Maas

H. L. J.

Raijmakers

M. E. J.

Sachisthal

M. S. M.

Meeter

(2022). Motivation-achievement cycles in learning: A literature review and research agenda. Educational Psychology Review, 34(1), 39–71. https://doi.org/10.1007/s10648-021-09616-7

72.

Widaman

K. F.

Reise

S. P.

(1997). Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In Bryant

K. J.

Windle

M. E.

West

S. G.

(Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281–324). American Psychological Association.