The authors examined the psychometric properties of the Research Motivation Scale (RMS) in a sample of faculty members (N = 337) in university science departments. It was hypothesized that the RMS would evidence partial measurement invariance across tenure status and noninvariance across gender, given the different sociocultural factors (e.g., gender role bias) that regulate the research behavior of men and women. Gender was thus predicted to moderate the relations between the latent RMS factors and their defining items. Results of confirmatory factor analytic testing yielded support for the hypotheses, while post hoc probing of sources of noninvariance indicated that men and women differed mostly on measures of extrinsic reward and failure avoidance. Implications for motivation measurement and science, technology, engineering, and mathematics (STEM) career development are discussed.
AbeleA. E.SpurkD. (2009). The longitudinal impact of self-efficacy and career goals on objective and subject success. Journal of Vocational Behavior, 74, 53–62. doi:10.1016/j.jvb.2008.10.005
2.
AmabileT. M.HillK. G.HennesseyB. A.TigheE. M. (1994). The work preference inventory: Assessing intrinsic and extrinsic motivational orientations. Journal of Personality and Social Psychology, 66, 950–967. doi:10.1037//0022-3514.66.5.950
AssorA.VansteenkisteM.KaplanA. (2009). Identified versus introjected approach and introjected avoidance motivations in school and sports: The limited benefits of self-worth strivings. Journal of Educational Psychology, 101, 482–497. doi:10.1037/a0014236
5.
AtkinsonJ. W. (1957). Motivational determinants of risk-taking behavior. Psychological Review, 64, 359–372. doi:10.1037/h0043445
6.
BentlerP. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. doi:10.1037//0033-2909.107.2.238
7.
BentlerP. M. (1995). EQS structural equations program manual. Encino, CA: Multivariate Software.
8.
BernsteinB. L.RussoN. F. (2008). Explaining too few women in STEM careers: A psychosocial perspective. In PaludiM. A. (Ed.), The psychology of women at work: Challenges and solutions for our female workforce: Vol. 2Obstacles and the identity jungle. (pp. 1–33). Westport, CT: Praeger.
9.
BeutelA. M.NelsonD. J. (2005). The gender and race-ethnicity of faculty in top science and engineering research departments. Journal of Women and Minorities in Science and Engineering, 11, 389–402. doi:10.1615/JWomenMinorScienEng.v11.i4.50
10.
BlusteinD. L. (1988). The relationship between motivational processes and career exploration. Journal of Vocational Behavior, 32, 345–357. doi:10.1016/0001-8791(88)90025-5
11.
BollenK. A. (1989). Structural equations with latent variables. New York, NY: John Wiley.
12.
BrannickM. T. (1995). Critical comments on applying covariance structure modeling. Journal of Organizational Behavior, 16, 201–213. doi:10.1002/job.4030160303
13.
BrowneM. W.CudeckR. (1993). Alternative ways of assessing model fit. In BollenK. A.LongJ. S. (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: SAGE.
14.
ByrneB. M.ShavelsonR. J.MuthénB. O. (1989). Testing for equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456–466. doi:10.1037//0033-2909.105.3.456
15.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. doi:10.1207/S15328007SEM0902_5
16.
ColeS. (1979). Age and scientific performance. American Journal of Sociology, 84, 958–977. doi:10.1086/226868
17.
ConroyD. E. (2001). Progress in the development of a multidimensional measure of fear of failure: The Performance Failure Appraisal Inventory (PFAI). Anxiety, Stress, and Coping, 14, 431–452. doi:10.1080/10615800108248365
18.
CsikszentmihalyiM. (1975). Beyond boredom and anxiety. San Francisco, CA: Jossey-Bass.
19.
CsikszentmihalyiM. (1990). Flow: The psychology of optimal experience. New York, NY: Harper Perennial.
20.
DeciE. L. (1975). Intrinsic motivation. New York, NY: Plenum Press.
21.
DeciE. L.RyanR. M. (1985). Intrinsic motivation and self-determination in human behavior. New York, NY: Plenum Press.
22.
DeciE. L.RyanR. M. (1987). The support of autonomy and the control of behavior. Journal of Personality and Social Psychology, 53, 1024–1037. doi: 10.1037/0022-3514.53.6.1024
23.
DeciE. L.RyanR. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11, 227–268. doi:10.1207/S15327965PLI1104_01
24.
DeemerE. D.MartensM. P.BuboltzW. C. (2010). Toward a tripartite model of research motivation: Development and initial validation of the Research Motivation Scale. Journal of Career Assessment, 18, 292–309. doi:10.1177/1069072710364794
25.
DeemerE. D.MartensM. P.PodchaskiE. J. (2007). Counseling psychology students’ interest in research: Examining the contribution of achievement goals. Training and Education in Professional Psychology, 1, 193–203. doi:10.1037/1931-3918.1.3.193
26.
EcclesJ. S. (2007). Where are all the women? Gender differences in participation in physical science and engineering. In WilliamsW. M.CeciS. J. (Eds.), Why aren’t more women in science: Top researchers debate the evidence (pp. 199–210). Washington, DC: American Psychological Association.
27.
ElliotA. J. (1997). Integrating the “classic” and “contemporary” approaches to achievement motivation: A hierarchical model of approach and avoidance achievement motivation. In MaehrM. L.PintrichP. R. (Eds.), Advances in motivation and achievement (pp. 143–179). Vol. 10, Greenwich, CT: JAI Press.
28.
ElliotA. J. (2005). A conceptual history of the achievement goal construct. In ElliotA.DweckC. (Eds.), Handbook of competence and motivation (pp. 52–72). New York, NY: Guilford.
29.
ElliotA. J. (2008). Approach and avoidance motivation. In ElliotA. J. (Ed.), Handbook of approach and avoidance motivation (pp. 3–14). New York, NY: Psychology Press.
30.
ElliotA. J.SheldonK. M. (1997). Avoidance achievement motivation: A personal goals analysis. Journal of Personality and Social Psychology, 73, 171–185. doi:10.1037//0022-3514.73.1.171
31.
FernándezM. L.CastroY. R.OteroM. C.FoltzM. L.LorenzoM. G. (2006). Sexism, vocational goals, and motivation as predictors of men’s and women’s career choice. Sex Roles, 55, 267–272. doi:10.1007/s11199-006-9079-y
32.
FerreiraM. M. (2003). Gender issues related to graduate student attrition in two science departments. International Journal of Science Education, 25, 969–989. doi:10.1080/09500690305026
33.
FoxM. F. (2005). Gender, family characteristics, and publication productivity among scientists. Social Studies of Science, 35, 131–150. doi:10.1177/0306312705046630
34.
GuayF.RatelleC. F.SenecalC.LaroseS.DeschenesA. (2006). Distinguishing developmental from chronic career indecision: Self-efficacy, autonomy, and social support. Journal of Career Assessment, 14, 235–251. doi:10.1177/1069072705283975
35.
GuayF.SenécalC.GauthierL.FernetC. (2003). Predicting career indecision: A self-determination theory perspective. Journal of Counseling Psychology, 50, 165–177. doi:10.1037/0022-0167.50.2.165
36.
HornerK. A.RushtonJ. P.VernonP. A. (1986). Relation between aging and research productivity of academic psychologists. Psychology and Aging, 1, 319–324. doi:10.1037/0882-7974.1.4.319
37.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. doi:10.1080/10705519909540118
38.
KellowayE. K. (1995). Structural equation modeling in perspective. Journal of Organizational Behavior, 16, 215–224. doi:10.1002/job.4030160304
39.
KlineR. B. (2005). Principles and practice of structural equation modeling. (2nd ed). New York, NY: Guilford.
40.
LittleT. D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53–76. doi:10.1207/s15327906mbr3201_3
41.
MarshH. W. (1994). Confirmatory factor models of factorial invariance: A multi-faceted approach. Structural Equation Modeling, 1, 5–34.
42.
McClellandD. C.AtkinsonJ. W.ClarkR. A.LowellE. L. (1953). The achievement motive. New York, NY: Appleton-Century-Crofts.
MullikinE. A.BakkenL. L.BetzN. E. (2007). Assessing research self-efficacy in physician-scientists: The clinical research appraisal inventory. Journal of Career Assessment, 15, 367–387. doi:10.1177/1069072707301232
45.
National Science Foundation. (2010). Science and engineering indicators 2010 (NSB) 10-01. Arlington, VA: National Science Foundation.
46.
O’BrienK. M.MaloneM. E.SchmidtC. K.LucasM. S. (1998, August). Research self-efficacy: Improvements in instrumentation. Poster session presented at the annual conference of the American Psychological Association, San Francisco, CA.
47.
O’LaughlinE. M.BischoffL. G. (2005). Balancing parenthood and academia: Work/family stress as influenced by gender and tenure status. Journal of Family Issues, 26, 79–106.
48.
OlsenD. (1993). Work satisfaction and stress in the first and third year of academic appointment. Journal of Higher Education, 64, 453–471. doi:10.2307/2960052
49.
O’NeilR.GreenbergerE. (1994). Patterns of commitment to work and parenting: Implications for role strain. Journal of Marriage and Family, 56, 101–118.
50.
PekrunR.ElliotA. J.MaierM. A. (2009). Achievement goals and achievement emotions: Testing a model of their joint relations with academic performance. Journal of Educational Psychology, 101, 115–135. doi:10.1037/a0013383
51.
PernaL. W. (2001). Sex differences in faculty salaries: A cohort analysis. The Review of Higher Education, 24, 283–307. doi:10.1353/rhe.2001.0006
52.
PhillipsJ. C.RussellR. K. (1994). Research self-efficacy, the research training environment, and research productivity among graduate students in counseling psychology. The Counseling Psychologist, 22, 628–641. doi:10.1177/0011000094224008
53.
RyanR. M.DeciE. L. (2000). Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25, 54–67. doi:10.1006/ceps.1999.1020
54.
SchmaltH. D. (2005). Validity of a short form of the Achievement-Motive Grid (AMG-S): Evidence for the three-factor structure emphasizing active and passive forms of fear of failure. Journal of Personality Assessment, 84, 172–184. doi:10.1207/s15327752jpa8402_07
55.
SideridisG. D. (2008). The regulation of affect, anxiety, and stressful arousal from adopting mastery-avoidance goal orientations. Stress and Health, 24, 55–69. doi:10.1002/smi.1160
56.
SteeleC. M. (1997). A threat in the air: How stereotypes shape intellectual identity and performance. American Psychologist, 52, 613–629. doi:10.1037/0003-066X.52.6.613
57.
SteenkampJ. E.BaumgartnerH. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90. doi:10.1086/209528
58.
SteigerJ. H.LindJ. C. (1980, May). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA.
59.
ThomasK. M.MackD. A.WilliamsK. L.PerkinsL. A. (1999). Career development strategies and experiences of “outsiders within” in academe. Journal of Career Development, 26, 51–67. doi:10.1177/089484539902600105
60.
TienF. F.BlackburnR. T. (1996). Faculty rank system, research motivation, and faculty research productivity: Measure refinement and theory testing. Journal of Higher Education, 67, 2–22. doi:10.2307/2943901
61.
TrowerC. A.BleakJ. L. (2004). Study of new scholars. Gender: Statistical report. [Universities]. Cambridge, MA: Harvard Graduate School of Education.
62.
UrdanT. (2004). Predictors of academic self-handicapping and achievement: Examining achievement goals, classroom goal structures, and culture. Journal of Educational Psychology, 96, 251–264. doi:10.1037/0022-0663.96.2.251
63.
VallerandR. J.PelletierL. G.BlaisM. R.BrièreN. M.SenécalC.VallièresE. F. (1993). On the assessment of intrinsic, extrinsic and amotivation in education: Evidence on the concurrent and construct validity of the academic motivation scale. Educational and Psychological Measurement, 53, 159–172.
64.
VandenbergR. J.LanceC. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–69. doi:10.1177/109442810031002
65.
VansteenkisteM.NeyrinckB.NiemiecC. P.SoenensB.De WitteH.Van den BroeckA. (2007). On the relations among work value orientations, psychological need satisfaction and job outcomes: A self-determination theory approach. Journal of Occupational and Organizational Psychology, 80, 251–277. doi:10.1348/096317906X1111024
66.
WhiteR. W. (1959). Motivation reconsidered: The concept of competence. Psychological Review, 66, 297–333. doi:10.1037/h0040934
67.
WidamanK. F.ReiseS. P. (1997). Exploring the measurement equivalence of psychological instruments: Applications in the substance use domain. In BryantK. G.WindleM.WestS. G. (Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281–324). Washington, DC: American Psychological Association.
68.
ZuckermanH. (1991). The careers of men and women scientists: A review of current research. In ZuckermanH.ColeJ. R.BruerJ. T. (Eds.), The outer circle: Women in the scientific community. New York, NY: Norton.
