The purpose of the present study was to explore the variability in reliability scores on a commonly used career scale, the Career Decision-Making Self-Efficacy Scale (CDMSE). Reliability generalization was employed to identify typical score reliability, variability of score reliability, and variables explaining this variability. Forty-nine pieces of work were examined, and the results revealed that 41% of them reported score reliability of their own data. Of the five subscales, Problem Solving showed the lowest score reliability. In addition, higher score reliability was associated with age, sample racial/ethnic demographics, and standard deviation of total mean score.
Get full access to this article
View all access options for this article.
References
1.
Abdalla, I. A. (1994). Relationships of career self-efficacy and personality variables with status of academic and career choice among Arab students. Psychological Reports, 75, 1571-1582
2.
Ahrens, J. A. , & O’Brien, K. M. (1996). Predicting gender-role attitudes in adolescent females: Ability, agency, and parental factors. Psychology of Women Quarterly, 20, 409-417.
3.
Anderson, S. , & Brown, C. (1997). Self-efficacy as a determinant of career maturity in urban and rural high school students. Journal of Career Assessment, 5, 305-315.
4.
Arnold, J. , & Bye, H. (1989). Sex and sex role self-concept as correlates of career decision-making self-efficacy. British Journal of Guidance and Counseling, 17, 201-206.
5.
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191-195.
6.
Bandura, A. (1997). Self-efficacy: The exercise of control. New York: W. H. Freeman.
7.
Bergeron, L. M. , & Romano, J. L. (1994). The relationships among career decision-making self-efficacy, educational indecision, vocational indecision, and gender. Journal of College Student Development, 35, 19-24.
8.
Betz, N. E. , & Klein, K. L. (1996). Relationships among measures of career self-efficacy, generalized self-efficacy, and global self-esteem. Journal of Career Assessment, 4, 285-298.
9.
Betz, N. E. , Klein, K. L., & Taylor, K. M. (1996). Evaluation of a short form of the Decision-Making Self-Efficacy Scale. Journal of Career Assessment, 4, 47-57.
10.
Betz, N. E. , & Luzzo, D. A. (1996). Career assessment and the Career Decision-Making Self-Efficacy Scale. Journal of Career Assessment, 4, 413-428.
11.
Betz, N. E., & Serling, D. (1995). Fear of commitment and career decision-making self-efficacy. Unpublished manuscript, Ohio State University.
12.
Betz, N. , & Voyten, K. K. (1997). Efficacy and outcome expectation influence career exploration, Career Development Quarterly, 46, 197-189.
13.
Bikos, L. H. , & Furry, T. S. (1999). The job search club for international students: An evaluation. Career Development Quarterly, 48, 31-44.
14.
Blustein, D. L. (1989). The role of goal instability and career self-efficacy in the career exploration process. Journal of Vocational Behavior, 35, 194-203.
15.
Brown, C. , Darden, E. E., Shelton, M. L., & Dipoto, M. C. (1999). Career exploration and self-efficacy of high school students: Are there urban/suburban differences?Journal of Career Assessment, 7, 227-237.
16.
Brown, C. , Glastetter-Fender, C., & Shelton, M. (2000). Psychosocial identity and career control in college student-athletes. Journal of Vocational Behavior, 56, 53-62.
17.
Brown, C. , Reedy, D., Fountain, J., Johnson, A., & Dichiser, T. (2000). Battered women’s career decision-making self-efficacy: Further insight and contributing factors. Journal of Vocational Behavior, 8, 251-265.
18.
Carns, A. W. , et al. (1995). Extracurricular activities: Are they beneficial?TCA Journal, 23, 37-45.
19.
Caruso, J. C. (2000). Reliability generalization of the NEO personality scales. Educational and Psychological Measurement, 60, 236-254.
20.
Caruso, J. C. , Witkiewitz, K., Belcourt-Dittloff, A., & Gottlieb, J. (2001). Reliability scores from the Eysenck Personality Questionnaire: A reliability generalization (RG) study. Educational and Psychological Measurement, 61, 675-682.
21.
Chockalingham, V. , & Ones, D. S. (2000). Measurement error in “Big Five Factors” personality assessment: Reliability generalization across studies and measures. Educational and Psychological Measurement, 60, 224-235.
22.
Crites, J. O. (1961). A model for the measurement of vocational maturity. Journal of Counseling Psychology, 8, 255-259.
23.
Dawis, R. V. (1987). Scaleconstruction. Journal of Counseling Psychology, 34, 481-489.
24.
Fouad, N. A. , Smith, P. L., & Enochs, L. (1997). Reliability and validity evidence for the middle school self-efficacy scale. Measurement and Evaluation in Counseling and Development, 30, 17-31.
25.
Fukuyama, M. A. , Probert, B. S., Neimeyer, G. J., Nevill, D. D., & Metzler, A. E. (1988). Effects of DISCOVER on career self-efficacy and decision making of undergraduates. Career Development Quarterly, 37, 56-62.
26.
Gati, I. , Osipow, S. H., Fassa, N. (1994). Thescalestructureof multi-scalemeasures: Application of thesplit-scalemethod to thetask-specific occupational self-efficacy scaleand the Career Decision-Making Self-Efficacy Scale. Journal of Career Assessment, 2, 384-397.
27.
Ghiselli, E. E. (1964). Theory of psychological measurement. New York: McGraw-Hill.
28.
Gianakos, I. (1995). The relation of sex role identity to career decision-making self-efficacy. Journal of Vocational Behavior, 46, 131-143.
29.
Gianakos, I. (2001). Predictors of Career Decision-Making Self-Efficacy. Journal of Career Assessment, 9, 101-114.
30.
Gloria, A. M. , & Hird, J. S. (1999). Influences of ethnic and nonethnic variables on the career decision-making self-efficacy of college students. Career Development Quarterly, 48, 157-175.
31.
Hackett, G. , & Betz, N. E. (1981). A self-efficacy approach to the career development of women. Journal of Vocational Behavior, 18, 326-339.
32.
Hair, J. F. , Anderson, R. E., Tatham, R. L., & Black, W. C. (1998). Multivariate data analysis (5th ed.). Upper Saddle River, NJ: Prentice Hall.
33.
Helms, J. E. (1999). Another meta-analysis of the White racial Identity Attitude Scale’s Cronbach’s alphas: Implication for validity. Measurement and Evaluation in Counseling and Development, 32, 122-137.
34.
Hird, J. S. (1995). The relationship of sources of efficacy information to career decision-making self-efficacy. Unpublished doctoral dissertation, Arizona State University.
35.
Hunter, J. E. , & Schmidt, F. L. (1990). Methods of meta-analysis. Newbury Park: Sage.
36.
Kornspan, A. S. , & Etzekl, E. F. (2001). The relationship of demographic and psychological variables to career maturity of junior college student athletes. Journal of College Student Development, 42, 122-132.
37.
Kraus, L. J. , & Hughey, K. F. (1999). The impact of an intervention on career decision-making self-efficacy and career decision. Professional School Counseling, 2, 384-390.
38.
Luzzo, D. A. (1993a). Career decision-making differences between traditional and nontraditional college students. Journal of Career Development, 20, 113-120.
39.
Luzzo, D. A. (1993b). Reliability and validity testing of the Career Decision-Making Self-Efficacy Scale. Measurement & Evaluation in Counseling & Development, 26, 137-142.
40.
Luzzo, D. A. (1993c). Value of career-decision-making self-efficacy in predicting career-decision-making attitudes and skills. Journal of Counseling Psychology, 40, 194-199.
41.
Luzzo, D. A. (1995). The relative contributions of self-efficacy and locus of control to the pre-diction of career maturity. Journal of College Student Development, 36, 61-66.
42.
Luzzo, D. A. (1996). Exploring the relationship between the perception of occupational barriers and career development. Journal of Career Development, 22, 239-248
43.
Luzzo, D. A. , & Day, M. A. (1999). Effects of strong interest inventory feedback on career decision-making self-efficacy and social cognitive career beliefs. Journal of Career Assessment, 7, 1-17.
44.
Luzzo, D. A. , Funk, D. P., & Strang, J. (1995). Attributional retraining increases career counseling. Career Development Quarterly, 44, 378-386.
45.
Luzzo, D. A. , Hitchings, W. E., Retish, P., & Shoemaker, A. (1999). Evaluating differences in college students’ career decision making on the basis of disability status. Career Development Quarterly, 48, 142-156.
46.
Luzzo, D. A. , McWhirter, E. H., & Hutcheson, K. G. (1997). Evaluating career decision-making factors associated with employment among first-year college students. Journal of College Student Development, 38, 166-172.
47.
Luzzo, D. A. , & Taylor, M. (1993). Effects of verbal persuasion on the career self-efficacy of college freshman. California Association for Counseling and Development, 14, 31-34.
48.
Luzzo, D. A. , & Ward, B. E. (1995). The relative contributions of self-efficacy and locus of control to the prediction of vocational congruence. Journal of Career Development, 21, 307-317.
49.
Mathieu, P. S. , Sowa, C. J., & Niles, S. G. (1993). Differences in career self-efficacy among women. Journal of Career Development, 19, 187-196.
50.
Nevill, D. D. , Neimeyer, G. J., Probert, B., & Fukuyama, M. (1986). Cognitive structures in vocational information processing and decision-making. Journal of Vocational Behavior, 28, 110-122.
51.
Niles, S. G. , & Sowa, C. J. (1992). Mapping the nomological network of career self-efficacy. Career Development Quarterly, 41, 13-21.
52.
Nunnally, J. C. , & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
53.
Peterson, S. L. , & delMas, R. C. (1998). The component structure of Career Decision-Making Self-Efficacy for underprepared college students. Journal of Career Development, 24, 209-225.
54.
Robbins, S. B. (1985). Validity estimates for the Career Decision-Making Self-Efficacy Scale. Measurement & Evaluation in Counseling & Development, 18, 64-71.
55.
Rowley, G. L. (1976). The reliability of observed measures. American Educational Research Journal, 13, 51-59.
56.
Satterfield, C. D. (2000). Effects of institutional integration and career decision making self efficacy on academic persistence among college freshman. Unpublished doctoral dissertation.
57.
Schmidt, F. L. , & Hunter, J. E. (1996). Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods, 1, 199-223.
58.
Silcox, P. E. , & Cummings, A. L. (1999). A comparison of women in nontraditional and traditional science majors: Implications for career counselors. Canadian Journal of Counseling, 33, 264-276.
59.
Solon, P. (1993). Vicarious learning (daughters’perceptions of their mothers’influence) and women’s career self-efficacy expectations. Unpublished master’s thesis, University of Minnesota.
60.
Srsic, C. S. , & Walsh, B. (2001). Person-environment congruence and career self-efficacy. Journal of Career Assessment, 9, 203-213.
61.
Stankovich, C. E. (1998). The effectiveness of a career development intervention program designed to assist student athletes through the sport retirement transition. Unpublished doctoral dissertation, Ohio State University.
62.
Taylor, K. M. , & Betz, N. E. (1983). Applications of self-efficacy theory to the understanding and treatment of career indecision. Journal of Vocational Behavior, 37, 17-31.
63.
Taylor, K. M. , & Popma, J. (1990). An examination of the relationships among career decisionmaking self-efficacy, career salience, locus of control, and vocational indecision. Journal of Vocational Behavior, 37, 17-31.
64.
Thompson, B. , & Snyder, P. A. (1998). Statistical significance and reliability analyses in recent JCD research articles. Journal of Counseling and Development, 76, 436-441.
65.
Thompson, B. , & Vacha-Haase, T. (2000). Psychometrics is datametrics: The test is not reliable. Educational and Psychological Measurement, 60, 174-195.
66.
Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting some reliability across studies. Educational and Psychological Measurement, 58(1), 6-20.
67.
Vacha-Haase, T. , Ness, C., Nilsson, J. E., & Reetz, D. (1999). Practices regarding reporting of reliability coefficients: A review of three journals. Journal of Experimental Education, 67, 335-341.
68.
Vacha-Haase, T. , Tani, C. R., Kogan, L. R., & Woodall, R. A. (2001). Reliability generalization: Exploring variation of reliability coefficients or MMPI clinical scales scores. Educational and Psychological Measurement, 61, 45-59.
69.
Vidal-Brown, S. A. (2000). The psychometric characteristics of the career assessment diagnostic inventory. Unpublished doctoral dissertation, Texas A&M University.
70.
Wilson, L. M. (2000). The relationship between parental attachment, career decision-making self-efficacy, gender, race, and career indecision. Unpublished dissertation, Florida State University.
71.
Yin, P. , & Fan, X. (2000). Assessing the reliability of Beck Depression Inventory Scores: Reliability generalization across studies. Educational and Psychological Measurement, 60, 224-235.
