Assessing Progress Toward Accreditation Related Objectives: Evidence Regarding the Use of Self-Efficacy as an Outcome in the Advanced Concentration Research Curriculum

Abstract

Objective: Assessing the achievement of social work educational outcomes is a requirement of the Council on Social Work Education's Educational Policy and Standards (EPAS). The Evaluation Self-Efficacy Scale (ESE) was created to assess student progress in advanced concentration courses focused on evaluation and thereby provide data regarding attainment of EPAS-related objectives. Method: This social cognitive theory—derived scale was pretested, revised, and then used with a final sample of 85 master's-level students in a single-group, pretest-posttest-retrospective pretest study. Results: Cronbach alphas for the ESE were .94 or greater. Evidence of both content and construct validity was obtained. Conclusion: The results provide evidence that supports the psychometric properties of data obtained using the ESE.

Keywords

accreditation CSWE EPAS educational outcomes evaluation outcome measures self-efficacy social cognitive theory social work education

Get full access to this article

View all access options for this article.

References

Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavior change . Psychological Review, 84, 191-215 .

Bandura, A. (1982). Self-efficacy mechanism in human agency . American Psychologist, 37, 122-147 .

Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall .

Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Freeman .

Bandura, A. (2004). Swimming against the mainstream: The early years from chilly tributary to transformative mainstream . Behaviour Research and Therapy, 42, 613-630 .

Banta, T.W. , Lund, J.P. , Black, K.E. , & Oblander, F.W. (1996). Assessment in practice: Putting principles to work on college campuses. San Francisco : Jossey-Bass .

Baskind, F.R. , Shank, B.W. , & Ferraro, E.K. (2001). Accountability for professional practice: Assessment in social work education. In C. A. Palomba & T. W. Banta (Eds.), Assessing student competence in accredited disciplines: Pioneering approaches to assessment in higher education (pp. 95-119). Sterling, VA : Stylus .

Black, P.N. , & Whelley, J. (1999). The social work licensure exam: Examining the exam through the lens of CSWE curriculum policy . Arete, 23, 66-76 .

Bogo, M. , Regehr, C. , Hughes, J. , Power, R. , & Globerman, J. (2002). Evaluating a measure of student field performance in direct service: Testing reliability and validity of explicit criteria . Journal of Social Work Education, 38, 385-401 .

10.

Bogo, M. , Regehr, C. , Power, R. , Hughes, J. , Woodford, M. , & Regehr, G. (2004). Toward new approaches for evaluating student field performance: Tapping the implicit criteria used by experienced field instructors . Journal of Social Work Education, 40, 417-426 .

11.

Buchan, V. , Rodenheiser, R. , Hull, G. , Smith, M. , Rogers, J. , Pike, C. , & et al. (2004). Evaluating an assessment tool for undergraduate social work education: Analysis of the Baccalaureate Educational Assessment Package . Journal of Social Work Education, 40, 239-253 .

12.

Carpenter, J. (2005). Evaluating outcomes in social work education. Social Care Institute for Excellence and the Scottish Institute for Excellence in Social Work Education. Retrieved April 24, 2005, from http://www.scie.org.uk/publications/reports/evalreport.pdf

13.

Chichester, E. , Finestone, S. , Lucas, L. , & Scott, D. (1950). Field work criteria for second-year casework students . Social Casework, 31, 229-237 .

14.

Cliff, N. (1987). Analyzing multivariate data. New York: Harcourt Brace .

15.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum .

16.

Corcoran, K.J. (1985). Student self-assessment as a teaching tool: A pilot study of the sequential criterion-referenced educational evaluation system . Journal of Social Work Education, 21(2), 54-59 .

17.

Cournoyer, B.R. (2001). Assessment of student learning in social work education: The Indiana Model. Advances in Social Work, 2(2), 128-155 .

18.

Crisp, B.R. , & Lister, P.G. (2001). Methods of assessment in DipSW campus based modules. A report to the West of Scotland Consortium for Education and Training in Social Work. Retrieved March 6, 2005, from http://www.swap.ac.uk/docs/ac/Assessmentmethods.rtf

19.

Crisp, B.R. , & Lister, P.G. (2002). Assessment methods in social work education: A review of the literature . Social Work Education, 21, 259-269 .

20.

Cronbach, L. (1963). Course improvement through evaluation . Teachers' College Record, 64, 672-683 .

21.

Cswe. (2002). Educational Policy And Accreditation Standards. Retrieved May 5, 2005, from http://www.cswe.org

22.

Cuzzi, L.C. , Holden, G. , Chernack, P. , Rutter, S. , & Rosenberg, G. (1997). Evaluating social work field instruction: Rotations versus year-long placements . Research on Social Work Practice , 7, 402-414 .

23.

Cuzzi, L.C. , Holden, G. , Rutter, S. , Rosenberg, G. , & Chernack, P. (1996). A pilot study of fieldwork rotations vs. year long placements for social work students in a public hospital . Social Work in Health Care, 24, 73-91 .

24.

Danis, F. (2004). Factors that influence domestic violence self-efficacy: Implications for social work. Advances in Social Work, 5, 150-162 .

25.

Donaldson, L.P. (2004). Toward validating the therapeutic benefits of empowerment-oriented social action groups . Social Work with Groups, 27(2/3), 159-175 .

26.

Dorfman, L.T. , Holmes, C.A. , & Berlin, K.L. (1996). Wide care-givers of frail elderly veterans: Correlates of caregiver satisfaction and caregiver strain . Family Relations , 45, 46-55 .

27.

Ellett, A.J. (2001, March). Self-efficacy beliefs and employee retention in child welfare: A multi-state study . Paper presented at the Council on Social Work Education Annual Program Meeting, Dallas, TX.

28.

Ellison, M.L. (1996). Assessing student progress in field practice . Journal of Social Work Education, 32, 421-424 .

29.

Evans, E.N. (1992). Liberation theology, empowerment theory and social work practice with the oppressed . International Social Work , 35, 135-147 .

30.

Fortune, A.E. , Lee, M. , & Cavazos, A. (2005). Achievement motivation and outcome in social work field education . Journal of Social Work Education, 41, 115-129 .

31.

Frans, D.J. (1993). A scale for measuring social worker empowerment . Research on Social Work Practice, 3, 312-328 .

32.

Furstenberg, A.L. , & Rounds, K.A. (1995). Self-efficacy as a target for social work intervention. Families in Society : The Journal of Contemporary Human Services , 76, 587-595 .

33.

Garcia, J.A. , & Floyd, C.E. (2002). Addressing evaluative standards related to program assessment: How do we respond? Journal of Social Work Education , 38, 369-383 .

34.

Green, D.M. (2003). Self-efficacy: A communication model for the development of self-efficacy in the classroom . Journal of Teaching in Social Work, 23, 107-116 .

35.

Holden, G. (1991). The relationship of self-efficacy appraisals to subsequent health related outcomes: A meta-analysis . Social Work in Health Care, 16, 53-93 .

36.

Holden, G. , Anastas, J. , & Meenaghan, T. (2003). Determining attainment of the EPAS foundation program objectives: Evidence for the use of self-efficacy as an outcome . Journal of Social Work Education, 39, 425-440 .

37.

Holden, G. , Anastas, J. , & Meenaghan, T. (2005). EPAS objectives and foundation practice self-efficacy: A replication . Journal of Social Work Education, 41, 559-570 .

38.

Holden, G. , Barker, K. , Meenaghan, T. , & Rosenberg, G. (1999). Research self-efficacy: A new possibility for educational outcomes assessment . Journal of Social Work Education , 35, 463-476 .

39.

Holden, G. , Cuzzi, L.C. , Rutter, S. , Chernack, P. , & Rosenberg, G. (1997). The Hospital Social Work Self-Efficacy Scale: A replication . Research on Social Work Practice, 7, 490-499 .

40.

Holden, G. , Cuzzi, L.C. , Rutter, S. , Chernack, P. , Spitzer, W. , & Rosenberg, G. (1997). The Hospital Social Work Self-Efficacy Scale: A partial replication and extension . Health & Social Work , 22, 256-263 .

41.

Holden, G. , Cuzzi, L.C. , Rutter, S. , Rosenberg, G. , & Chernack, P. (1996). The Hospital Social Work Self-Efficacy Scale: Initial development . Research on Social Work Practice, 6, 353-365 .

42.

Holden, G. , Meenaghan, T. , Anastas, J. , & Metrey, G. (2002). Outcomes of social work education: The case for social work self-efficacy . Journal of Social Work Education , 38(1), 115-133 .

43.

Holden, G. , Moncher, M.S. , Schinke, S.P. , & Barker, K.M. (1990). Self-efficacy of children, and adolescents: A meta-analysis . Psychological Reports, 66, 1044-1046 .

44.

Holden, G. , Wade, S. , Mitchell, H. , Ewart, C. , & Islam, S. (1998). Caretaker expectations and the management of pediatric asthma in the inner-city: A scale development study . Social Work Research, 22, 51-59 .

45.

Holloway, S. (2005). Some suggestions on educational program assessment and continuous improvement. Retrieved October 6, 2006, from http://www.cswe.org/

46.

Howard, G.S. , & Dailey, P.R. (1979). Response shift bias: A source of contamination of self-report measures . Journal of Applied Psychology, 64, 144-150 .

47.

Howard, G.S. , Dailey, P.R. , & Gulanick, N.A. (1979). The feasibility of informed pretests in attenuating response—shift bias . Applied Psychological Measurement, 3, 481-494 .

48.

Howard, G.S. , Ralph, K.M. , Gulanick, N.A. , Maxwell, S.E. , Nance, D.W. , & Gerber, S.K. (1979). Internal invalidity in pretest—posttest self-report evaluations and a re-evaluation of retrospective pretests . Applied Psychological Measurement, 3, 1-23 .

49.

Hudson, W.W. (1981). Sequential criterion-referenced educational evaluation: A student/teacher assessment system . Journal of Education for Social Work, 17(1), 53-58 .

50.

Kranz, K.M. (2003). Development of the Alcohol and Other Drug Self-Efficacy Scale . Research on Social Work Practice, 13, 724-741 .

51.

Kunz, J. , & Kalil, A. (1999). Self-esteem, self-efficacy, and welfare use . Social Work Research, 23, 119-127 .

52.

Ley, P. , & Florio, T. (1996). The use of readability formulas in health care . Psychology, Health & Medicine, 1, 7-28 .

53.

Linkon, S.L. (2005). How can assessment work for us? Academe, 91, 4 . Retrieved October 6, 2006, from http://www.aaup.org/publications/Academe/2005/05ja/05jalink.htm

54.

Lister, P.G. , Dutton, K. , & Crisp, B.R. (2005). Assessment practices in Scottish social work education: A practice audit of Scottish universities providing qualifying social work courses . Social Work Education, 24, 693-711 .

55.

Madaus, G.F. , & Stufflebeam, D.L. (2000). Program evaluation: A historical overview. In D. L. Stufflebeam , G. F. Madaus , & T. Kellaghan (Eds.), Evaluation models: Viewpoints on educational and human services evaluation (2nd ed.). Boston: Kluwer Academic .

56.

Mancoske, R.J. , Standifer, D. , & Cauley, C. (1994). The effectiveness of counseling services for battered women . Research on Social Work Practice, 4, 53-63 .

57.

Merrifield, A. , & Astro, S. (1969). A standard for measuring the minimum acceptable level of performance in second-year field work in social work. Chicago: University of Chicago, School of Social Service Administration, Levels Committee Report .

58.

Merrifield, A. , Linfield, J. , & Jastram, E. (1964). A standard for measuring the minimum acceptable level of performance in first-year field work in social casework. Chicago: University of Chicago, School of Social Service Administration, Levels Committee Report .

59.

Montcalm, D.M. (1999). Applying Bandura's theory of self-efficacy to the teaching of research . Journal of Teaching in Social Work , 19, 93-107 .

60.

Parducci, A. (2000). An historical introduction to response shift. In C. E. Schwartz & M. A. G. Sprangers (Ed.), Adaptation to changing health: Response shift in quality-of-life research (pp. 3-7). Washington, DC : American Psychological Association .

61.

Parker, J. (2005, May). Self-efficacy and effectiveness in social work practice learning . Presented at the European Association of Schools in Social Work Conference, Lefkosia , Cyprus.

62.

Paulhus, D.L. (1991). Measurement and control of response bias. In J. P. Robinson , P. R. Shaver , & L. S. Wrightsman (Eds.), Measures of personality and social psychological attitudes (pp. 17-60). New York: Academic Press .

63.

Pearlmutter, S. (1998). Self-efficacy and organizational change leadership . Administration in Social Work, 22(3), 23-38 .

64.

Petrovich, A. (2004). Using self-efficacy theory in social work teaching . Journal of Social Work Education, 40, 429-443 .

65.

Rawlings, M.A. , Townsend, A.L. , & Gingerich, W.J. (2005, January). A psychometric analysis of the Social Work Self-Efficacy Scale . Paper presented at the 2005 Society for Social Work Research Conference, Miami, FL. Available from Society for Social Work Research Web site, http://sswr.confex.com/sswr/2005/techprogram/P1415.HTM

66.

Reid, W. , Baily-Dempsey, C. , & Viggiani, P. (1996). Evaluating student field education: An empirical study . Journal of Social Work Education, 32, 45-52 .

67.

Robinson, E.A.R. , & Doueck, H.J. (1994). Implications of the pre/ post/then design for evaluating social group work . Research on Social Work Practice , 4, 224-239 .

68.

Rounds, K.A. , Galinsky, M.J. , & Despard, M.R. (1995). Evaluation of telephone support groups for persons with HIV disease . Research on Social Work Practice, 5, 442-459 .

69.

Siegel, S. , & Castellan, N.J. (1988). Nonparametric statistics for the behavioral sciences. New York: McGraw-Hill .

70.

Simpson, R.D. (1999). Ralph Tyler on curriculum: A voice from the past with a message for the future. Innovative Higher Education , 24(2), 85-87 .

71.

Skolnik, L. (1989). Field instruction in the 1980s—Realities, issues and problem solving strategies. In M. S. Raskin (Ed.), Empirical studies in field instruction (pp. 47-76). New York: Haworth .

72.

Somlai, A.M. , Kelly, J.A. , Wagstaff, D.A. , & Whitson, D.P. (1998). Patterns, predictors, and situational contexts of HIV risk behaviors among homeless men and women . Social Work, 43, 7-20 .

73.

Sprangers, M.A.G. , & Schwartz, C.E. (1999). Integrating response shift into health-related quality-of-life research: A theoretical model . Social Science & Medicine, 48, 1507-1515 .

74.

Unrau, Y.A. , & Beck, A.R. (2004). Increasing research self-efficacy among students in professional academic programs. Innovative Higher Education , 28(3), 187-204 .

75.

Unrau, Y.A. , & Grinnell, R.M. (2005). The impact of social work research courses on research self-efficacy for social work students . Social Work Education, 24, 639-651 .

76.

Vourlekis, B. , Bembry, J. , Hall, G. , & Rosenblum, P. (1992). Evaluating the interrater reliability of process recordings . Research on Social Work Practice, 2, 198-206 .

77.

Vourlekis, B. , Bembry, J. , Hall, G. , & Rosenblum, P. (1996). Testing the reliability and validity of an interviewing skills evaluation tool for use in practicum . Research on Social Work Practice, 6, 492-503 .

78.

Williams, N.R. , King, M. , & Koob, J.J. (2002). Social work students go to camp: The effects of service learning on perceived self-efficacy . Journal of Teaching in Social Work, 22, 55-70 .

79.

Wilson, S. (1981). Field instruction. New York : Free Press .