Restricted accessResearch articleFirst published online 2007-07
Assessing Progress Toward Accreditation Related Objectives: Evidence Regarding the Use of Self-Efficacy as an Outcome in the Advanced Concentration Research Curriculum
Objective: Assessing the achievement of social work educational outcomes is a requirement of the Council on Social Work Education's Educational Policy and Standards (EPAS). The Evaluation Self-Efficacy Scale (ESE) was created to assess student progress in advanced concentration courses focused on evaluation and thereby provide data regarding attainment of EPAS-related objectives. Method: This social cognitive theory—derived scale was pretested, revised, and then used with a final sample of 85 master's-level students in a single-group, pretest-posttest-retrospective pretest study. Results: Cronbach alphas for the ESE were .94 or greater. Evidence of both content and construct validity was obtained. Conclusion: The results provide evidence that supports the psychometric properties of data obtained using the ESE.
Bandura, A.
(1977).
Self-efficacy: Toward a unifying theory of behavior change
. Psychological Review, 84,
191-215
.
2.
Bandura, A.
(1982).
Self-efficacy mechanism in human agency
. American Psychologist, 37,
122-147
.
3.
Bandura, A.
(1986). Social foundations of thought and action: A social cognitive theory.
Englewood Cliffs, NJ: Prentice Hall
.
4.
Bandura, A.
(1997). Self-efficacy: The exercise of control.
New York: Freeman
.
5.
Bandura, A.
(2004).
Swimming against the mainstream: The early years from chilly tributary to transformative mainstream
. Behaviour Research and Therapy, 42,
613-630
.
6.
Banta, T.W.
,
Lund, J.P.
,
Black, K.E.
, &
Oblander, F.W.
(1996). Assessment in practice: Putting principles to work on college campuses.
San Francisco : Jossey-Bass
.
7.
Baskind, F.R.
,
Shank, B.W.
, &
Ferraro, E.K.
(2001). Accountability for professional practice: Assessment in social work education. In
C. A. Palomba
&
T. W. Banta
(Eds.), Assessing student competence in accredited disciplines: Pioneering approaches to assessment in higher education (pp. 95-119).
Sterling, VA : Stylus
.
8.
Black, P.N.
, &
Whelley, J.
(1999).
The social work licensure exam: Examining the exam through the lens of CSWE curriculum policy
. Arete, 23,
66-76
.
9.
Bogo, M.
,
Regehr, C.
,
Hughes, J.
,
Power, R.
, &
Globerman, J.
(2002).
Evaluating a measure of student field performance in direct service: Testing reliability and validity of explicit criteria
. Journal of Social Work Education, 38,
385-401
.
10.
Bogo, M.
,
Regehr, C.
,
Power, R.
,
Hughes, J.
,
Woodford, M.
, &
Regehr, G.
(2004).
Toward new approaches for evaluating student field performance: Tapping the implicit criteria used by experienced field instructors
. Journal of Social Work Education, 40,
417-426
.
11.
Buchan, V.
,
Rodenheiser, R.
,
Hull, G.
,
Smith, M.
,
Rogers, J.
,
Pike, C.
, & et al. (2004).
Evaluating an assessment tool for undergraduate social work education: Analysis of the Baccalaureate Educational Assessment Package
. Journal of Social Work Education, 40,
239-253
.
12.
Carpenter, J.
(2005). Evaluating outcomes in social work education. Social Care Institute for Excellence and the Scottish Institute for Excellence in Social Work Education. Retrieved April 24, 2005, from http://www.scie.org.uk/publications/reports/evalreport.pdf
13.
Chichester, E.
,
Finestone, S.
,
Lucas, L.
, &
Scott, D.
(1950).
Field work criteria for second-year casework students
. Social Casework, 31,
229-237
.
14.
Cliff, N.
(1987). Analyzing multivariate data.
New York: Harcourt Brace
.
15.
Cohen, J.
(1988). Statistical power analysis for the behavioral sciences (2nd ed.).
Hillsdale, NJ: Lawrence Erlbaum
.
16.
Corcoran, K.J.
(1985).
Student self-assessment as a teaching tool: A pilot study of the sequential criterion-referenced educational evaluation system
. Journal of Social Work Education, 21(2),
54-59
.
17.
Cournoyer, B.R.
(2001).
Assessment of student learning in social work education: The Indiana Model. Advances
in Social Work, 2(2),
128-155
.
18.
Crisp, B.R.
, &
Lister, P.G.
(2001). Methods of assessment in DipSW campus based modules. A report to the West of Scotland Consortium for Education and Training in Social Work. Retrieved March 6, 2005, from http://www.swap.ac.uk/docs/ac/Assessmentmethods.rtf
19.
Crisp, B.R.
, &
Lister, P.G.
(2002).
Assessment methods in social work education: A review of the literature
. Social Work Education, 21,
259-269
.
20.
Cronbach, L.
(1963).
Course improvement through evaluation
. Teachers' College Record, 64,
672-683
.
21.
Cswe.
(2002). Educational Policy And Accreditation Standards. Retrieved May 5, 2005, from http://www.cswe.org
22.
Cuzzi, L.C.
,
Holden, G.
,
Chernack, P.
,
Rutter, S.
, &
Rosenberg, G.
(1997).
Evaluating social work field instruction: Rotations versus year-long placements
. Research on Social Work Practice , 7,
402-414
.
23.
Cuzzi, L.C.
,
Holden, G.
,
Rutter, S.
,
Rosenberg, G.
, &
Chernack, P.
(1996).
A pilot study of fieldwork rotations vs. year long placements for social work students in a public hospital
. Social Work in Health Care, 24,
73-91
.
24.
Danis, F.
(2004).
Factors that influence domestic violence self-efficacy: Implications for social work. Advances inSocial Work, 5,
150-162
.
25.
Donaldson, L.P.
(2004).
Toward validating the therapeutic benefits of empowerment-oriented social action groups
. Social Work with Groups, 27(2/3),
159-175
.
26.
Dorfman, L.T.
,
Holmes, C.A.
, &
Berlin, K.L.
(1996).
Wide care-givers of frail elderly veterans: Correlates of caregiver satisfaction and caregiver strain
. Family Relations , 45,
46-55
.
27.
Ellett, A.J.
(2001, March).
Self-efficacy beliefs and employee retention in child welfare: A multi-state study
. Paper presented at the Council on Social Work Education Annual Program Meeting, Dallas, TX.
28.
Ellison, M.L.
(1996).
Assessing student progress in field practice
. Journal of Social Work Education, 32,
421-424
.
29.
Evans, E.N.
(1992).
Liberation theology, empowerment theory and social work practice with the oppressed
. International Social Work , 35,
135-147
.
30.
Fortune, A.E.
,
Lee, M.
, &
Cavazos, A.
(2005).
Achievement motivation and outcome in social work field education
. Journal of Social Work Education, 41,
115-129
.
31.
Frans, D.J.
(1993).
A scale for measuring social worker empowerment
. Research on Social Work Practice, 3,
312-328
.
32.
Furstenberg, A.L.
, &
Rounds, K.A.
(1995).
Self-efficacy as a target for social work intervention. Families in Society
: The Journal of Contemporary Human Services , 76,
587-595
.
33.
Garcia, J.A.
, &
Floyd, C.E.
(2002).
Addressing evaluative standards related to program assessment: How do we respond?Journal of Social Work Education , 38,
369-383
.
34.
Green, D.M.
(2003).
Self-efficacy: A communication model for the development of self-efficacy in the classroom
. Journal of Teaching in Social Work, 23,
107-116
.
35.
Holden, G.
(1991).
The relationship of self-efficacy appraisals to subsequent health related outcomes: A meta-analysis
. Social Work in Health Care, 16,
53-93
.
36.
Holden, G.
,
Anastas, J.
, &
Meenaghan, T.
(2003).
Determining attainment of the EPAS foundation program objectives: Evidence for the use of self-efficacy as an outcome
. Journal of Social Work Education, 39,
425-440
.
37.
Holden, G.
,
Anastas, J.
, &
Meenaghan, T.
(2005).
EPAS objectives and foundation practice self-efficacy: A replication
. Journal of Social Work Education, 41,
559-570
.
38.
Holden, G.
,
Barker, K.
,
Meenaghan, T.
, &
Rosenberg, G.
(1999).
Research self-efficacy: A new possibility for educational outcomes assessment
. Journal of Social Work Education , 35,
463-476
.
39.
Holden, G.
,
Cuzzi, L.C.
,
Rutter, S.
,
Chernack, P.
, &
Rosenberg, G.
(1997).
The Hospital Social Work Self-Efficacy Scale: A replication
. Research on Social Work Practice, 7,
490-499
.
40.
Holden, G.
,
Cuzzi, L.C.
,
Rutter, S.
,
Chernack, P.
,
Spitzer, W.
, &
Rosenberg, G.
(1997).
The Hospital Social Work Self-Efficacy Scale: A partial replication and extension
. Health & Social Work , 22,
256-263
.
41.
Holden, G.
,
Cuzzi, L.C.
,
Rutter, S.
,
Rosenberg, G.
, &
Chernack, P.
(1996).
The Hospital Social Work Self-Efficacy Scale: Initial development
. Research on Social Work Practice, 6,
353-365
.
42.
Holden, G.
,
Meenaghan, T.
,
Anastas, J.
, &
Metrey, G.
(2002).
Outcomes of social work education: The case for social work self-efficacy
. Journal of Social Work Education , 38(1),
115-133
.
43.
Holden, G.
,
Moncher, M.S.
,
Schinke, S.P.
, &
Barker, K.M.
(1990).
Self-efficacy of children, and adolescents: A meta-analysis
. Psychological Reports, 66,
1044-1046
.
44.
Holden, G.
,
Wade, S.
,
Mitchell, H.
,
Ewart, C.
, &
Islam, S.
(1998).
Caretaker expectations and the management of pediatric asthma in the inner-city: A scale development study
. Social Work Research, 22,
51-59
.
45.
Holloway, S.
(2005). Some suggestions on educational program assessment and continuous improvement. Retrieved October 6, 2006, from http://www.cswe.org/
46.
Howard, G.S.
, &
Dailey, P.R.
(1979).
Response shift bias: A source of contamination of self-report measures
. Journal of Applied Psychology, 64,
144-150
.
47.
Howard, G.S.
,
Dailey, P.R.
, &
Gulanick, N.A.
(1979).
The feasibility of informed pretests in attenuating response—shift bias
. Applied Psychological Measurement, 3,
481-494
.
48.
Howard, G.S.
,
Ralph, K.M.
,
Gulanick, N.A.
,
Maxwell, S.E.
,
Nance, D.W.
, &
Gerber, S.K.
(1979).
Internal invalidity in pretest—posttest self-report evaluations and a re-evaluation of retrospective pretests
. Applied Psychological Measurement, 3,
1-23
.
49.
Hudson, W.W.
(1981).
Sequential criterion-referenced educational evaluation: A student/teacher assessment system
. Journal of Education for Social Work, 17(1),
53-58
.
50.
Kranz, K.M.
(2003).
Development of the Alcohol and Other Drug Self-Efficacy Scale
. Research on Social Work Practice, 13,
724-741
.
51.
Kunz, J.
, &
Kalil, A.
(1999).
Self-esteem, self-efficacy, and welfare use
. Social Work Research, 23,
119-127
.
52.
Ley, P.
, &
Florio, T.
(1996).
The use of readability formulas in health care
. Psychology, Health & Medicine, 1,
7-28
.
53.
Linkon, S.L.
(2005). How can assessment work for us? Academe, 91, 4 . Retrieved October 6, 2006, from http://www.aaup.org/publications/Academe/2005/05ja/05jalink.htm
54.
Lister, P.G.
,
Dutton, K.
, &
Crisp, B.R.
(2005).
Assessment practices in Scottish social work education: A practice audit of Scottish universities providing qualifying social work courses
. Social Work Education, 24,
693-711
.
55.
Madaus, G.F.
, &
Stufflebeam, D.L.
(2000). Program evaluation: A historical overview. In
D. L. Stufflebeam
,
G. F. Madaus
, &
T. Kellaghan
(Eds.), Evaluation models: Viewpoints on educational and human services evaluation (2nd ed.).
Boston: Kluwer Academic
.
56.
Mancoske, R.J.
,
Standifer, D.
, &
Cauley, C.
(1994).
The effectiveness of counseling services for battered women
. Research on Social Work Practice, 4,
53-63
.
57.
Merrifield, A.
, &
Astro, S.
(1969). A standard for measuring the minimum acceptable level of performance in second-year field work in social work.
Chicago: University of Chicago, School of Social Service Administration, Levels Committee Report
.
58.
Merrifield, A.
,
Linfield, J.
, &
Jastram, E.
(1964). A standard for measuring the minimum acceptable level of performance in first-year field work in social casework.
Chicago: University of Chicago, School of Social Service Administration, Levels Committee Report
.
59.
Montcalm, D.M.
(1999).
Applying Bandura's theory of self-efficacy to the teaching of research
. Journal of Teaching in Social Work , 19,
93-107
.
60.
Parducci, A.
(2000). An historical introduction to response shift. In
C. E. Schwartz
&
M. A. G. Sprangers
(Ed.), Adaptation to changing health: Response shift in quality-of-life research (pp. 3-7).
Washington, DC : American Psychological Association
.
61.
Parker, J.
(2005, May).
Self-efficacy and effectiveness in social work practice learning
. Presented at the European Association of Schools in Social Work Conference, Lefkosia , Cyprus.
62.
Paulhus, D.L.
(1991). Measurement and control of response bias. In
J. P. Robinson
,
P. R. Shaver
, &
L. S. Wrightsman
(Eds.), Measures of personality and social psychological attitudes (pp. 17-60).
New York: Academic Press
.
63.
Pearlmutter, S.
(1998).
Self-efficacy and organizational change leadership
. Administration in Social Work, 22(3),
23-38
.
64.
Petrovich, A.
(2004).
Using self-efficacy theory in social work teaching
. Journal of Social Work Education, 40,
429-443
.
65.
Rawlings, M.A.
,
Townsend, A.L.
, &
Gingerich, W.J.
(2005, January).
A psychometric analysis of the Social Work Self-Efficacy Scale
. Paper presented at the 2005 Society for Social Work Research Conference, Miami, FL. Available from Society for Social Work Research Web site, http://sswr.confex.com/sswr/2005/techprogram/P1415.HTM
66.
Reid, W.
,
Baily-Dempsey, C.
, &
Viggiani, P.
(1996).
Evaluating student field education: An empirical study
. Journal of Social Work Education, 32,
45-52
.
67.
Robinson, E.A.R.
, &
Doueck, H.J.
(1994).
Implications of the pre/ post/then design for evaluating social group work
. Research on Social Work Practice , 4,
224-239
.
68.
Rounds, K.A.
,
Galinsky, M.J.
, &
Despard, M.R.
(1995).
Evaluation of telephone support groups for persons with HIV disease
. Research on Social Work Practice, 5,
442-459
.
69.
Siegel, S.
, &
Castellan, N.J.
(1988). Nonparametric statistics for the behavioral sciences.
New York: McGraw-Hill
.
70.
Simpson, R.D.
(1999).
Ralph Tyler on curriculum: A voice from the past with a message for the future. InnovativeHigher Education , 24(2),
85-87
.
71.
Skolnik, L.
(1989). Field instruction in the 1980s—Realities, issues and problem solving strategies. In
M. S. Raskin
(Ed.), Empirical studies in field instruction (pp. 47-76).
New York: Haworth
.
72.
Somlai, A.M.
,
Kelly, J.A.
,
Wagstaff, D.A.
, &
Whitson, D.P.
(1998).
Patterns, predictors, and situational contexts of HIV risk behaviors among homeless men and women
. Social Work, 43,
7-20
.
73.
Sprangers, M.A.G.
, &
Schwartz, C.E.
(1999).
Integrating response shift into health-related quality-of-life research: A theoretical model
. Social Science & Medicine, 48,
1507-1515
.
74.
Unrau, Y.A.
, &
Beck, A.R.
(2004).
Increasing research self-efficacy among students in professional academic programs. InnovativeHigher Education , 28(3),
187-204
.
75.
Unrau, Y.A.
, &
Grinnell, R.M.
(2005).
The impact of social work research courses on research self-efficacy for social work students
. Social Work Education, 24,
639-651
.
76.
Vourlekis, B.
,
Bembry, J.
,
Hall, G.
, &
Rosenblum, P.
(1992).
Evaluating the interrater reliability of process recordings
. Research on Social Work Practice, 2,
198-206
.
77.
Vourlekis, B.
,
Bembry, J.
,
Hall, G.
, &
Rosenblum, P.
(1996).
Testing the reliability and validity of an interviewing skills evaluation tool for use in practicum
. Research on Social Work Practice, 6,
492-503
.
78.
Williams, N.R.
,
King, M.
, &
Koob, J.J.
(2002).
Social work students go to camp: The effects of service learning on perceived self-efficacy
. Journal of Teaching in Social Work, 22,
55-70
.
79.
Wilson, S.
(1981). Field instruction.
New York : Free Press
.
