This article is a critique of the article by Robin Perry in this issue that describes a study in Florida to compare supervisor and peer performance evaluations of child welfare staff. An overview of prior studies related to the importance of the social work degree is provided. Subsequently, selected technical, design issues, and results in the Perry study are identified and discussed. Issues and speculations about the validity of supervisor and peer ratings in Perry's study and other studies are addressed. Finally, a discussion of the need to broaden perspectives on the importance of the social work degree is included. Perry's results indicate more about the invalidity of supervisor and peer ratings of child welfare staff performance than anything about the importance of the social work degree for effective job performance. Perry's study focused on a narrow issue pertaining to a larger set of issues.
Abramczyk, L. (1994). Should child welfare workers have an M.S.W.? In E. Gambrel & T. Stein (Eds.), Controversial issues in child welfare (pp. 174-186). Needham Heights, MA: Allyn & Bacon.
2.
AERA/APA/NCME. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
3.
Albers, E., Reilly, T., & Rittner, B. (1993). Children in foster care: Possible factors affecting permanency planning. Child and Adolescent Social Work Journal10, 329-341.
4.
American Public Human Services Association. (2005). Report from the 2004 child welfare workforce survey: State agency findings. Washington, DC: Author.
5.
Austin, J. F., & Villanova, P. (1992). The criterion problem: 1917-1992. Journal of Applied Psychology77, 836-874.
6.
Balzer, W. K., & Sulsky, M. (1992). Halo and performance appraisal research: A critical examination. Journal of Applied Psychology77, 975-985.
7.
Barbee, A. P., Sullivan, D. J., & Antle, B. F. (2003, February). Kentucky Public Child Welfare Certification Program. Paper presented at the Annual Program meeting of the Council of Social Work Education, Atlanta, GA.
8.
Booz-Allen and Hamilton, Inc. (1987). The Maryland Social Work Service Job Analysis and Personnel Qualifications Study. Baltimore: Maryland Department of Human Resources.
9.
Brittner, R. H. (1948). Developing an industrial merit rating procedure. Personnel Psychology1, 403-432.
10.
Bureau of Labor Statistics. (1962). Salaries and working conditions of social welfare manpower in 1960. New York: National Social Welfare Assembly.
11.
Campbell, D. T., & Stanley, J. C. (1981). Experimental and quasiexperimental designs for research. Boston: Houghton Mifflin.
12.
Cohen, E. P. (2003, May). Getting the whole picture: CFSR training and front-line practice. Keynote address at the 6th National Human Services Training and Evaluation Symposium, Berkeley, CA.
13.
Cooper, W. H. (1981). Ubiquitous halo. Psychological Bulletin90, 218-244.
14.
Costin, L., Karger, H., & Stoesz, D. (1996). The politics of child abuse and neglect in America. New York: Oxford University Press.
15.
Cyphers, G. (2001). Report from the child welfare workforce survey: State and county data and findings. Washington, DC: Author.
16.
Dhooper, S., Royse, D., & Wolfe, L. (1990). Does social work education make a difference?Social Work35, 57-61.
17.
Ellett, A. J. (2000). Human caring self-efficacy beliefs and professional organizational culture correlates of employee retention in child welfare. Unpublished doctoral dissertation, Louisiana State University, Baton Rouge.
18.
Ellett, A. J., Ellett, C. D., & Rugutt, J. (2003). A study of personal and organizational factors contributing to retention and turnover in child welfare in Georgia. Athens: School of Social Work, University of Georgia.
19.
Ellett, A. J., & Leighninger, L. (in press). What happened? An historical analysis of the de-professionalization in child welfare with implications for policy and practice. Journal of Public Child Welfare.
20.
Ellett, C. D., & Ellett, A. J. (1997). Statewide study of child welfare personnel factors: Who stays, who leaves, who cares? In T. Martin & M. Miah (Eds.), A national child welfare challenge: Creating partnerships to strengthen families and children. Proceedings of the National Conference on Child Welfare (pp. 61-71). Carbondale: Southern Illinois University.
21.
Ellett, C. D., & Garland, J. S. (1987). Teacher evaluation practices in our largest school districts: Are they living up to “state-of-the-art” systems?Journal of Personnel Evaluation in Education1,69-92.
22.
Ellis, J. (2005). Continued development and validation of a measure of human caring in child welfare. Unpublished doctoral dissertation, University of Georgia.
23.
Flower, C., McDonald, J., & Sumski, M. (2005). Review of turnover in Milwaukee County private agency welfare ongoing case management staff. Urbana-Champaign: Children and Family Research Center, University of Illinois.
24.
Fox, S., Burnham, D., Barbee, A. P., & Yankeelov, P. A. (2000). School to work—Social work that is: Maximizing agency/university partnerships in preparing public child welfare workers. Journal of the National Staff Development and Training Association1(1), 13-20.
25.
Fox, S., Miller, V., & Barbee, A. P. (2003). Finding and keeping child welfare workers: Effective use of training and professional development. Journal of Human Behavior in the Social Environment7, 67-82.
26.
Gall, M. D., Borg, W. R., & Gall, J. P. (1996). Educational research: An introduction. White Plains, NY: Longman.
27.
Gansle, K. A., & Ellett, A. J. (2002). Child welfare knowledge transmission, practitioner retention, and university-community impact: A study of Title IV-E child welfare training. Journal of Health & Social Policy15(3-4), 69-88.
28.
Harrison, S. C. (1995). Exploration of factors related to intent to leave among child welfare caseworkers. Dissertation Abstracts International The Humanities and Social Science 56(9), 3744-A.
29.
Hopkins, K. M., Mudrick, N. R., & Rudolph, C. S. (1999). Impact of university/agency partnerships in child welfare on organizations, workers and work activities. Child Welfare78, 749-773.
30.
Joint Committee on Standards for Educational Evaluation. (1988). The personnel evaluation standards: How to assess systems for evaluating educators. Newbury Park, CA: Corwin Press.
31.
Jones, L. P. (2002). A follow-up of a Title IV-E program's graduates' retention rates in a public child welfare agency. Journal of Health & Social Policy15(3-4), 39-51.
32.
Jones, L. P., & Okamura, A. (2000). Reprofessionalizing child welfare services: An evaluation of a Title IV-E training program. Research on Social Work Practice10, 607-621.
33.
Kern, H., McFadden, T., Baumann, D., & Law, J. (1993). Caseworker study part I: Burnout and turnover. Austin, TX: Department of Protective and Regularity Services.
34.
Lieberman, A., Hornby, H., & Russell, M. (1988). Analyzing the educational backgrounds and work experiences of child welfare personnel: A national study. Social Work33, 485-489.
35.
Longenecker, C. O., Sims, H. P., & Gioia, D. A. (1987). Behind the mask: The politics of employee appraisal. The Academy of Management Executive1, 183-193.
36.
Murphy, K. R., & Cleveland, J. N. (1995). Understanding performance appraisal: Social organization and goal-based perspectives. Thousand Oaks, CA: Sage.
37.
Murphy, S. (2005). Summary report of the Georgia Title IV-E/426 Program. Athens: University of Georgia.
38.
Pecora, P., Briar, K., & Zlotnik, J. (1989). Addressing the program and personnel crisis in child welfare. Silver Spring, MD: NASW.
39.
Robin, S. C., & Hollister, C. D. (2002). Career paths and contributions of four cohorts of IV-E funded MSW child welfare graduates. Journal of Health & Social Policy15(3-4), 53-68.
40.
Russell, M., & Hornby, H. (1987). 1987 National study of public child welfare job requirements. Portland, ME: National Child Welfare Resource Center for Management and Administration.
41.
Tucker, P. D. (1997). Lake Wobegon: Where all teachers are competent (Or, have we come to terms with the problem of incompetent teachers?). Journal of Personnel Evaluation in Education11,103-126.
42.
U.S. Government Accounting Office. (2003). Child welfare: HHS could play a greater role in helping child welfare agencies recruit and retain staff. Washington, DC: Author.
43.
Vinokur-Kaplan, D. (1991). Job satisfaction among social workers in public and voluntary child welfare agencies. Child Welfare70, 81-91.
