This article discusses the need for more rigorous evaluations due to the demands faced by today's intern, as well as the practical challenges faced by intern evaluators. Recommendations are provided to strengthen the process of intern evaluation. The strengths and weaknesses of scales that can be used to evaluate interns are discussed. A framework is given for developing an intern rating system, considering both what areas of intern training to evaluate and how to select appropriate content items. Finally, a 7-point intern professional growth scale is presented that focuses on the development of applied skills throughout the internship year. Exit criteria are offered.
Get full access to this article
View all access options for this article.
References
1.
Albott, W. (1984). Supervisory characteristics and other sources of supervision variance. Clinical Supervisor, 2, 27-41.
2.
Andrews, J. D. (1989). Integrating vision of reality: Interpersonal diagnosis and the existential vision. American Psychologist, 44, 803-817.
3.
Archer, R. , & Peake, T. (1984). Learning and teaching psychotherapy: Signposts and growth stages. Clinical Supervisor, 2, 61-74.
4.
Association of Psychology Internship Centers . (1988). APIC Membership Criteria. In C. H. Carrington (Ed.), Directory, internship programs in professional psychology (17th ed., pp. 6, 7) Washington, DC: Author.
5.
Baldwin, B. A. (1979). Crisis intervention: An overview of theory and practice. Counseling Psychologist, 8, 43-52.
6.
Barak, A. , & LaCrosse, M. B. (1975). Multidimensional perception of counselor behavior. Journal of Counseling Psychology, 2, 471-476.
7.
Barak, A. , & LaCrosse, M. B. (1977). Comparative perceptions of practicum counselor behavior. Counselor Education and Supervision, 16, 202-208.
8.
Bartlett, W. (1983). A multidimensional framework for the analysis of supervision of counseling. Counseling Psychologist, 11, 9-18.
9.
Bergin, A. E. , & Lambert, M. J. (1978). The evaluation of therapeutic outcomes. In S. L Garfield & A. E. Bergin (Eds.), Handbook of psychotherapy and behavior change (pp. 139-190). New York: Wiley.
10.
Beutler, L. E. (1983). Eclectic psychotherapy-A systematic approach. New York: Pergamon.
11.
Bishop, J. B. (1971). Another look at counselor, client, and supervisor ratings of counselor effectiveness. Counselor Education and Supervision, 10, 319-323.
12.
Borman, C. A. , & Ramirez, C. (1975). Evaluating counseling practicum students. Counselor Education and Supervision, 15, 48-54.
13.
Bruch, H. (1974). Learning psychotherapy: Rationale and ground rules. Cambridge, MA: Harvard University Press.
14.
Coche, E. (1977). Training of group therapist. In F. W. Kaslow (Ed.), Supervision, consultation, and staff training in the helping professions (pp. 235-263). San Francisco: Jossey-Bass.
15.
Cogan, D. B. , & Nobel, F. C. (1979). Ratings on a comprehensive set of counselor competencies. Counselor Education and Supervision, 19, 120-125.
16.
Cohen, L. (1980). The new supervisee views supervision. In A. K. Hess (Ed.), Psychotherapy supervision: Theory, research and practice (pp. 78-84). New York: Wiley.
17.
Cone, J. D. (1981). Psychometric considerations. In M. Hersen & A. S. Bellack (Eds.), Behavioral assessment: A practical handbook (2nd ed., pp. 38-68). New York: Pergamon.
18.
Echterling, L. G. , Hartsough, D. M., & Zarle, T. H. (1980). Testing a model for the process of telephone crisis intervention. American Journal of Community Psychology, 8, 715-725.
19.
Edelstein, B. A. , & Berler, E. S. (1987). Evaluation and accountability in clinical training. New York: Plenum.
20.
Finch, W. A. (1977). The role of the organization. In F. W. Kaslow (Ed.), Supervision, consultation and staff training in the helping professions (pp. 61-80). San Francisco: Jossey-Bass.
21.
Fitzgerald, L. F. , & Osipow, S. H. (1986). An occupational analysis of counseling psychology: How special is the specialty? American Psychologist, 41, 535-544.
22.
Fox, R. (1983). Contracting in supervision: A goal oriented process. Clinical Supervisor, 1, 37-49.
23.
Freeman, E. (1985). The importance of feedback in clinical supervision: Implications for direct practice. Clinical Supervisor, 3, 5-26.
24.
Friesen, D. E. , & Dunning, G. B. (1973). Peer evaluation and practicum supervision. Counselor Education and Supervision, 12, 229-233.
25.
Fuhriman, A. , & Burlingame, G. M. (1990). Consistency of matter: A comparative analysis of individual and group process variables. Counseling Psychologist, 18, 6-63.
26.
Gitterman, A. , & Miller, 1. (1977). Supervisors as educators. In F. W. Kaslow (Ed.), Supervision, consultation, and staff training in the helping professions (pp. 100-114). San Francisco: Jossey-Bass.
27.
Goodstein, L. D. (1978). Consulting with human service systems. Reading, MA: Addison-Wesley.
28.
Haase, R. F. , & Miller, C. D. (1968). Comparison of factor analytic studies of the Counseling Evaluation Inventory. Journal of Counseling Psychology, 15, 363-367.
29.
Haynes, S. N. (1984). Behavioral assessment of adults. In G. Goldstein & M. Hersen (Eds.), Handbook of psychological assessment. New York: Pergamon.
30.
Heppner, P. P. , & Roehlke, H. J. (1984). Differences among supervisees at different levels of training: Implications for a developmental model of supervision. Journal of Counseling Psychology, 31, 76-90.
31.
Hess, A. K. (1987). Psychotherapy supervision: Stages, blubber, and a theory of relationship. Professional Psychology: Research and Practice, 18, 251-259.
32.
Hill, L. E. , Charles, D., & Reed, K. G. (1981). A longitudinal analysis of changes in counseling skill during doctoral training in counseling psychology. Journal of Counseling Psychology, 28, 428-436.
33.
Holloway, E. L. (1984). Outcome evaluation in supervision research. Counseling Psychologist, 12, 167-174.
34.
Holloway, E. L. (1987). Developmental models of supervision: Is it development? Professional Psychology: Research and Practice, 18, 209-216.
35.
Holloway, E. L. , & Roehlke, H. J. (1987). Internship: The applied training of a counseling psychologist. Counseling Psychologist, 15, 205 -260.
36.
Hurst, J. C. , & Parker, C. A. (1977). Counseling psychology: Tyranny of a title. Counseling Psychologist, 7, 16-19.
37.
Kivlighan, D. M., Jr. (1990). Career group therapy. Counseling Psychologist, 18, 64-79.
38.
Linden, J. D. , Stone, S. C., & Shertzer, B. (1965). Development and evaluation of an instrument for rating counselors. Personnel and Guidance Journal, 44, 267-276.
39.
Lindsay, C. A. , Crowe, M. B., & Jacobs, D. F. (1987). Continuing professional education for clinical psychology: A practice oriented model. In B. A. Edelstein & E. S. Berler (Eds.), Evaluation and accountability in clinical training (pp. 331-363). New York: Plenum.
40.
Loganbill, L. , Hardy, E., & Delworth, U. (1982). Supervision: A conceptual model. Counseling Psychologist, 10, 3-42.
41.
Messer, S. (1986). Behavioral and psychoanalytic perspectives at therapeutic choice points. American Psychologist, 41, 1261-1271.
42.
Messer, S. , & Winokur, M. (1980). Some limits to the integration of psychoanalytic and behavior therapy. American Psychologist, 35, 818-827.
43.
Michaels, L. F. (1982). The development of an anchored rating scale for evaluating psychotherapy skills. Unpublished doctoral dissertation, Colorado State University, Ft. Collins.
44.
Miller, H. L. , & Rickard, H. C. (1983). Procedures and students' rights in the evaluation process. Professional Psychology: Research and Practice, 14, 497-503.
45.
Miller, R. K. , & Van Rybroek, G. J. (1988). Internship letters of recommendation: Where are the other 90%? Professional Psychology: Research and Practice, 19, 115-117.
46.
Myrick, R. D. , & Kelly, F. D. (1971). A scale for evaluating practicum students in counseling and supervision. Counselor Education and Supervision, 10, 330-336.
47.
Norcross, J. C. , & Stevenson, J. F. (1984). How shall we judge ourselves? Training evaluation in clinical psychology training programs. Professional Psychology: Research and Practice, 15, 497-508.
48.
Oetting, E. R. , & Michaels, L. (1982). Oetting/Michaels anchored ratings of therapists. Fort Collins, CO: Rocky Mountain Behavioral Science Institute.
49.
Orlinsky, D. E. , & Howard, K. 1. (1978). Relation of process to outcome in psychotherapy. In S. L. Garfield & A. E. Bergin (Eds.). Handbook of psychotherapy and behavior change (pp. 283-330). New York: Wiley.
50.
Osipow, S. H. , & Reed, R. A. (1987). Training and evaluation in counseling psychology. In B. A. Edelstein & E. S. Berler (Eds.), Evaluation and accountability in clinical training (pp. 117-133). New York: Plenum.
51.
Paravonian, S. D. (1981). Evaluating and grading pre-service counseling students. Counselor Education and Supervision, 20, 276-284.
52.
Parloff, M. B. , Waskow, I. E., & Wolfe, B. E. (1978). Research on therapist variables in relation to process and outcome. In S. L. Garfield & A. E. Bergin (Eds.), Handbook of psychotherapy and behavior change (pp. 233-282). New York: Wiley.
53.
Rabinowitz, F. , Heppner, P., & Roehlke, H. (1986). Descriptive study of process and outcome variables on supervision over time. Journal of Counseling Psychology, 33, 292-300.
54.
Rangel, D. , & Boxley, R. (1985). Clinical impairment in American Psychological Association approved internship programs. APIC Newsletter, 10, 18-21.
55.
Reising, G. N. , & Daniels, M. H. (1983). A study of Hogan's model of counselor development and supervision. Journal of Counseling Psychology, 30, 235-244.
56.
Richards, R. L. , Burlingame, G. M., & Fuhriman, A. (1990). Theme-oriented group therapy. Counseling Psychologist, 18, 80-92.
57.
Robbins, S. G. , May, T. M., & Corazzini, J. G. (1985). Perceptions of client needs and counseling center staff roles and functions. Journal of Counseling Psychology, 32, 641-644.
58.
Rogers, C. R. (1957). Training individuals to engage in the therapeutic process. In C. R. Strother (Ed.), Psychology and mental health (pp. 76-92). Washington, DC: American Psychological Association.
59.
Sechrest, L. , & Chatel, D. M. (1987). Evaluation and accountability in training for professional psychology. In B. A. Edelstein & E. S. Berler (Eds.), Evaluation and accountability in clinical training (pp. 1-37). New York: Plenum.
60.
Stoltenberg, C. D. , & Delworth, (1987). Supervising counselors and therapists. San Francisco: Jossey-Bass.
61.
Tedesco, J. (1982). Premature termination of psychology interns. Professional Psychology, 13, 695-698.
62.
Watkins, C. E., Jr. (1987). On myopia, rhetoric, and reality in counseling psychology. Counseling Psychologist, i5, 332-336.
63.
Watkins, C. E., Jr. , Lopez, F. G., Campbell, V. L., & Himmell, C. D. (1986). Contemporary counseling psychology: Results of a national survey. Journal of Counseling Psychology, 33, 301-309.
64.
Wiggins, J. S. (1973). Personality and prediction: Principles of personality assessment. Reading, MA: Addison-Wesley.
65.
Wiley, M. O'L. (1982, August). Developmental counseling supervision: Person-environment congruency, satisfaction, and learning. Paper presented at the annual meeting of the American Psychological Association, Washington, DC.
66.
Worthington, E. L. (1987). Changes in supervision as counselors and supervisors gain experience: A review. Professional Psychology: Research and Practice, 18, 189-208.
67.
Worthington, E. L., Jr. , & Stern, A. (1985). The effects of supervisor and supervisee degree level and gender on the supervisory relationship. Journal of Counseling Psychology, 32, 252-262.
68.
Zorski, J. J. , Bubenzer, D. L., & Walter, D. L. (1980). Counselor effectiveness and trainee helping qualities: Another view. Counselor Education and Supervision, 20, 15-21.
