The authors provide psychometric support for the comprehensive counseling skills rubric (CCSR). The CCSR is designed to assess trainee’s counseling proficiency, identify how counseling skills are used within phases of a counseling session, and evaluate the counseling relationship. The CCSR content validity was verified with an overall mean item content validity index of .81. There was a strong domain-level internal consistency reliability (.73 to .84). Fleiss’ κ of .70 demonstrated substantial interrater reliability. Thus, the results indicate initial support for using the CCSR as a transtheoretical instrument designed to assess a counseling trainee’s ability to execute the counseling experience.
BernardJ. M.GoodyearR. K. (2014). Fundamentals of clinical supervision (5th ed.). Upper Saddle River, NJ: Pearson.
2.
BhatC. S. (2005). Enhancing counseling gatekeeping with performance appraisal protocols. International Journal for the Advancement of Counselling, 27, 399–411. doi:10.1007/s10447-005-8202-z
3.
ChurchillG. A.PeterJ. P. (1984). Research design effects on the reliability of rating scales: A meta-analysis. Journal of Marketing Research, 21, 360–375. doi:10.2307/3151463
4.
CoreyG. (2013). Theory and practice of counseling and psychotherapy (9th ed.). Pacific Grove, CA: Cengage.
5.
CormierS.NuriusP. S.OsbornC. J. (2009). Interviewing and change strategies for helpers: Fundamental skills and cognitive behavioral interventions (6th ed.). Pacific Grove, CA: Cengage.
CreswellJ. W.Plano ClarkV. L. (2010). Designing and conducting mixed methods research (2nd ed.). Thousand Oaks, CA: Sage.
9.
CronbachL. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334. doi:10.1007/BF02310555
10.
DanielsJ. A.LarsonL. M. (2001). The impact of performance feedback on counseling self-efficacy and counselor anxiety. Counselor Education and Supervision, 41, 120–130. doi:10.1002/j.1556-6978.2001.tb01276.x
11.
EriksenK.McAuliffeG. (2003). A Measure of Counselor Competency. Counselor Education and Supervision, 43, 120–133. doi:10.1002/j.1556-6978.2003.tb01836.x
12.
FleissJ. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76, 378–382. doi:10.1037/h0031619
13.
GaubatzM. D.VeraE. M. (2002). Do formalized gatekeeping procedures increase programs’ follow-up with deficient trainees?. Counselor Education and Supervision, 41, 294–305. doi:10.1002/j.1556-6978.2002.tb01292.x
14.
GreenH. (2011). Skills training and self-esteem: Educational and clinical perspectives on giving feedback to clinical trainees. Behavior Change, 28, 87–96. doi:10.1375/bech.28.2.87
15.
HackneyH.CormierS. (2012). The professional counselor: A process guide to helping (6th ed.). Upper Saddle River, NJ: Pearson.
16.
HamletH. S.BurnesT. (2013). Professional school counseling internship: Developmental assessment of counseling skills (CIDACS). Counseling Outcome Research and Evaluation, 4, 55–71doi:10.1177/2150137812472196
17.
HorvathA.O.GreenbergL.S. (1989). Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology, 36, 223–233. doi:10.1037/0022-0167.36.2.223
18.
IveyA.IveyM.ZalaquettC. (2010). Intentional interviewing and counseling: Facilitating client development in a multicultural society (7th ed.). Belmont, CA: Brooks/Cole.
19.
KocarekC. E.TalbotD. M.BatkaJ. C.AndersonM. Z. (2001). Reliability and validity of three measures of multicultural competency. Journal of Counseling and Development, 79, 486–496doi:10.1002/j.1556-6676.2001.tb01996.x
20.
LarsonL. M.SuzukiL. A.GillespieK. N.PotenzaM. T.BechtelM. A.ToulouseA. L. (1992). Development and validation of the Counseling Self-Estimate Inventory. Journal of Counseling Psychology, 39, 105–120. doi:10.1037/0022-0167.39.1.105
21.
LynnM. R. (1986). Determination and quantification of content validity. Nursing Research, 35, 382–385. doi:10.1097/00006199-198611000-00017
22.
MotleyV.ReeseM. K.CamposP. (2014). Evaluating corrective feedback self-efficacy changes among counselor educators and site supervisors. Counselor Education and Supervision, 53, 34–46. doi:10.1002/j.1556-6978.2014.00047.x
23.
PolitD. F.BeckC.T. (2006). Essentials of nursing research: Appraising evidence for nursing practice (6th ed.). Philadelphia, PA: Lippincott Williams & Wilkins.
24.
PonterottoJ.PotereJ. (2003). The multicultural counseling knowledge and awareness scale (MCKAS): Validity, reliability, and user guidelines. In Pope-DavisD.ColemanH.LiuW.ToporekR. (Eds.), Handbook of multicultural competencies in counseling & psychology. (pp. 137–154). Thousand Oaks, CA: Sage.
25.
PorterE. J. (1943). The development and evaluation of a measure of counseling interview procedures’, II. The evaluation. Educational and Psychological Measurement, 3, 215–238.
26.
SaldanaJ. (2009). The coding manual for qualitative researchers. Thousand Oaks, CA: Sage.
27.
SchoenerG. R. (1999). Practicing what we preach. The Counseling Psychologist, 27, 693–701. doi:10.1177/0011000099275003
28.
SkovholtT. M.RonnestadM. H. (1992). Themes in therapist and counselor development. Journal of Counseling and Development, 70, 505–515. doi:10.1002/j.1556-6676.1992.tb01646.x
29.
SodowskyG. R.TaffeR. C.GutkinT. B.WiseS. L. (1994). Development of the Multicultural Counseling Inventory: A self-report measure of multicultural competencies. Journal of Counseling Psychology, 41, 137–148. doi:10.1037/0022-0167.41.2.137
30.
StoltenbergC. D.DelworthU. (1987). Supervising counselors and therapists. San Francisco, CA: Jossey-Bass.
31.
SwankJ. M.LambieG. W.WittaE. L. (2012). An exploratory investigation of the Counseling Competencies Scale: A measure of counseling skills, dispositions, and behaviors. Counselor Education and Supervision, 51, 189–206. doi:10.1002/j.1556-6978.2012.00014.x
32.
SwankJ. M.Smith-AdcockS. (2013). Creative group strategies for interviewing applicants for counselor education programs. Journal of Counselor Preparation and Supervision, 5, 38–48. doi:10.7729/51.0039
33.
TruaxC.CarkhuffR. (1967). Toward effective counseling and psychotherapy. Chicago, IL: Aldine.
34.
YoungM. A. (2013). Learning the art of helping: Building blocks and techniques (5th ed.). Upper Saddle River, NJ: Merrill Prentice Hall.
35.
Ziomek-DaigleJ.ChristensenT. M. (2010). An emergent theory of gatekeeping practices in counselor education. Journal of Counseling and Development, 88, 407–415. doi:10.1002/j.1556-6678.2010.tb00040.x
