The purpose of this study was to validate the measures included in the Counselor Response Observation System. The Counselor Response Observation System consists of the Counselor Response Coding System and the Skilled Verbal Responding Scale. Detailed results of their validity and reliability are presented.
AhnH.WampoldB. E. (2001). Where oh where are the specific ingredients? A meta-analysis of component studies in counseling and psychotherapy. Journal of Counseling Psychology, 48, 251–257.
2.
BakerS.DanielsT. (1989). Integrating research on the microcounseling program: A meta-analysis. Journal of Counseling Psychology, 36, 213–222.
3.
BakerS.DanielsT.GreeleyA. T. (1990). Systematic training of graduate-level counselors: Narrative and meta-analytic reviews of three major programs. The Counseling Psychologist, 18, 355–421.
4.
BarrettP. (2007). Structural equation modelling: Adjudging model fit. Personality and Individual Differences, 42, 815–824.
5.
BentlerP. M.ChouC. P. (1987). Practical issues in structural modeling. Sociological Methods & Research, 16, 78–117.
6.
BeutlerL. E.MachadoP.NeufeldS. (1994). Therapist variables. In BerginA. E.GarfieldS. L. (Eds.), Handbook of psychotherapy and behavior Change (4th ed. pp. 229–269). New York, NY: Wiley.
7.
CahillJ.BarkhamM.HardyG.GilbodyS.RichardsD.BowerP.ConnellJ. (2008). A review and critical appraisal of measures of therapist-patient interactions in mental health settings. Health Technology Assessment, 12(24), 1–58.
8.
CohenJ. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
9.
Crits-CristophP.BaranackieK.KurciasJ. S.CarrollK.LuborskyL.McLellanT.ZitrinC. (1991). Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1, 81–91.
10.
CuijpersP.van StratenA.AnderssonG.van OppenP. (2008). Psychotherapy for depression in adults: A meta-analysis of comparative outcome studies. Journal of Consulting and Clinical Psychology, 76, 909–922.
11.
DingerU.StrackM.LeichsenringF.WilmersF.SchauenburgH. (2008). Therapist effects on outcome and alliance in inpatient psychotherapy. Journal of Clinical Psychology, 64, 344–354.
12.
GrissomR. J. (1996). The magical number .7 ± .2: Meta-meta-analysis of the probability of superior outcome in comparisons involving therapy, placebo, and control. Journal of Consulting and Clinical Psychology, 64, 973–982.
13.
HorvathA. O.Del ReA. C.FlückigerC.SymondsD. (2011). Alliance in individual psychotherapy. In NorcrossJ. C. (Ed.), Psychotherapy relationships that work: Evidence-based responsiveness (2nd ed., pp. 25–69). New York, NY: Oxford University Press.
14.
HorvathA. O.SymondsB. D. (1991). Relation between working alliance and outcome in psychotherapy: A meta-analysis. Journal of Counseling Psychology, 38, 139–149.
15.
HuL. T.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.
16.
IveyA. E. (1971). Microcounseling: Innovations in interviewing training. Springfield, IL: Charles C. Thomas.
17.
IveyA. E.IveyM. B. (2007). Intentional interviewing and counseling: Facilitating client development in a multicultural society (6th ed.). Belmont, CA: Thomson Brooks/Cole.
18.
KaganN.KrathwolD. R.MillerR. (1963). Stimulated recall in therapy using videotape: A case study. Journal of Counseling Psychology, 10, 237–243.
19.
LambertM. J.BerginA. E.(1994). The effectiveness of psychotherapy. In BerginA. E.GarfieldS. L. (Eds.), Handbook of psychotherapy and behavior change (4th ed.,pp. 143–189). New York, NY: Wiley.
20.
LandisJ. R.KochG. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.
21.
LipseyM. W.WilsonD. B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181–1209.
22.
MacCallumR. C.BrowneM. W.SugawaraH. M.(1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.
23.
MacCallumR. C.HongS. (1997). Power analysis in covariance structure modeling using GFI and AGFI. Multivariate Behavioral Research, 32, 193–210.
24.
MartinD. J.GarskeJ. P.DavisM. K. (2000). Relation of the therapeutic alliance with outcome and other variables: A meta-analytic review. Journal of Consulting and Clinical Psychology, 68, 438–450.
25.
NaugleK. A.HallD. H. (1999). Evaluation of counselor performance and recommendations. Psychology: A Journal of Human Behavior, 36(3–4), 17–23.
26.
NunnallyJ. C. (1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill.
27.
OkiishiJ.LambertM. J.NielsenS. L.OglesB. M. (2003). Waiting for supershrink: An empirical analysis of therapist effects. Clinical Psychology & Psychotherapy, 10, 361–373.
28.
OkunB. (2002). Effective helping: Interviewing and counseling techniques (6th ed.). Pacific Grove, CA: Brooks/Cole.
29.
OrlinskyD. E.GraveK.ParksB. K. (1994). Process and outcome in psychotherapy: Noch einmal. In BerginA. E.GarfieldS. L. (Eds.), Handbook of psychotherapy and behavior change (pp. 257–310). New York, NY: Wiley.
30.
SmithM. L.GlassG. V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32, 752–760.
31.
SmithM. L.GlassG. V.MillerT. I. (1980). The benefits of psychotherapy. Baltimore, MD: Johns Hopkins University Press.
32.
TruaxC. B.CarkhuffR. R. (1967). Toward effective counseling and psychotherapy: Training and practice. Chicago, IL: Aldine.
33.
WalterS. D.EliasziwM.DonnerA. (1998). Sample size and optimal designs for reliability studies. Statistics in Medicine, 17, 101–110.
34.
WampoldB. E.MondinG. W.MoodyM.StichF.BensonK.AhnH. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, “All must have prizes.”Psychological Bulletin, 122, 203–215.
