To obtain initial results with regard to the reliability and validity of the Client Satisfaction Inventory (CSI), a 25-item scale for measuring general satisfaction with services among clients of human service agencies.
Method
The CSI was administered to 329 clients of 11 agencies in six states. Also administered were three other standardized measures and a brief descriptive questionnaire, results from which were used to assess the discriminant validity of the CSI.
Results
Findings indicated that both the full version of the CSI and a 9-item short-form version, the CSI-SF, have good to excellent internal consistency. Item analyses also provided some affirmative evidence with regard to the content validity of both versions, and the presence of hypothesized relationships between client satisfaction scores and those of the other instruments offered indications of good discriminant validity for each version.
Conclusion
Accountability demands, including pressures associated with managed care, have created a need in many agencies for brief, accurate, and norm-referenced measures of client satisfaction. Although further research is needed, initial results suggest that the CSI and CSI-SF may be useful tools for meeting this need.
Get full access to this article
View all access options for this article.
References
1.
AttkissonC. C., & GreenfieldT. K. (1994). Client Satisfaction Questionnaire-8 and Service Satisfaction Scale-30. In MariushM. E. (Ed.), The use of psychological testing for treatment planning and outcome assessment (pp. 402–420). Hillsdale, NJ: Lawrence Erlbaum.
2.
AttkissonC. C., & ZwickR. (1982). The Client Satisfaction Questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome.Evaluation and Program Planning, 6, 299–314.
3.
BegleyK., RossM. W., AustinP., CaseyK., CollinsP., HenningsG., AgriestiL., & MarshallK. (1994). Development and evaluation of an inventory for rating client satisfaction with outcome in HIV counseling: The Albion Center Scale.Patient Education and Counseling, 24, 341–345.
4.
BloomM., FischerJ., & OrmeJ. G. (1999). Evaluating practice: Guidelines for the accountable professional (3rd ed.). Boston: Allyn & Bacon.
5.
BlytheB., TripodiT., & BriarS. (1994). Direct practice research in human service agencies.New York: Columbia University Press.
6.
CampbellD. T., & FiskeD. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 56, 81–105.
7.
ClareL., & PistrangN. (1995). Parents’ perceptions of portage: Towards a standardized measure of parent satisfaction.British Journal of Learning Disabilities, 23, 110–117.
8.
CournoyerD. E., & JohnsonH. C. (1991). Measuring parents’ perceptions of mental health professionals.Research on Social Work Practice, 1, 399–415.
9.
CoxJ. B., BrownT. R., PetersonP. D., & RoweM. M. (1982). A report on a statewide community mental health center outcome study.Community Mental Health Journal, 18, 135–150.
10.
FeigenbaumA. (1983). Total quality control (3rd ed.). New York: McGraw-Hill.
11.
FurstD., BoeverW., CohenJ., DowdT., DalyD., & CristeT. (1993). Implementation of the Boys Town psychoeducational treatment model in a children's psychiatric hospital.Hospital and Community Psychiatry, 44, 863–868.
12.
GlassA. P. (1995). Identifying issues important to patients on a hospital satisfaction questionnaire.Psychiatric Services, 46, 83–85.
13.
GreenfieldT. K., & AttkissonC. C. (1989). Progress toward a multifactorial Service Satisfaction Scale for evaluating primary care and mental health services.Evaluation and Program Planning, 12, 271–278.
14.
HersenM., & BarlowD. H. (1976). Single case experimental designs: Strategies for studying behavior change.New York: Pergamon.
15.
HolcombW. R., AdamsN. A., PonderH. M., & ReitzR. (1989). The development and construction validation of a consumer satisfaction questionnaire for psychiatric inpatients.Evaluation and Program Planning, 12, 189–194.
16.
HorvathA. O., & GreenbergL. S. (1989). Development and validation of the Working Alliance Inventory.Journal of Counseling Psychology, 36, 223–233.
17.
HudsonW. W. (1982). The clinical measurement package: A field manual.Chicago: Dorsey.
18.
HudsonW. W. (1990). The MPSI technical manual.Tempe, AZ: WALMYR.
19.
HudsonW. W. (1992). The WALMYR assessment scales scoring manual.Tempe, AZ: WALMYR.
20.
JuJ. J., & ThomasK. R. (1987). The accuracy of counselor perceptions of client work values and client satisfaction.Rehabilitation Counseling Bulletin, 30, 157–166.
21.
KincaidJ. P., AagardJ. A., O'HaraJ. W., & CottrellL. W. (1981). Computer readability editing system.IEEE Transactions on Professional Communications, 24, 38–41.
22.
LarsenD. L., AttkissonC. C., HargreavesW. A., & NguyenT. D. (1979). Assessment of client/patient satisfaction: Development of a general scale.Evaluation and Program Planning, 2, 197–207.
23.
LebowJ. L. (1983). Research assessing consumer satisfaction with mental health treatment: A review of findings.Evaluation and Program Planning, 6, 211–236.
24.
LoveR. E., CaidC. D., & DavisA.Jr. (1979). The user satisfaction survey: Consumer evaluation of an inner city community mental health center.Evaluation and the Health Professions, 2, 42–54.
25.
MartinL. L., & KettnerP. M. (1996). Measuring the performance of human service programs.Thousand Oaks, CA: Sage.
26.
McNaughtonD. (1994). Measuring parent satisfaction with early childhood intervention programs: Current practices, problems, and future perspectives.Topics in Early Childhood Special Education, 14, 26–48.
27.
MooreS. T., & KellyM. J. (1996). Quality now: Moving human services organizations toward a consumer orientation to service quality.Social Work, 41(1), 33–40.
28.
NguyenT. D., AttkissonC. C., & StegnerB. L. (1983). Assessment of patient satisfaction: Development and refinement of a Service Evaluation Questionnaire.Evaluation and Program Planning, 6, 299–314.
29.
NickersonK. J., HelmsJ. E., & TerrellF. (1994). Cultural mistrust, opinions about mental illness, and black students’ attitudes toward seeking psychological help from white counselors.Journal of Counseling Psychology, 41, 378–385.
30.
NunnallyJ. C., & BernsteinI. H. (1994). Psychometric theory.New York: McGraw-Hill.
31.
ReidP. N., & GundlachJ. H. (1983). A scale for the measurement of client satisfaction in the social services.Journal of Social Service Research, 7, 37–54.
32.
RifkinL., WolfM., LewisC., & PantellR. (1988). Children's perceptions of physicians and medical care: Two measures.Journal of Pediatric Psychology, 13, 247–254.
33.
RobertsR. E., & AttkissonC. C. (1983). Assessing client satisfaction among Hispanics.Evaluation and Program Planning, 6, 401–413.
34.
RosenthalJ. A. (1994). Reliability and social work research.Social Work Research, 18, 115–121.
35.
RouseL. W., MacCabeN., & TopracM. G. (1994, March). Measuring satisfaction with community-based services for severely emotionally disturbed children: A comparison of questionnaires for children and parents. Paper presented at the Seventh Annual Research Conference for a “System of Care” for Children's Mental Health, Tampa, FL.
36.
SaylorJ. H. (1996). TQM simplified: A practical guide (2nd ed.). New York: McGraw-Hill.
37.
SimonianS., TarnowskiK., ParkA., & BekenyP. (1993). Child, parent and physician perceived satisfaction with pediatric outpatient visits.Developmental and Behavioral Pediatrics, 14, 8–12.
38.
SpensleyJ., EdwardsD., & WhiteE. (1980). Patient satisfaction and involuntary treatment.American Journal of Orthopsychiatry, 50, 725–727.
39.
StallardP. (1996). Validity and reliability of the Parent Satisfaction Questionnaire.British Journal of Clinical Psychology, 35, 311–318.
40.
StevensS. S. (1968). Ratio scales of opinion. In WhitlaD. K. (Ed.), Handbook of measurement and assessment in behavioral science (pp. 171–199). Reading, MA: Addison-Wesley.
41.
StilesW. B., & SnowJ. S. (1984). Counseling session impact as seen by novice counselors and their clients.Journal of Counseling Psychology, 31, 3–12.
42.
Stüntzer-GibsonD., KorenP. E., & DeChilloN. (1995). The Youth Satisfaction Questionnaire: What kids think of services.Families in Society, 76, 616–624.
43.
TalleyJ. E., ButcherA. T., & MoormanJ. C. (1992). Client satisfaction with very brief psychotherapy. In TalleyJ. L. (Ed.), The predictors of successful very brief psychotherapy (pp. 46–84). Springfield, IL: Charles C. Thomas.
44.
TannerB. A. (1981). Factors influencing client satisfaction with mental health services: A review of quantitative research.Evaluation and Program Planning, 4, 279–286.
45.
ThyerB. A. (1996). Guidelines for applying the empirical clinical practice model to social work.Journal of Applied Social Sciences, 20, 121–127.
46.
WareJ. E., & DaviesA. R. (1983). Behavioral consequences of consumer dissatisfaction with medical care.Evaluation and Program Planning, 6, 291–298.
47.
WestraB. L., CullenL., BrodyD., & JumpP. (1995). Development of the Home Care Client Satisfaction Instrument.Public Health Nursing, 12, 393–399.
48.
YoungA. T. (1995). Quality assurance. In Encyclopedia of social work (19th ed., Vol. 3, pp. 2016–2018). Washington, DC: National Association of Social Workers.
49.
YoungS. C., NicholsonJ., & DavisM. (1995). An overview of issues in research on consumer satisfaction with child and adolescent mental health services.Journal of Child and Family Studies, 4, 219–238.
50.
ZinnJ. S., Lavizzo-MoureyR., & TaylorL. (1993). Measuring satisfaction with care in the nursing home setting: The Nursing Home Resident Satisfaction Scale.Journal of Applied Gerontology, 12, 452–465.
