Recent concerns about containing the growth of public expenditures on nursing home care and the development of prospective and casemix reimbursement systems with incentives for cost containment have increased the importance of monitoring quality in nursing homes. The current view is that quality assurance systems should include more outcome measures to improve quality. This article discusses why it is difficult to develop facilitylevel outcome measures that can be used to evaluate and compare the quality of care of nursing homes. The article places the current interest in outcomes measures in its historical policy context and reviews important conceptual and methodological issues associated with outcome-based quality assessment. The authors discuss the difficulty in isolating the facility effect when studying nursing home outcomes and implications of using different estimation approaches. In conclusion, they discuss the need to integrate research with outcome-based quality assurance systems to allow ongoing evaluation and quality improvement.
Get full access to this article
View all access options for this article.
References
1.
Angrist, J. D.
, Imbens, G. W., & Rubin, D. B. (1993). Identification of causal effects using instrumental variables. (NBER Technical Paper No. 136). Cambridge, MA: National Bureau of Economic Research.
2.
Bound, J.
, Jaeger, D., & Baker, R. (1993). The cure can be worse than the disease: A cautionary note regarding instrumental variables (Research Report No. 93-273). Ann Arbor: University of Michigan, Population Studies Center.
3.
Bryk, A.
, & Raudenbush, S., & Congdon, R. (1996). HLM Hierarchical linear and nonlinear modeling with the HLM/2L and HLM/3L programs. Chicago: Scientific Software International.
4.
Campbell, S.
(1997). Outcomes-based accreditation evolves slowly with JCAHO's Oryx initiative. Health Care Strategy Management, 15(4), 12-13.
5.
Christiansen, C. L.
, & Morris, C. N. (1997). Improving the statistical approach to health care provider profiling. Annals of Internal Medicine, 127(8, Pt. 2), 764-768.
6.
Cohen, J. W.
, & Spector, W. D. (1996). The effect of Medicaid reimbursement on quality of care in nursing homes. Journal of Health Economics, 15, 23-48.
7.
Consumers Union of U.S.
(1995). Nursing homes. When a loved one needs care. In search of the right home. Consumer Reports, 60(8), 518-534.
8.
Cox, B.
, & Cohen, S. (1985). Methodological issues forhealth care surveys: Statistics. Textbooks and monograph series (Vol. 61). New York: Dekker.
9.
Delong, E. R.
, Peterson, E. D., Delong, D. M., Muhlbaier, L. H., Hackett, S., & Mark, D. B. (1997). Comparing risk-adjustment methods for provider profiling. Statistics in Medicine, 16,2645-2664.
10.
Donabedian, A.
(1980). The definition of quality and approaches to its assessment (Vol. 1). Ann Arbor, MI: Health Administration Press.
11.
Feldman, J.
, & Boulter, C. (Eds.). (1991). Multistate nursing home case mix and quality demonstration training manual. Natick, MA: Eliot.
12.
Fiatarone, M. A.
, Marks, E. C., Ryan, N. D., Meredith, C. N., Lipsitz, L. A., & Evans, W. J. (1990). High intensity strength training in nonagenarians. Journal of the American Medical Association, 263(22), 3029-3034.
13.
Fisher, N. M.
, Pendergast, D. R., & Calkins, E. (1991). Muscle rehabilitation in impaired elderly nursing home residents. Archives of Physical Medicine and Rehabilitation, 72, 181-185.
14.
Fries, J. F.
, & Singh, G. (1996). The hierarchy of patient outcomes. In B. Spilker (Ed.), Quality of life and pharmacoeconomics in clinical trials (2nd ed., pp. 33-40.). Philadelphia: Lippincott-Raven.
15.
Garibaldi, R. A.
, Brodine, S., & Matsumiya, S. (1981). Infections among patients in nursing homes. New England Journal of Medicine, 305(15), 731-735.
16.
Garrard, J.
, Kane, R. L., Radosevich, D. M., Skay, C. L., Arnold, S., Kepferle, L., McDermott, S., & Buchanan, J. L. (1990). Impact of geriatric nurse practitioners on nursing-home residents' functional status, satisfaction, and discharge outcomes. Medical Care, 28, 271-283.
17.
Hannan, E. L.
, O'Donnell, J. F., Lukacik, G., & Chassin, M. R. (1994). New York state's cardiac surgery reporting system: Four years later. Annals of Thoracic Surgery, 58, 1852-1857.
18.
Hannan, E. L.
, Siu, A. L., Kumar, D., Kilburn, H., & Chassin, M. R. (1995). The decline in coronary artery bypass graft surgery mortality in New York state: The role of surgeon volume. Journal of the American Medical Association, 273, 209-213.
19.
Hausman, J. A.
(1978). Specification tests in econometrics. Econometrica, 46, 1251-1272.
20.
Hawes, C.
, Mor, V., Phillips, C. D., Fries, B. E., Morris, J. N., Steele-Friedlob, E., Greene, A. M., & Nennstief, M. (1997). The OBRA-87 nursing home regulations and implementation of the resident assessment instrument: Effects on process quality. Journal of the American Geriatrics Society, 45(8), 977-985.
21.
Health Care Financing Administration
. (1992). Medicare hospital information report. Washington, DC: Government Printing Office.
22.
Heckman, J.
, & Robb, R. (1986, March). Alternative methods for solving the problem of selection bias in evaluating the impact of treatments on outcomes. Economics Research Center NORC discussion paper. Cambridge, MA: National Bureau of Economic Research.
23.
lezzoni, L. I.
, Ash, A. S., Shwartz, M., Daly, J., Hughes, J. S., Mackiernan, Y. D. (1996). Judging hospitals by severity adjusted mortality rates: The influence of the severity-adjustment method. American Journal of Public Health, 86, 1379-1387.
24.
Iezzoni, L. I.
, Schwartz, M., Ash, A. S., Hughes, J. S., Daley, J., & Mackiernan, Y. D. (1996). Severity measurement methods and judging hospital death rates for pneumonia. Medical Care, 34, 11-28.
25.
Institute of Medicine
. (1986). Improving the quality of care in nursing homes. Washington, DC: National Academy Press.
26.
Judge, G. G.
, Griffiths, W. E., Hill, R. C., Lutkepohl, H., & Lee, T. (1985). The theory and practice of econometrics (2nd ed.). New York: John Wiley.
27.
Kane, R. L.
, Garrard, J., Skay, C. L., Radosevich, D. M., Buchanan, J. L., McDermott, S. M., Arnold, S. B., & Kepperle, L. (1989). Effect of a geriatric nurse practitioner on the process and outcomes of nursing home care. American Journal of Public Health, 79, 1271-1277.
28.
Lee, T.
(1985). The theory and practice of econometrics (2nd ed). New York: John Wiley.
29.
Legnini, M. W.
, Zach, A., & Richards, T. (1993). Annual report of the California hospital outcomes project. Sacramento, CA: Office of Statewide Health Planning and Development.
30.
Littell, R. C.
, Milliken, G. A., Stroup, W. W., & Wolfinger, R. D. (1996). SAS system for mixed models. Cary, NC: SAS Institute.
31.
Luft, H. S.
, & Brown, B. W. (1993). Calculating the probability of rare events: Why settle for an approximation?Health Services Research, 28(4), 419-439.
32.
Maddala, G. S.
(1983). Limited-dependent and qualitative variables in econometrics. Cambridge, UK: Cambridge University Press.
33.
Mor, V.
, Intrator, O., Fries, B. E., Phillips, C., Teno, J., Hiris, J., Hawes, C., & Morris, J. (1997). Changes in hospitalization associated with introducing the resident assessment instrument. Journal of the American Geriatrics Society, 45(8), 1002-1010.
34.
Morrissey, J.
(1997). Quality measures hit prime time. JCAHO's Oryx lights fire under providers. Modern Healthcare, 27(18), 66-76.
35.
Moseley, C. B.
(1997). The impact of restraints on nursing home resident outcomes. American Journal of Medical Quality, 12(2), 94-102.
36.
Mukamel, D. B.
(1997). Risk adjusted outcome measures and quality of care in nursing homes. Medical Care, 35, 367-385.
37.
Omnibus Budget Reconciliation Act of 1987 (OBRA-87), Pub. L. No. 100-203 (1987).
38.
Ouslander, J. G.
(1997). The resident assessment instrument (RAI): Promise and pitfalls. Journal of the American Geriatrics Society, 45(8), 975-976.
39.
Phelps, C. E.
(1992). Diffusion of information in medical care. Journal of Economic Perspective, 6, 23-42.
40.
Phillips, C. D.
, Morris, J. N., Hawes, C., Fries, B. E., Mor, V., Nenstiel, M., & Iannacchione, V. (1997). Association of the resident assessment instrument (RAI) with changes in function, cognition, and psychosocial status. Journal of the American Geriatrics Society, 45(8), 986-993.
41.
Potter, D.E.B.
(1996). Design and methods of the 1996 Medical Expenditure Panel Survey Nursing Home Component (MEPS Methodology Report No. 3, AHCPR Publication No. 97-0028). Rockville, MD: Agency for Health Care Policy and Research.
42.
Pryzbylski, B. R.
, Dumont, E. D., Watkins, M. E., Warren, S. A., Beaulne, A. P., & Lier, D. A. (1996). Outcomes of enhanced physical and occupational therapy service in a nursing home setting. Archives of Physical Medicine and Rehabilitation, 77(6), 554-561.
43.
Rogosa, D.
(1995). Myths and methods: "Myths about longitudinal research" plus supplemental questions. In J. M. Gottman (Ed.), The analysis of change (pp.3-66). Mahwah, NJ: Lawrence Erlbaum.
44.
Rosenthal, G. F.
(1997). Weak association between hospital mortality rates for individual diagnoses: Implications for profiling hospital quality. American Journal of Public Health, 87, 429-433.
45.
Rubenstein, L. Z.
, Robbins, A. S., Josephson, K. R., Schulman, B. L., & Osterweil, D. (1990). The value of assessing falls in an elderly population. Annals of Internal Medicine, 113, 308-316.
46.
Sackett, D.
, & Torrance, G. (1978). The utility of different health states as perceived by the general public. Journal of Chronic Diseases, 31, 697-704.
47.
Schnelle, J. F.
(1997). Can nursing homes use the MDS to improve quality?Journal of the American Geriatrics Society, 45(8), 1027-1028.
48.
Silber, J. H.
, & Rosenbaum, P. R. (1997). A spurious correlation between hospital mortality and complication rates: The importance of severity adjustment. Medical Care, 35(Suppl. 10), S77-S92.
49.
Sparer, M. S.
(1993). States in reformed health care system. Health Affairs, 12, 7-20.
50.
Spector, W. D.
, & Drugovich, M. (1988). Reforming nursing home quality regulation: Impact on cited deficiencies and nursing home outcomes. Medical Care, 27(8), 789-801.
51.
Spector, W. D.
, & Fortinsky, R. (1998). Pressure ulcers prevalence in Ohio nursing homes: Clinical and facility correlates. Journal of Aging and Health, 10, 62-80.
52.
Spector, W. D.
, & Takada, H. A. (1991). Characteristics of nursing homes that affect resident outcomes. Journal of Aging and Health, 3(4), 427-454.
53.
Torrance, G. W.
, Feeny, D. H., Furlong, W. J., Barr, R. D., Zhang, Y., Wang, Q. (1996). Multiattribute utility function for a comprehensive health system: Health utilities index mark 2. Medical Care, 34(7), 702-722.
54.
White, H.
(1982). Maximum likelihood estimation of misspecified models. Econometrica, 50(1), 1-25.
55.
Zeger, S.
, Liang, K., & Albert, P. (1988). Models for longitudinal data: A likelihood approach. Biometrics, 44, 1049-1060.
56.
Zimmerman, D. R.
, Karon, S. L., Clark, B. R., Collins, T., Ross, R. & Sainfort, F. (1995). Development and testing of nursing home quality indicators. Health Care Financing Review, 16(4), 107-128.
