Inter-Rater Reliability of Assessments Administered by Individuals with and without a Background in Health Care

Abstract

As part of a randomized controlled trial, a pilot study was conducted to determine the inter-rater reliability of four assessments administered by individuals with and without a background in health care. The assessments included in the study were the Barthel Index (Mahoney & Barthel, 1965), the Mini Mental Status Examination (Folstein, Folstein, & McHugh, 1975), the Philadelphia Geriatric Center Morale Scale (Lawton, 1975), and the Instrumental Activities of Daily Living Scale (Lawton & Brody, 1969).

The scores of three assessors, one senior occupational therapist, and two research assistants were examined. The research assistants were trained to administer the assessments by the occupational therapist but had no previous background in health care.

Inter-rater reliability for the measures varied from .97 to 1.00 indicating that, with adequate training, research assistants with no health care background could administer the assessments in a consistent manner.

Keywords

measurement occupational therapy research assistants reliability

Get full access to this article

View all access options for this article.

References

Deyo

R. A.

(1984). Measuring functional outcomes in therapeutic trials for chronic disease. Controlled Clinical Trials, 5, 223–240.

Fillenbaum

G. G.

Heyman

Wilkinson

W. E.

, & Haynes

C. S.

(1987). Comparison of two screening tests in Alzheimer's disease: The correlation and reliability of the Mini-Mental State examination and the modified Blessed test. Archives of Neurology, 44, 924–927.

Folstein

M. F.

Folstein

S. E.

, & McHugh

P. R.

(1975). Mini-Mental State: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189.

Granger

C. V.

Albrecht

G. L.

, & Hamilton

B. B.

(1979). Outcome of comprehensive medical rehabilitation: Measurement by Pulses profile and the Barthel index. Archives of Physical Medicine and Rehabilitation, 60,145–154.

Kivela

S-L.

(1984). Measuring disability—Do self-ratings and service provider ratings compare? Journal of Chronic Diseases, 37(2), 115–123.

Kuriansky

J. B.

Gurland

B. J.

, & Fleiss

J. L.

(1986). The assessment of self-care capacity in geriatric psychiatric patients by objective and subjective methods. Journal of Clinical Psychology, 32(1), 95–102.

Law

(1989). Clinical Research: A priority for occupational therapists in Canada. Canadian Journal of Occupational Therapy, 56(2), 57–59.

Lawton

M. P.

(1972). The dimensions of morale. In Kent

D. P.

Kastenbaum

Sherwood

(Eds.), Research planning and action for the elderly: The power and potential of social sciences (pp. 144–165). New York: Behavioral Publications.

Lawton

M. P.

(1975). The Philadelphia Geriatric Center Morale Scale: A revision. Journal of Gerontology, 30, 85–89.

10.

Lawton

M. P.

, & Brody

E. M.

(1969). Assessment of older people: Self-maintaining and instrumental activities of daily living. Gerontologist, 9, 179–186.

11.

Mahoney

F. I.

, & Barthel

D. W.

(1965). Functional evaluation: The Barthel index. Maryland State Medical Journal, 14, 61–65.

12.

Ottenbacher

K. J.

(1987). Research: Its importance to clinical practice in Occupational Therapy. American Journal of Occupational Therapy, 41(4), 213–215.

13.

Oyster

C. K.

Hanten

W. P.

, & Llorens

L. A.

(1987). Introduction to research: A guide for the health science professional. Philadelphia: J. B. Lippincott Company.

14.

Streiner

D. L.

, & Norman

G. R.

(1990). Health Measurement Scales: A practical guide to their development and use. Oxford, England; New York: Oxford University Press.

15.

Yerxa

E. J.

(1987). Research: The key to the development of occupational therapy as an academic discipline. American Journal of Occupational Therapy, 41(7), 415–419.