Assessment of Disabilities in Stroke Patients with Apraxia: Internal Consistency and Inter-Observer Reliability

Abstract

In this paper the internal consistency and inter-observer reliability of the assessment of disabilities in stroke patients with apraxia is presented. Disabilities were assessed by means of observation of activities of daily living (ADL). The study was conducted at occupational therapy departments in general hospitals, rehabilitation centers and nursing homes in the Netherlands. Patients (n=42) diagnosed to have had a stroke in the left hemisphere and to have apraxia as well, participated in the study (48% male, aged 39–91). Guidelines were offered for the ADL-observation and the assessment of disabilities in these activities. The internal consistency of the scales is expressed by means of Cronbach's alpha and Mokken-scale analysis. The inter-observer reliability is expressed by means of percentage of agreement between two observers, Cohen's kappa and the intra-class correlation coefficient (ICC). The internal consistency of the observations is good: alpha is high (0.94). The Mokken-analysis confirms this finding: an H-coefficient of 0.58 and corresponding rho of 0.94 indicate a strong and reliable scale composed of the set of all ADL-observations. Results indicate that the inter-observer reliability can be considered fair to good: all kappa values were higher than 0.44; the maximum kappa was 0.95. Percentages of agreement vary between 60% and 96%. The ICC range from 0.62 to 0.98. The results of this study imply that the ADL-observations can be considered an internally consistent and reliable instrument for the assessment of disabilities in stroke patients with apraxia.

Keywords

apraxia stroke assessment disabilities inter-observer reliability internal consistency

Get full access to this article

View all access options for this article.

References

Arnadottir

(1990). The brain and behaviour. Assessing cortical dysfunction through activities of daily living. St Louis: Mosby Company.

Berk

R.A.

(1979). Generalizability of behavioural observations: A clarification of intra-observer agreement and inter-observer reliability. American Journal of Mental Deficiency, 83 (5), 460–472.

Brennan

& Silman

(1992). Statistical methods for assessing observer variability in clinical measures. British Medical Journal, 304, 1491–1994.

Chau

Daler

Andre

J.M.

Patris

(1994). Inter-rater agreement of two functional independence scales: The Functional Independence Measure (FIM) and a subjective uniform continuous scale. Disability and Rehabilitation, 16 (nr. 2), 63–71.

Cohen

(196)). A coefficient for agreement for nominal scales. Educational Psychological Measures, 20, 37–46.

Cronbach

L.J.

(1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–333.

De Renzi

(1989). Apraxia. In Boiler

& Gralman

(Eds.). Handbook of Neuropsychology, Volume 2. Amsterdam: Elseviers Science Publishers B.V.

De Renzi

Motti

& Nichelli

(1980). Imitating gestures: A quantitative approach to ideomotor apraxia. Archives of Neurology, 37, 6–10.

De Renzi

Faglioni

& Sorgato

(1982). Modality specific and supramodal mechanisms of apraxia. Brain, 105, 301–312.

10.

De Renzi

& Lucchelli

(1988). Ideational apraxia. Brain, 111, 1173–1185.

11.

Donders

F.C.

(1969). On the speed of mental processes. In Koster

W.G.

(Ed. & Trans.), Attention and Performance II. Amsterdam: North-Holland (original work 1868).

12.

Drenth

P.J.D.

& Sijtsma

(1990). Testtheorie. Inleiding in de theorie van de psychologische test en zijn toepassingen. Houten/Zaventem: Bohn Stafleu van Loghum.

13.

Driessen

M.J.

Dekker

Lankhorst

G.J.

& Van der Zee

(1995). Interrater and intrarater reliability of the occupational therapy diagnosis. Occupational Therapy Journal of Research, 15, 259–274.

14.

Fleiss

(1981). Statistical methods for rates and proportions, 2nd ed. New York: John Wiley.

15.

Grieve

(1993). Neuropsychology for occupational therapists; assessment of perception and cognition. Oxford: Blackwell Scientific Publishers.

16.

de Haan

(1994). Clinimetrics in stroke [dissertation]. Amsterdam: University of Amsterdam.

17.

Heilman

K.M.

& Gonzalez-Rothi

L.J.

(1985). Apraxia. In: Heilman

K.M.

& Valenstein

, (Eds.). Clinical Neuropsychology, 2nd ed. Oxford University Press.

18.

Heugten

C.M.

van Dekker

Deelman

B.G.

Stehmann-Saris

J.C.

& Kinebanian

(1997). A diagnostic test for apraxia in stroke patients: Internal consistency and diagnostic value. Accepted for publication. The Clinical Neuropsychologist.

19.

Kolb

& Whishaw

I.Q.

(1990). Fundamentals of human neuropsychology, 3rd ed. New York: Freeman.

20.

Mokken

R.J.

(1971). A theory and procedure of scale analysis. Mouton, Den Haag.

21.

Mokken

R.J.

& Lewis

(1982). A nonparametric approach to the analysis of dichotomous item responses. Applied Psychological Measures, 6(4), 417–430.

22.

Molenaar

I.W.

Debets

Sijtsma

& Henker

B.T.

(1994). MSP: A program for Mokken scale analysis for polytomous items. Groningen: Progamma.

23.

Roebroeck

M.E.

(1994). Clinical assessment of muscle function with a computer-assisted hand-held dynamometer [dissertation]. Amsterdam: Free University.

24.

Roorda

L.D.

Roebroeck

M.E.

Lankhorst

G.J.

van Tilburg

& Bouter

L.M.

(1996). Measuring functional limitations in rising and sitting down: Development of a questionnaire. Archives of Physical Medicine and Rehabilitation Clinics of North America, 77, 663–669.

25.

Sanders

A.F.

(1980). Stage analysis of reaction processes. In Stelmach

G.E.

& REquin

(Eds.), Tutorials in motor behaviour. Amsterdam: North-Holland.

26.

Schmidt

R.A.

(1988). Motor control and learning. Champaign: Human Kinetic Publishers Inc.

27.

Schouten

H.J.A.

(1985). Statistical measurement of interobserver agreement [dissertation]. Utrecht: University of Utrecht.

28.

Shelton

P.A.

& Knopman

D.S.

(1991). Ideomotor apraxia in Huntington's disease. Archives of Neurology, 48, 35–41.

29.

Shout

P.E.

& Fleiss

J.L.

(1979). Intra-class correlations: Use in assessing rater-reliability. Psychological Bulletin, 86, 420–428.

30.

Smith

D.S.

& Clark

M.S.

(1995). Competence and performance in activities of daily living of patients following rehabilitation from stroke. Disability and Rehabilitation, 17, 15–23.

31.

Soeken

K.L.

& Prescott

P.A.

(1986). Issues in the use of kappa to estimate reliability. Medical Care, 24, 8, 733–741.

32.

Wade

D.T.

(1992). Measurement in neurological rehabilitation. Oxford: Oxford University Press.