Objective: To determine the inter/intra-rater reliability of expert physiotherapists (PTs) measuring post-stroke shoulder pain with 100 mm vertical visual analogue scales (VAS; intensity, frequency and affective response) and a categorical site-of-pain scale.
Design: Three PTs independently rated subjects (normal clinical procedure but with a standardized starting position) on three days, at the same time of day, during one week in a randomized order determined by a nested latin square. Reliability for VAS scores was determined with the intraclass correlation coefficient (ICC) and for site-of-pain with the kappa statistic (. Acceptable reliability was set at 0.75. The limits of agreement were also calculated.
Setting: Community.
Subjects: Thirty-three patients, mean time post stroke 42 months (range 7–360).
Results: Mean inter-rater reliability was 0.79 for intensity, 0.75 for frequency and 0.62 for affective response (ICC). The limits of agreement were wide and rater bias was significant for 6/27 ratings. Mean intra-rater reliability was 0.70 for intensity, 0.77 for frequency and 0.69 for affective response (ICC). For site-of-pain inter-rater reliability ranged from 0.156 (to 0.385 (and intrarater reliability ranged from 0.300 (to 0.559 (.
Conclusions: Although inter-rater reliability was acceptable for intensity and frequency there was a consistently large systematic bias between pairs of raters. Agreement might be improved if a standardized assessment procedure was used and/or if training in pain behaviour interpretation was provided.
Get full access to this article
View all access options for this article.
References
1.
Warlow CP, Dennis MS, van Gijn J et al. What are this person's problems? A problem-based approach to the general management of stroke. In: Warlow CP, Dennis MS, van Gijn J et al. eds. Stroke: a practical guide to management. Oxford: Blackwell Science, 1996: 477–544.
2.
Roy CW, Sands MR, Hill LD. Shoulder pain in acutely admitted hemiplegics. Clin Rehabil1994; 8: 334–340.
3.
Roy CW, Sands MR, Hill L, Harrison A, Marshall S. The effect of shoulder pain on outcome of acute hemiplegia. Clin Rehabil1995; 9: 21–27.
4.
Kucukdeveci AA, Tennant A, Hardo P, Chamberlain AM. Sleep problems in stroke patients: relationship with shoulder pain. Clin Rehabil1996; 10: 166–172.
5.
Bruton JD. Shoulder pain in stroke patients with hemiplegia or hemiparesis following a cerebrovascular accident. Physiotherapy1985; 71: 2–4.
Roy CW. Shoulder pain in hemiplegia: a literature review. Clin Rehabil1988; 2: 35–44.
8.
Van Langenberghe HVK, Partridge CJ, Edwards MS, Mee R. Shoulder pain in hemiplegia – a literature review. Physiother Pract1988; 4: 155–162.
9.
Jespersen HF, Jorgensen HS, Nakayama H, Olsen TS. Shoulder pain after a stroke. Int J Rehabil Res1995; 18: 273–276.
10.
Parker VM, Wade DT, Hewer RL. Loss of arm function after stroke: measurement, frequency, and recovery. Int Rehabil Med1986; 8: 69–73.
11.
Ring H, Feder M, Berchadsky R, Samuels G. Prevalence of pain and malalignment in the hemiplegic's shoulder at admission for rehabilitation. A preventative approach. Eur J Phys Med Rehabil1993; 3: 199–203.
12.
Wanklyn P, Forster A, Young J. Hemiplegic shoulder pain (HSP): natural history and investigation of associated features. Disabil Rehabil1996; 18: 497–501.
13.
Bohannon RW, Andrews AW. Shoulder subluxation and pain in stroke patients. Am J Occup Ther1990; 44: 507–509.
14.
Faghri PD, Rodgers MM, Glaser RM, Bors JG, Ho C, Akanthota P. The effects of functional electrical stimulation on shoulder subluxation, arm function recovery and shoulder pain in hemiplegic stroke patients. Arch Phys Med Rehabil1994; 75: 73–79.
15.
Braus DF, Krauss JK, Strobel J. The shoulder-hand syndrome after stroke: a prospective clinical trial. Ann Neurol1994; 36: 728–733.
16.
Partridge CJ, Edwards SM, Mee R, Van Langenberghe HVK. Hemiplegic shoulder pain: a study of two methods of physiotherapy treatment. Clin Rehabil1990; 4: 43–49.
17.
Van Langenberghe HVK, Hogan BM. Degree of pain and grade of subluxation in the painful hemiplegic shoulder. Scand J Rehabil Med1988; 20: 161–166.
18.
Price DD, Harkins SW. Psychophysical approaches to pain assessment. In: Turk DC, Melzack R. Handbook of pain assessment. New York, London: The Guilford Press, 1992: 111–134.
19.
Price CIM, Curless RH, Rodgers H. Visual analogue scales after stroke: can validity be assumed?Cerebrovasc Dis1998; 8(suppl 4): 92-92.
20.
Kehayia E, Korner-Bitensky N, Singer F et al. Differences in pain medication use in stroke patients with aphasia and without aphasia. Stroke1997; 28: 1867–1870.
21.
Loeser JD, Fordyce WE. Chronic pain. In: Carr JE, Dengerik HA eds. Behavioural science in the practice of medicine. Amsterdam: Elsevier, 1983.
22.
Keefe FJ, Dunsmore J. Concepts and controversies. Am Pain Soc J1992; 1: 92–100.
23.
Hantson L, De Weerdt W, De Keyser J et al. The European Stroke Scale. Stroke1994; 25: 2215–2219.
24.
Goodglass H, Kaplan E. The assessment of aphasia and related disorders, second edition. Philadelphia: Lea and Febiger, 1983.
25.
Fullerton KJ, McSherry D, Stout RW. Albert's Test: a neglected test of perceptual neglect. Lancet1986; 1: 430–432.
26.
Demeurisse G, Demol O, Robaye E. Motor evaluation in vascular hemiplegia. Eur Neurol1980; 19: 382–389.
27.
Berg K, Wood-Dauphinee S, Williams JI, Maki B. Measuring balance in the elderly: validation of an instrument. Can J Public Health1992; 2: S7–S11.
28.
Eliaswziw M, Young SL, Woodbury MG, Fryday-Field K. Statistical methodology for the concurrent assessment of interrater and intra-rater reliability: using goniometric measurements as an example. Phys Ther1994; 74: 777–788.
29.
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet1986; 307–310.
30.
Fleiss JL, Slakter MJ, Fischman SL, Park MH, Chilton NW. Inter-examiner reliability in caries trials. J Dent Res1979; 58: 604–609.
31.
Guyatt GH, Townsend M, Berman LB, Keller JL. A comparison of Likert and visual analogue scales for measuring change in function. J Chronic Disabil1987; 12: 1129–1133.
32.
Swiwatanakul K, Kelvie W, Lasagna L, Calimlim JF, Weis OF, Mehta G. Studies with different types of visual analogue scales for measurement of pain. Clin Pharmacol Ther1983; 34: 234–239.
33.
Maxwell C. Sensitivity and accuracy of the visual analogue scale: a psycho-physical classroom experiment. Br J Clin Pharmacol1978; 6: 15–24.
