The short version of the Problem Behaviours Assessment (PBA-s) is the recommended outcome measure for behavioural symptoms in Huntington’s disease. Rasch analysis was used to further investigate the measurement limitations of the PBA-s.
Objectives:
1) To assess the psychometric properties of the 11 severity and frequency items within the PBA-s and 2) to determine the construct validity of using a total PBA-s score as a clinical outcome measure.
Methods:
PBA-s data for 517 participants from Enroll-HD were included in the Rasch analysis. Separate analyses were conducted for the severity and frequency items of the PBA-s, using RUMM2030 software. Achieving fit to the model provides supporting evidence that all items contribute to a single underlying latent trait. This property is defined as internal construct validity.
Results:
The total PBA-s severity score demonstrated several important limitations, including disordered response categories for all 11 severity items, local dependency and poor targeting. However, modifying the original five-point scoring system to a four-point system resulted in ordered response categories for seven of the severity items and achieved a good overall fit to the Rasch model. For the total PBA-s frequency score, fit to the model was not achieved even after amendments to the scoring system.
Conclusions:
This study suggests that with reduction to a four-point scoring system, the total PBA-s severity score may be considered a valid clinical outcome measure. This study also suggests limitations in the use of a total PBA-s frequency score.
A novel gene containing a trinucleotide repeat that is expanded and unstable on Huntington’s disease chromosomes. The Huntington’s Disease Collaborative Research Group. Cell. 1993;72(6):971–83.
3.
PringsheimT, WiltshireK, DayL, DykemanJ, SteevesT, JetteN. The incidence and prevalence of Huntington’s disease: A systematic review and meta-analysis. Mov Disord. 2012;27(9):1083–91.
4.
EvansKR, SillsT, DeBrotaDJ, GelwicksS, EngelhardtN, SantorD. An Item Response analysis of the Hamilton Depression Rating Scale using shared data from two pharmaceutical companies. J Psychiatr Res. 2004;38(3):275–84.
5.
HoAK, GilbertAS, MasonSL, GoodmanAO, BarkerRA. Health-related quality of life in Huntington’s disease: Which factors matter most? Mov Disord2009;24(4):574–8.
6.
HamiltonJM, SalmonDP, Corey-BloomJ, GamstA, PaulsenJS, JerkinsS, et al. Behavioural abnormalities contribute to functional decline in Huntington’s disease. J Neurol Neurosurg Psychiatry. 2003;74(1):120–2.
7.
MarderK, ZhaoH, MyersRH, CudkowiczM, KaysonE, KieburtzK, et al. Rate of functional decline in Huntington’s disease. Huntington Study GrouNeurology. 2000;54(2):452–8.
8.
WattDC, SellerA. A clinico-genetic study of psychiatric disorder in Huntington’s chorea. Psychol Med. 1993;(Suppl 23):1–46.
9.
van DuijnE, KingmaEM, van der MastRC. Psychopathology in verified Huntington’s disease gene carriers. J Neuropsychiatry Clin Neurosci. 2007;19(4):441–8.
10.
CarlozziNE, MiciuraA, MiglioreN, DayaluP. Understanding the Outcomes Measures used in Huntington Disease Pharmacological Trials: A Systematic Review. J Huntingtons Dis. 2014;3(3):233–52.
11.
HobartJ, CanoS. Improving the evaluation of therapeutic interventions in multiple sclerosis: The role of new psychometric methods. Health Technol Assess. 2009;13(12):iii, ix-x, 1–177.
12.
AminL, RosenbaumP, BarrR, SungL, KlaassenRJ, DixDB, et al. Rasch analysis of the PedsQL: An increased understanding of the properties of a rating scale. J Clin Epidemiol. 2012;65(10):1117–23.
13.
BechP, AllerupP, LarsenER, CsillagC, LichtRW. The Hamilton Depression Scale (HAM-D) and the Montgomery-Asberg Depression Scale (MADRS). A psychometric re-analysis of the European genome-based therapeutic drugs for depression study using Rasch analysis. Psychiatry Res. 2014;217(3):226–32.
14.
KingmaEM, van DuijnE, TimmanR, van der MastRC, RoosRAC. Behavioural problems in Huntington’s disease using the Problem Behaviours Assessment. Gen Hosp Psychiatry. 2008;30(2):155–61.
15.
CallaghanJ, StopfordC, ArranN, BoisseMF, ColemanA, SantosRD, et al. Reliability and factor structure of the Short Problem Behaviors Assessment for Huntington’s disease (PBA-s) in the TRACK-HD and REGISTRY studies. J Neuropsychiatry Clin Neurosci. 2015;27(1):59–64.
16.
ZuccaA, LambertSD, BoyesAW, PallantJF. Rasch analysis of the Mini-Mental Adjustment to Cancer Scale (mini-MAC) among a heterogeneous sample of long-term cancer survivors: A cross-sectional study. Health Qual Life Outcomes. 2012;10:5575251055.
17.
RaschG. Probabilistic models for some intelligence attainment tests. Chicago:University of Chicago Press;1960.
18.
PallantJF, TennantA. An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS). Br J Clin Psychol. 2007;46(Pt 1):1–18.
19.
HobartJC, CanoSJ, ZajicekJP, ThompsonAJ. Rating scales as outcome measures for clinical trials in neurology: Problems, solutions, and recommendations. Lancet Neurol. 2007;6(12):1094–105.
20.
RossCA, TabriziSJ. Huntington’s disease: From molecular pathogenesis to clinical treatment. Lancet Neurol. 2011;10(1):83–98.
21.
LerdalA, KottorpA, GayCL, GrovEK, LeeKA. Rasch analysis of the Beck Depression Inventory-II in stroke survivors: A cross-sectional study. J Affect Disord. 2014;158:48–52.
VaccarinoAL, AndersonK, BorowskyB, DuffK, GiulianoJ, GuttmanM, et al. An item response analysis of the motor and behavioral subscales of the unified Huntington’s disease rating scale in huntington disease gene expansion carriers. Mov Disord. 2011;26(5):877–84.
24.
BatesG, HarperP, JonesL. Huntington’s disease. Oxford:Oxford University Press;2002, pp. 29.
25.
ShoulsonI, FahnS. Huntington disease: Clinical care and evaluation. Neurology. 1979;29(1):1–3.
26.
WheelockVL, TempkinT, MarderK, NanceM, MyersRH, ZhaoH, et al. Predictors of nursing home placement in Huntington’s disease. Neurology. 2003;60(6):998–1001.
27.
Unified Huntington’s Disease Rating Scale: Reliability and consistency. Huntington Study Group. Mov Disord. 1996;11(2):136–42.
28.
ChatterjeeA, AndersonKE, MoskowitzCB, HauserWA, MarderKS. A comparison of self-report and caregiver assessment of depression, apathy, and irritability in Huntington’s disease. J Neuropsychiatry Clin Neurosci. 2005;17(3):378–83.
AndrichD. A rating formulation for ordered response categories. Psychometrika. 1978;43:561–73.
31.
MastersG. A Rasch model for partial credit scoring. Psychometrika. 1982;47:149–74.
32.
TennantA, ConaghanPG. The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper?. Arthritis Rheum. 2007;57(8):1358–62.
33.
BlandJM, AltmanDG. Multiple significance tests: The Bonferroni method. BMJ. 1995;310(6973):170.
34.
MaraisI, AndrichD. Effects of varying magnitude and patterns of response dependence in the unidimensional Rasch model. J Appl Meas. 2008;9(2):105–24.
35.
SmithEVJr. Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002;3(2):205–31.
36.
WrightB. Rack and Stack: Time 1 vs. Time 2. Rasch Measurement Transactions. 2003;17(1):905–906.
WyseAE. DIF Cancellation in the Rasch Model. J Appl Meas. 2013;14(2):118–28.
39.
TabriziSJ, ScahillRI, OwenG, DurrA, LeavittBR, RoosRA, et al. Predictors of phenotypic progression and disease onset in premanifest and early-stage Huntington’s disease in the TRACK-HD study: Analysis of 36-month observational data. Lancet Neurol. 2013;12(7):637–49.
40.
FieldA. Discovering Statistics using IBM SPSS Statistics. 4th ed. Univeristy of Sussex:SAGE Publications Ltd;2013.
41.
LinacreJ. Optimising rating scale effectiveness. Journal of Applied Measurement. 2002;3(1):85–106.
42.
ZielonkaD, MarinusJ, RoosRA, De MicheleG, Di DonatoS, PutterH, et al. The influence of gender on phenotype and disease progression in patients with Huntington’s disease. Parkinsonism Relat Disord. 2013;19(2):192–7.
43.
AzizNA, AnguelovaGV, MarinusJ, LammersGJ, RoosRA. Sleep and circadian rhythm alterations correlate with depression and cognitive impairment in Huntington’s disease. Parkinsonism Relat Disord. 2010;16(5):345–50.
44.
WittchenHU, JacobiF, RehmJ, GustavssonA, SvenssonM, JonssonB, et al. The size and burden of mental disorders and other disorders of the brain in Europe Eur Neuropsychopharmacol2011;21(9):655–79.
