To assess whether changes in length of wait are correlated (directly) with changes in size of list, i.e. whether census-, event- and enrolment-based estimates of the percentage that waited 0–2 months are valid measures. EyeNet Sweden supplied dates of extraction and enrolment for 1,061,246 cataracts extracted between 1992 and 2009 inclusive. Changes in size of list were calculated as enrolments minus extractions. Fifty-nine times out of 62 the enrolment-based measure reported an increase in length of wait when size of list increased or a decrease in length when size decreased (LB = 90%, 95% confidence interval = 80–100). But 47 times out of 62 the event-based measure reported a decrease in length of wait when size of list increased, or an increase in length when size decreased (LB = 40%, 95% confidence interval = 6–74). The census-based measure did likewise 34 times out of 63 (LB = 6%). The three approaches gave different results despite using the same combination of cohorts and categories, the same point on the distribution of waits, the same rules about which waits (and which parts of these) count and the same length of follow-up. Census- and event-based measures often concealed the true direction of change in length of wait.
Get full access to this article
View all access options for this article.
References
1.
Department of Health. Annex D – Summary Report on NHS Performance Indicators: A Consultation, May 2001. See www.dh.gov.uk/en/Consultations/Consultationslibrary/index.htm (last accessed 30 March 2009)
2.
Steering group on Health Services Information. A Report on the Collection and Use of Information About Hospital Clinical Activity in the National Health Service. London: HMSO, 1982, Part 1:7–8
3.
SmithT. Waiting times: monitoring the total postreferral wait. BMJ1994;309:593–6
4.
YatesJM. In-patient Waiting List Statistics. Handle With Care. [Occasional Paper 16]. Birmingham: Health Services Management Centre, University of Birmingham, 1978:6, 9
5.
CottrellKM. Waiting lists: some problems of definition and a relative measure of waiting time. Hosp Health Serv Rev1980;76:265–9
6.
WilliamsDRR, WestRJ, HagardS, DiasAFS. Waiting list monitoring using information from Hospital Activity Analysis and SBH203 returns. Community Med1983;5:311–6
7.
MooreT. Waiting – how long? How can waiting times be defined and measured? In: WilkinD, RolandM, eds. Waiting Times for First Outpatient Appointments in the NHS. Manchester: Centre for Primary Care Research, University of Manchester, 1993:47–56
8.
NHS Executive. The NHS Performance Assessment Framework. Leeds: Department of Health, 1999:19
9.
NHS Executive. The New NHS Modern and Dependable: A National Framework for Assessing Performance. Consultation Document. Leeds: Department of Health, 1998:41
10.
DonB, LeeA, GoldacreMJ. Waiting list statistics. III. Comparison of two measures of waiting times. Br Med J (Clin Res Ed)1987;295:1247–8
11.
EdwardsRT. NHS Waiting Lists: Towards the Elusive Solution. London: Office of Health Economics, 1997:25
12.
ArmstrongPW. Correction. Stat Med2004;23:1987
13.
HanningM, LundströmM. Assessment of the maximum waiting time guarantee for cataract surgery. The case of a Swedish policy. Int J Technol Assess Health Care1998;14:180–93
14.
LevyAR, SobolevBG, HaydenR, KielyM, FitzGeraldJM, SchechterMT. Time on wait lists for coronary bypass surgery in British Columbia, Canada, 1991–2000. BMC Health Serv Res2005;5:22
15.
HåkanssonI, LundströmM, SteneviU, EhingerB. Data reliability and structure in the Swedish National Cataract Register. Acta Ophthalmol Scand2001;79:518–23
16.
LeeA, DonB, GoldacreMJ. Waiting list statistics. II: an estimate of inflation of waiting list length. Br Med J (Clin Res Ed)1987;295:1197–8
17.
ArmstrongPW. The ebb and flow of the NHS waiting list: how do recruitment and admission affect event-based measures of the length of ‘time-to-admission’?Stat Med2002;21:2991–3009
18.
ThomasHF, DarvellRHJ. Audit of an ophthalmology waiting list. Br J Ophthalmol1991;75:28–30
19.
ArmstrongPW. First steps in analysing NHS waiting times: avoiding the ‘stationary and closed population’ fallacy. Stat Med2000;19:2037–51
20.
Ninn-PedersenK, SteneviU, EhingerB. Cataract patients in a defined Swedish population 1986–1990. I. Resources and epidemiology. Acta Ophthalmol (Copenh)1994;72:1–9
21.
LundströmM, SteneviU, ThorburnW. The Swedish National Cataract Register: a nine-year review. Acta Ophthalmol Scand2002;80:248–57
22.
SicilianiL, HurstJ. Explaining Waiting Times Variation for Elective Surgery across OECD Countries. Health Working Paper 7. Paris: Organisation for Economic Cooperation and Development, 2003. Annex 2:62–6
23.
HuffD. How to Lie With Statistics. London: Gollancz, 1954. Chapter 2
24.
PaulosJA. Mathematical Illiteracy and Its Consequences. Innumeracy. London: Penguin, 1988:127
25.
WorthingtonDJ. Queueing models for hospital waiting lists. J Oper Res Soc1987;38:413–22
26.
HanningM. Maximum waiting time guarantee – an attempt to reduce waiting lists in Sweden. Health Policy1996;36:17–35
27.
TorkkiM, LinnaM, SeitsaloS, PaavolainenP. How to report and monitor the performance of waiting list management. Int J Technol Assess Health Care2002;18:611–8
28.
LundströmM, SteneviU, ThorburnW. Svensk Kataraktkirurgi. Årsrapport 2001 baserad på data från Nationella Kataraktregistret. Karlskrona, Sweden: Nationella Kataraktregistret, 2001:5, 7. See www.cataractreg.com/Cataract_Sve/forstasida.htm (last accessed 30 July 2010)
29.
SobolevB, LevyA, HaydenR, KuramotoL. Does wait-list size at registration influence time to surgery? Analysis of a population-based cardiac surgery registry. Health Serv Res2006;41:23–39
30.
SPSS Inc. SPSS for Windows (Release 10.1.4). Chicago, IL: SPSS Inc, 2001
31.
CastellanNJ. The analysis of behaviour sequences. In: CairnsRB, ed. The Analysis of Social Interactions: Methods, Issues, and Illustrations. Hillsdale, NJ: Erlbaum, 1979:81–116
32.
HarleyM. Waiting times in trauma and orthopaedic surgery. Community Med1988;10:57–65
33.
ArmstrongPW. What do we know? Limitations of the two methods most commonly used to estimate the length of the prospective wait. Health Serv Manage Res2009;22:8–16
34.
ArmstrongPW. One question, two answers: do the two most commonly used methods of sampling describe the length of the prospective wait for admission to hospital?Health Serv Manage Res2010:23:18–24
35.
Government Statistical Service. Elective Admissions and Patients Waiting – Description of the Method used to Estimate Waiting Times of Patients Admitted from Waiting Lists. Supplement to Department of Health Statistical Bulletin 1996–1. Leeds: Department of Health, 1996
36.
House of Commons. Sandwell and West Birmingham Hospitals NHS Trust: Surgery. Hansard Written Answers. 21 May 2007, column 1137W
37.
DeCosterC, CarriereKC, PetersonS, WalldR, MacWilliamL. Waiting times for surgical procedures. Med Care1999;37:JS187–205
38.
DixonS. Trends in waiting time to date and total time waited: are the sources compatible?Health Stat Q2004;24:23–9
39.
CulyerAJ, CullisJG. Some economics of hospital waiting lists in the NHS. J Soc Policy1976;5:239–64
40.
GoldacreMJ, LeeA, DonB. Waiting list statistics. I: relation between admissions from waiting list and length of waiting list. Br Med J (Clin Res Ed)1987;295:1105–8
41.
NordbergM, KeskimäkiI, HemminkiE. Is there a relation between waiting-list length and surgery rate?Int J Health Plann Manage1994;9:259–65
42.
NewtonJN, HendersonJ, GoldacreMJ. Waiting list dynamics and the impact of earmarked funding. BMJ1995;311:783–5
43.
National Audit Office. Inappropriate Adjustments to NHS Waiting Lists. Report by the Comptroller and Auditor General HC 452. Session 2001–2002. London: The Stationery Office, 2001. Appendix 9:27–9
44.
MasonA. An epidemiological approach to the monitoring of hospital waiting list statistics. Proc R Soc Med1976;69:939–42
45.
SanmartinC, ShorttSED, BarerML, ShepsS, LewisS, McDonaldPW. Waiting for medical services in Canada: lots of heat, but little light. Can Med Assoc J2000;162:1305–10
