Abstract
Objectives:
To assess clinical metrics and resource use of a 30-minute point-of-care test (POCT) for
Methods:
Three English sexual health services (SHSs) were recruited as part of a study. Existing processes for CT/NG testing and treatment were assessed, and adaptions to incorporate the CT/NG POCT were developed during semi-structured interviews. Staff time and consumables data were collected by clinic staff prior to and following introduction of the POCT.
Results:
SHSs selected patient groups for whom the CT/NG POCT would be used. Testing and treatment process data were collected for 225 patients (n = 118 POC; n = 107 standard). The percentage of patients receiving unnecessary CT treatment was 5% (5/95) and 13% (12/93) for POC and standard care respectively. The average CT/NG pathway cost varied and was on average £61.55 for POC and £50.88 for standard care. For the two SHSs where the POCT was used during a patient’s visit, for standard and POC respectively, the average time to CT treatment was 10.0 and 0.0 days and to NG treatment, 0.3 and 0.0 days.
Conclusion:
Use of a 30-minute POCT at three SHSs yielded clinical benefits by reducing time to treatment and unnecessary CT treatment.
Introduction
Chlamydia, caused by
There are a small number of rapid tests for CT, NG, or CT and NG available with one semi-rapid (90-minute) test with equivalent performance to laboratory nucleic acid amplification tests (NAATs).7 –9 POCTs provide an opportunity for patients attending SHSs to be tested and treated at their first visit thereby reducing the time to results,10 –12 time to treatment,12 –14 and the proportion of patients receiving unnecessary syndromic/presumptive treatment.10,15 POCTs typically cost more than the equivalent laboratory tests but can result in overall cost savings to the health system by reducing return appointments, unnecessary treatments, staff time spent on results notification and follow-up, onward transmission, and disease sequalae.11,16 Many healthcare settings already use POC testing, for example for HIV testing, and these types of tests are typically viewed favourably by patients.17,18
There are no published data on how many UK SHSs are currently using CT/NG POCTs, but use is thought to be low. To maximise the benefit to patients and the SHS, adoption of these technologies requires an assessment of existing practice and a redesign of clinical pathways.11,12 Few examples exist of how SHSs have successfully adopted CT/NG POCTs or the impact on clinical outcomes and resource use.12,16
In 2019, the first 30-minute dual CT/NG NAAT (binx health
Methods
Outcome measures
The steps involved in testing and treating CT/NG for standard and POC pathways were summarised as flow diagrams for each patient group at each SHS.
Several clinical outcomes were assessed:
Average number of days to CT/NG result – from sample collection to patient notification.
Average number of days to treatment – from first visit, in CT/NG positive patients.
Percentage of patients receiving unnecessary CT treatment – that is, treatment given at first attendance to CT-negative patients.
Percentage of patients receiving unnecessary treatment for NG – (see Outcome 3).
Percentage of patients lost to follow-up (LTFU) – that is, patient is CT/NG positive (laboratory or POCT) but does not receive treatment for the infection.
The resources used (staff time and consumables) and associated cost per patient for each CT/NG pathway.
Pathway definition and perspective
For this evaluation, the pathway included all steps involved in testing and treating CT/NG from the patient’s first attendance at clinic (for this episode) to the patient either receiving a negative test result or treatment for the infection – which results in no further attendance. Only costs incurred by the SHS were considered; patients’ time and out of pocket expenses were not assessed.
Clinic recruitment
As part of a wider collaborative research project and service evaluation with the Applied Diagnostic Research and Evaluation Unit at St George’s University of London, and binx health, SHSs were recruited to the project via the BASHH newsletter, the BASHH conference and direct invites to existing contacts. SHSs keen to participate were asked to host a workshop attended by their clinic and laboratory staff and members of the collaborative research project. These were used to explain the project, demonstrate the POCT and brainstorm how it could best be utilised within the service. Of the seven SHSs which hosted a workshop, three went on to participate.
CT/NG POCT
The binx health
Mapping CT/NG testing and treatment pathways
Adapting methods previously used to map CT/NG pathways in SHSs, 16 audio-recorded semi-structured interviews with service leads and/or clinical staff were held at each clinic in June–December 2018. These were used to create an overview of steps and resource use for CT/NG testing and treatment. After discussing how the pathway could be adapted, the mapping process was repeated for the hypothetical POC pathway. (See online Supplementary Material Tables S1–S3 for further details of the approaches used for data collection and analysis).
Following the interview, summary diagrams were created in Microsoft Excel (Office 365, Microsoft, Redmond, USA) for each pathway – listing the resource use (staff time, diagnostics, consumables, and medication) for each step. These were reviewed by the main contact at each clinic and were later simplified (for this paper). (Unit costs are presented in Tables S4-S6).
Data collection by SHSs to assess clinical outcomes and resource use
Following pathway mapping, data collection (paper) forms were developed for use by clinic staff to record data on resource use for each pathway. Separate forms were developed for collecting data at first/return attendance (Form A and Form B), additional tasks performed during an attendance (Form C), or following the attendance (Form D), at 30-days follow-up (Form E) and for clinic staff paygrade (Form F). Data collected on each form are listed in Table 1.
Summary of data collection forms used by clinic staff to collect clinical and resource use data for comparing standard and POC CT/NG testing and treatment pathways.
CT, chlamydia; LARC, long-acting reversible contraception; MSM, men who have sex with men; NG, gonorrhoea; POCT, point-of-care test.
Forms were completed between April and October 2019. Taking into account practical considerations and the needs of the service, each SHS decided on either the total number of forms they would complete or a specific period during which they would complete forms for all patients in their selected patient group/s. The patient groups were selected by the SHSs based on pragmatic reasons such as patient numbers and practical considerations and the perceived acceptability and benefit to those patients.
Patient and public involvement
There was patient/public representation on the advisory committee for the wider collaborative project. These representatives provided input on the design of the pathway mapping and data collection exercise.
No unique patient identifying information or demographic data such as age or ethnicity were collected. Steps were taken to ensure clinic IDs were removed from forms before forms were sent to the research team (see Table S2). Information on gender/sexual risk (i.e. heterosexual or MSM (Men who have Sex with Men)) were collected – as this would impact pathway costs since different sample types or number of samples are collected for men/women and according to exposure risk.
Data analysis
Data from the forms were entered into a Microsoft Access database and reviewed by a second individual to check for accuracy. Clinical outcomes and resource use data were then analysed in Excel. Data for patients were excluded if the patient had not been tested for CT/NG, where resource use data were missing or where no equivalent forms were completed in the standard/POC pathway for that patient group.
The average cost per patient for each pathway and each patient group was calculated using a micro-costing approach. The minutes spent on each activity by each staff grade were used to calculate the average staff cost for each pathway plus consumables used for sample collection, diagnosis, treatment, treatment notification, health promotion and medication for each attendance, plus any follow-up or return appointment.
Due to the small sample size, statistical analyses were not performed, and data for columns containing <5 individuals are not presented.
Results
Clinic recruitment
Initially, pathways were mapped at five SHSs where preliminary workshops had been hosted. Three SHSs then went on to participate in the project and collect resource data within their clinic/s – the results of which are presented here. The three participating SHSs, representing five clinical sites, differed in the characteristics of the local population, in the way they provide CT/NG testing and treatment, and in the patient groups they selected for CT/NG POC testing. The Supplementary Material contains detailed results for SHS 1 (Tables S7–S12), SHS 2 (Tables S13–S18), and SHS 3 (Tables S19–S24).
Patient groups
The patient groups selected at each SHS are listed in Table 2. Further details about the clinics and patient groups are presented in Tables S7, S13, and S18.
Patient groups and summary data for clinics where pathway and resource data were collected for CT/NG standard and POC pathways.
CT, chlamydia; LARC, long-acting reversible contraception; MSM, men who have sex with men; MSW, men who have sex with women; NG, gonorrhoea; POC, point-of-care; SHS, sexual health services.
Includes: symptomatic, asymptomatic, contacts (symptomatic and asymptomatic), and contraception.
LARC here refers to the intrauterine device and the intrauterine system.
This does not include excluded forms: n = 53 at SHS 1 (Table S8); n = 2 at SHS 2 (Table S14) and n = 2 at SHS 3 (Table S20). Patient numbers and risk groups for selected patient groups where clinical outcome and resource use data were collected are presented in Tables S9, S15, and S21.
This table includes only infections diagnosed using molecular testing (lab or POCT). CT and NG prevalence data for standard and POC pathways are presented for each SHS in Tables S10, S16, and S22.
Includes those with CT/NG co-infection.
Pathway changes to incorporate CT/NG POC testing
The pathways were summarised as diagrams and are presented in online Supplementary Material Figures S1–S6. A typical pathway change is shown in Figure S3. The return appointment for treatment is not required in the POC pathway since anyone with a positive result is treated at their first attendance. Patients still have laboratory tests for other infections (e.g. HIV and syphilis) and therefore receive results
In standard care, SHS 3 sent samples away to be tested at a central laboratory. Instead of using the rapid test during the patient’s attendance, they chose to wait and run the test on samples in the clinic at a later time when either a healthcare assistant or nurse had availability (Figure S6).
Clinical outcomes
Clinical outcome data are presented in Table 3. For every SHS and for every patient group, the average time to CT/NG result notification was demonstrably shorter in POC than for standard pathways. The time to results notification was on average 7.9 days shorter for POC pathway than for standard care when data for all three SHSs were combined, and 6.6 days shorter when data for SHS 1 and 2 were combined (i.e. SHSs that used the test to give results during the attendance). For SHS 1 and 2, the delay between first attendance and treatment for patients with chlamydia was on average 10.0 days for standard care and 0.0 days for POC. For patients with gonorrhoea, the delay was 0.3 for standard care and 0.0 days for POC.
Clinical outcomes for patients with data collected to compare the use of standard CT/NG pathways with POC pathways.
CT, chlamydia; NG, gonorrhoea; POC, point-of-care; SHS, sexual health services.
Cells are left blank where not applicable. Data for each patient group for standard and POC pathways are presented for each SHS in online Supplementary Material Tables S11, S17, and S23.
The SHS 3 POC pathway is not a genuinely POC pathway, since samples were not tested during the patient’s first attendance; therefore, combined data are presented for SHS 1 and SHS 2. In POC at SHS 3, 9/48 of the patients received their result on their same day as they tested.
Average wait (days) for treatment is average wait between first attendance and treatment being received for all patients diagnosed with chlamydia or gonorrhoea.
For one patient at SHS 3, data were missing on the date the patient returned for CT treatment after receiving their CT/NG test result on the same day they attended.
Unnecessary treatment is treatment given at the first appt for CT/NG with a subsequent negative test result. This does not include patients treated for nongonococcal urethritis (NGU).
Return appointment for any reason.
Lost to follow-up refers to patients diagnosed with chlamydia or gonorrhoea who are not reported as having received treatment for the infection within the 30-day follow-up period.
In current care, patients not treated at their first visit, who were then diagnosed with chlamydia, waited on average 9-days for their result and 14-days for treatment from first attendance.
For all clinics combined, the percentage of patients who received unnecessary CT treatment was 13% (12/92) in standard and 5% (5/95) in POC pathways (where the denominator is CT-negative patients). The percentage of patients who received correct treatment at their first attendance was 47% (7/15) in standard care and 96% (22/23) in POC (where the denominator is CT positive patients).
No patients received unnecessary treatment for NG in either standard or POC pathways, and there was no evidence that any patients were lost to follow-up.
Resource use
When average pathway costs were combined, weighted according to the number of patients in that patient group among those in the evaluation, the overall average cost was £61.55 for POC and £50.88 for standard care – POC costing an additional £10.67 overall, £7.76 for SHS 1, £11.61 for SHS 2, and £9.90 for SHS 3 (Table 4).
Average pathway costs for standard and POC CT/NG testing and treatment pathways – calculated using resource use data collected in clinic for specific patient groups.
CT, chlamydia; NG, gonorrhoea; POC, point-of-care; SHS, sexual health services.
Data for each patient group for standard and POC pathways are presented for each SHS in online Supplementary Material Tables S12, S18, and S24.
There are likely to be some resource savings in POC at SHS 1 which were not captured. Clinics A and B refer patients to a central clinic when the patient requires microscopy or where NG or
No data on resource use at return appointments were collected for the POC pathway for some patient groups who had a second attendance (reported on their 30-day follow-up form). To avoid under-estimating the cost of the POC pathway, the average cost per person per return visit (in standard pathway) was used to calculate the average cost of these return visits for the POC pathway and included in the total average cost of the pathway.
Follow-up refers to the tasks performed following the attendance such as processing and communicating test results.
For SHS 1, staff time increased for some groups and reduced for others (Table S12) – on average, for the groups combined, staff time cost £40.04 for standard care and £36.10 for POC. The total cost was higher for POC than standard care for all patient groups except for emergency LARC (long-acting reversible contraception) (£16.99 saving).
For SHS 2, overall, POC cost £78.52 and standard care £66.91. The cost of POC was lower than standard care for two patient groups – emergency LARC (£7.99 saving) and symptomatic patients (£2.83 saving).
For SHS 3, where CT/NG pathways were not altered (Figure S6), standard pathway cost £40.25 and POC £50.15 per patient. This difference came from the increase in diagnostics cost (£12.58 for standard and £23.03 for POC) as the average staff time costs increased by only £0.04 (£23.68 for standard and £23.72 for POC) (Table S24).
Discussion
Standard and POC CT/NG testing and treatment pathways were mapped in three SHSs serving distinct populations, and clinical and resource use data were collected in clinic. SHSs selected diverse patient groups for POC testing including groups more likely to have chlamydia and/or gonorrhoea, such as contacts and symptomatic patients, as well as lower-risk groups such as women receiving LARC.
This is the first study to use data collected in clinic to assess clinical outcomes and resource use at multiple SHSs comparing laboratory testing with a 30-minute NAAT for CT/NG with laboratory equivalent clinical performance. Previous studies report pathway changes in SHSs based on estimates, models, or used data from a single SHS.12,16,22 –25 Data were collected for each step of the pathway, including follow-up, and even when multiple staff were working simultaneously, providing a more complete picture of resource use. However, the burden of data collection was on busy clinic staff whose priority is clinical work. Therefore, data were collected for a relatively small number of patients and as such, statistical and sensitivity analyses were not appropriate. It also meant that there was inconsistency in the data quality resulting in some exclusions.
The results of this analysis provide further evidence that CT/NG POC testing improves patient management, reducing the time to results and to treatment, and reducing unnecessary CT treatment – as have been reported in previous studies.10 –12 At the two SHSs where the POCT was used to test and treat patients during their attendance, the average wait for results fell from 6.6 to 0.0 days. At SHS 3, where samples were not tested during the patients attendance, the time to results decreased from 15.5 to 6.5 days, below the 8-day threshold set by BASHH. 6 There may have been some selection bias in which SHSs chose to participate in the overall study, for example, favouring SHSs frustrated by long turnaround times for results. This is likely to be the case for SHS 3; however, it is difficult to assess since results turnaround times are not routinely published. Expediting the time to results and treatment will likely result in fewer onward transmissions impacting prevalence within the population in the longer term. 22 Avoiding inappropriate treatment improves antibiotic stewardship and is important in light of multi-antibiotic resistant strains of NG in the United Kingdom and elsewhere which pose a serious public health threat. 26 There is currently no cost threshold used to assess the cost-effectiveness of avoiding use of antibiotics.
The number of patients returning to the clinic for treatment or for other reasons was very low in standard pathways, in part because the prevalence of CT/NG was low and because syndromic/presumptive treatment for chlamydia was often given (some of which was unnecessary). This meant there was only a small difference in the percentage of patients returning in standard and POC pathways (18%
This assessment may underplay the benefit of the CT/NG POCT because there were likely to be other benefits which were not assessed including patient utility, reduced onward transmission and sequalae and reduced risk of antimicrobial resistance (AMR) by reducing the use of antibiotics. Statistical models suggest that these benefits of CT/NG POCTs are likely to result in longer-term cost savings to the wider health system. 22 There were potential cost savings from reducing the number of patients referred from the spoke to the hub clinic (for SHS 1) which were not captured or assessed.
The introduction of any new technology within a service provides an opportunity to assess current practice and consider process changes to improve clinical care and rationalise resource use. Although there are national standards for STI testing, 6 the way that clinics triage patients, the staffing grades and access to microscopy, differ between services. It is likely that clinics will use POC testing in different ways and in different patient groups according to where the clinic perceives the greatest need and/or benefit. In this study, no clinics chose to do an overhaul of the pathway, introduce POCT for other STIs or remove steps from the pathway as have been reported elsewhere.11,16 Once there is confidence in the new processes used for POC testing, some clinics may choose to adapt pathways further, for example, removing microscopy for most patients or using different staff grades for some tasks.
LTFU did not appear to be a problem at the participating SHSs and the cost of staff time and consumables used for follow-up (£1.54) made up only 3% of the overall pathway cost. However, in deciding where to use the POCT, all SHSs mentioned that they initially intended to use it for patients at high risk of LTFU, to prevent infections going untreated and to minimise efforts needed to contact patients requiring treatment. There is evidence from a small number of studies that CT/NG POCTs reduce LTFU rates.27,28 Our focus was on use of POCTs within specialist SHSs, where, in the United Kingdom, most STI testing takes place. 3 Since POCTs provide an opportunity to test and treat at the same attendance using transportable equipment, they are ideally suited for high-risk populations in settings where LTFU is an issue or where testing would not normally be possible, including colleges, homeless shelters, festivals, and emergency services – and a number of studies have explored these.10,15,23,29,30
There are likely to be additional benefits of CT/NG POC testing which were not assessed, in future work it would be useful to model and explore the effect of receiving a positive (or negative) result sooner on onward transition, sexual behaviour, and anxiety levels in patients. POC testing may improve the partner notification (PN) process, something normally done by the patient,
This assessment provides further evidence that CT/NG POCTs used in SHSs benefit patients by reducing the time to results and treatment and reducing the unnecessary use of antibiotics.
Supplemental Material
sj-docx-1-tai-10.1177_20499361211061645 – Supplemental material for Assessing the clinical impact and resource use of a 30-minute chlamydia and gonorrhoea point-of-care test at three sexual health services
Supplemental material, sj-docx-1-tai-10.1177_20499361211061645 for Assessing the clinical impact and resource use of a 30-minute chlamydia and gonorrhoea point-of-care test at three sexual health services by Susie Huntington, Georgie Weston and Elisabeth Adams in Therapeutic Advances in Infectious Disease
Footnotes
Acknowledgements
The authors would also like to thank the following people for their contribution to this work: the members of collaborative group: Sebastian Fuller, Martina Furegato and Tariq Sadiq, and the project advisory group: Kate Folkard, Sue Eaton, Merle Symonds, Cath Mercer, Gary Whitlock, Lucy Parker and Emma Harding-Esch. They thank the staff and patients at the participating health services.
Author contributions
All authors contributed to the pathway mapping work. SH and EA performed semi-structured interviews. SH designed the data collection forms, analysed the data and drafted the paper. SH, GW and EA contributed to the interpretation of the results and have approved the final submitted version.
Conflict of interest statement
The authors declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: SH, GW, and EA work at Aquarius Population Health and have received consultancy fees from the following organisations on projects related to STIs: Abbott, Cepheid, binx health, Hologic, Public Health England, and St. Georges University of London. SHSs participating in the wider project received free CT/NG POCT cartridges for use during the project with some surplus for use after the project plus a fridge in which to store the cartridges.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by Innovate UK (grant no. 90174-384633) awarded to binx health Limited (previously Atlas Genetics) for
Ethics approval
Ethics review was not required for this work. Patients were not randomised to a particular group or given a different procedure or treatment than they would normally receive. No external access was given to the electronic patient records and no unique patient identifying data were collected or reported. Following review by the Interim Research Governance Lead of the Joint Research Office, St George’s, London, the project was determined as fulfilling the criteria of a ‘service evaluation’. Approval was given for participation in the work by each Trust involved who signed a Collaboration Agreement.
Data sharing
All data relevant to the study are included in the online Supplementary Material. No additional data are available.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
