The effect of the Development and Well-Being Assessment as an adjunct to standard referral letters on referral decisions by child and adolescent mental health services

Abstract

Background: High rejection rates for referrals to child and adolescent mental health services (CAMHS) are common. The most cited reasons for rejection are that the child does not have a clinical need for assessment and poor quality of the referrals. However, studies of interventions aimed at improving appropriateness of referrals are sparse. Methods: In this randomized feasibility trial, we tested if the Development and Well-Being Assessment (DAWBA) as an adjunct to referral letters could improve accuracy of referral decisions made by CAMHS. The primary outcome of the study was the proportion of “correct” referral decisions. Results: The study included 160 children referred to CAMHS. Almost all (95.6%) participants fulfilled criteria for a mental disorder and 82.1% also reported high impact of symptoms. Compared to the group who did not complete the DAWBA, referral decisions for the DAWBA group showed higher sensitivity (0.63 vs. 0.83), specificity (0.30 vs. 0.42), and negative predictive value (0.14 vs. 0.36) as well as slightly higher positive predictive value (0.81 vs. 0.86). Conclusions: The use of the DAWBA as an adjunct to standard referral letters could lead to more correct referral decisions and reduce the proportion of wrongful rejection referrals to CAMHS.

Keywords

child psychiatry adolescent psychiatry referral service use development and well-being assessment Kiddie schedule for affective disorders and schizophrenia-COMP

Get full access to this article

View all access options for this article.

References

Aebi

Kuhn

Metzke

C. W.

Stringaris

Goodman

Steinhausen

H. C.

(2012). The use of the development and well-being assessment (DAWBA) in clinical practice: A randomized trial. European Child and Adolescent Psychiatry, 21(10), 559–567. https://doi.org/10.1007/s00787-012-0293-6

Akbari

Mayhew

Al-Alawi

M. A.

Grimshaw

Winkens

Glidewell

Pritchard

Thomas

Fraser

(2008). Interventions to improve outpatient referrals from primary care to secondary care. The Cochrane Database of Systematic Reviews, 20(3), CD005471. https://doi.org/10.1002/14651858.CD005471.pub2

American Psychiatric Association, D.-5 T. F (2013). Diagnostic and statistical manual of mental disorders: DSM-5^TM. In: Diagnostic and statistical manual of mental disorders: DSM-5^TM (5th ed.). American Psychiatric Publishing, Inc. https://doi.org/10.1176/appi.books.9780890425596

Angold

Costello

E. J.

Farmer

E. M.

Burns

B. J.

Erkanli

(1999). Impaired but undiagnosed. Journal of the American Academy of Child and Adolescent Psychiatry, 38(2), 129–137. https://doi.org/10.1097/00004583-199902000-00011

Arnfred

Svendsen

Rask

Jeppesen

Fensbo

Houmann

Obel

Niclasen

Bilenberg

(2019). Danish norms for the strengths and difficulties questionnaire. Danish Medical Journal, Jun, 66(6), A5546.

Becker

Woerner

Hasselhorn

Banaschewski

Rothenberger

(2004). Validation of the parent and teacher SDQ in a clinical sample. European Child and Adolescent Psychiatry, 13(2), 11–6. https://doi.org/10.1007/s00787-004-2003-5

Blundell

Clarke

Mays

(2010). Interpretations of referral appropriateness by senior health managers in five PCT areas in England: A qualitative investigation. Quality and Safety in Health Care, 19(3), 182–186. https://doi.org/10.1136/qshc.2007.025684

Catalá-López

Hutton

Núñez-Beltrán

Page

M. J.

Ridao

Macías Saint-Gerons

Catalá

M. A.

Tabarés-Seisdedos

Moher

(2017). The pharmacological and non-pharmacological treatment of attention deficit hyperactivity disorder in children and adolescents: A systematic review with network meta-analyses of randomised trials. PloS One, 12(7), e0180355. https://doi.org/10.1371/journal.pone.0180355

Davies

Elwyn

(2006). Referral management centres: Promising innovations or Trojan horses? BMJ (Clinical Research), 332(7545), 844–846. https://doi.org/10.1136/bmj.332.7545.844.

10.

Druss

B. G.

Wang

P. S.

Sampson

N. A.

Olfson

Pincus

H. A.

Wells

K. B.

Kessler

R. C.

(2007). Understanding mental health treatment in persons without mental diagnoses: Results from the national comorbidity survey replication. Archives of General Psychiatry, 64(10), 1196–1203. https://doi.org/10.1001/archpsyc.64.10.1196

11.

Ford

Last

Henley

Norman

Guglani

Kelesidi

Martin

A. M.

Moran

Latham-Cork

Goodman

(2013). Can standardized diagnostic assessment be a useful adjunct to clinical assessment in child mental health services? A randomized controlled trial of disclosure of the development and well-being assessment to practitioners. Social Psychiatry and Psychiatric Epidemiology, 48(4), 583–593. https://doi.org/10.1007/s00127-012-0564-z

12.

Forrest

C. B.

Nutting

P. A.

Von Schrader

Rohde

Starfield

(2006). Primary care physician specialty referral decision making: Patient, physician, and health care system determinants. Medical Decision Making, 26(1), 76–85. https://doi.org/10.1177/0272989X05284110

13.

Goodman

(1999). The extended version of the strengths and difficulties questionnaire as a guide to child psychiatric caseness and consequent burden. J. Child Psychol. Psychiat, 40(5), 791–799. https://doi.org/10.1111/1469-7610.00494

14.

Goodman

Ford

Richards

Gatward

Meltzer

(2000). The development and well-being assessment: Description and initial validation of an integrated assessement of child and adolescent psychopathology. Journal of Child Psychology and Psychiatry and Allied Disciplines, 41(5), 645–655. https://doi.org/10.1017/S0021963099005909

15.

Goodman

Heiervang

Collishaw

Goodman

(2011). The “DAWBA bands” as an ordered-categorical measure of child mental health: Description and validation in British and Norwegian samples. Social psychiatry and psychiatric epidemiology, 46(6), 521–532. https://doi.org/10.1007/s00127-010-0219-x

16.

Grimshaw

J. M.

Winkens

R. A. G.

Shirran

Cunningham

Mayhew

Thomas

Fraser

(2005). Interventions to improve outpatient referrals from primary care to secondary care. The Cochrane Database of Systematic Reviews, 3(3), CD005471. https://doi.org/10.1002/14651858.CD005471

17.

Hansen

A. S.

Kjaersdam Telléus

Lauritsen

M. B.

(2021). Changes in referral patterns to outpatient child and adolescent psychiatric services from 2005–2018. Nordic Journal of Psychiatry, 75(6), 437–446. https://doi.org/10.1080/08039488.2021.1880636

18.

Hartveit

Biringer

Vanhaeht

Haug

Aslaksen

(2011). The Western Norway mental health interface study: A controlled intervention trial on referral letters between primary care and specialist mental health care. BMC Psychiatry, 11(177). https://doi.org/10.1186/1471-244X-11-177.

19.

Hinrichs

Owens

Dunn

Goodyer

(2012). General practitioner experience and perception of Child and Adolescent Mental Health Services (CAMHS) care pathways: A multimethod research study. BMJ Open, Nov, 2(6), e001573. https://doi.org/10.1136/bmjopen-2012-001573

20.

Kaufman

Birmaher

Brent

Rao

Flynn

Moreci

Williamson

Ryan

(1997). Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 36(7), 980–988. https://doi.org/10.1097/00004583-199707000-00021.

21.

Kommunernes Landsforening . (2018). Børns diagnoser og skoletyper (Children’s diagnoses and types of schooling. [In Danish]. https://www.kl.dk/media/14395/ojyf-ezrxvgiuwyfuxvd.pdf

22.

Lambert

A. K.

Doherty

A. J.

Wilson

Chauhan

Mahadevan

(2020). GP perceptions of community-based children’s mental health services in Pennine Lancashire: A qualitative study. BJGP Open, 4(4), bjgpopen20X101075. https://doi.org/10.3399/bjgpopen20x101075.

23.

Last

Henley

Norman

Goodman

Ford

(2014). Innovations in Practice: Feasibility of the development and well-being assessment as an adjunct to clinical assessment in child and adolescent mental health services. Child and Adolescent Mental Health, 19(2), 142–146. https://doi.org/10.1111/camh.12017

24.

Mallett

Halligan

Matthew Thompson

G. P.

Collins

G. S.

Altman

D. G.

(2012). Interpreting diagnostic accuracy studies for patient care. BMJ (Online), 345, e3999. https://doi.org/10.1136/bmj.e3999

25.

Marzocchi

G. M.

Capron

Di Pietro

Duran Tauleria

Duyme

Frigerio

Gaspar

M. F.

Hamilton

Pithon

Simões

Thérond

(2004). The use of the Strengths and Difficulties Questionnaire (SDQ) in Southern European countries. European Child & Adolescent Psychiatry, 13(2), ii40–ii46. https://doi.org/10.1007/s00787-004-2007-1

26.

Matuschek

Jaeger

Stadelmann

Dölling

Grunewald

Weis

von Klitzing

Döhnert

(2016). Implementing the K-SADS-PL as a standard diagnostic tool: Effects on clinical diagnoses. Psychiatry Research, Feb 28(236), 119-124. https://doi.org/10.1016/j.psychres.2015.12.021.

27.

Mehrotra

FORREST

C. B.

Lin

C. Y.

(2011). Dropping the baton: Specialty Referrals in the United States. The Milbank Quarterly, 89(1), 39–68. https://doi.org/10.1111/j.1468-0009.2011.00619.x

28.

Neira-Munoz

Ward

(1998). Child mental health services. Side by side. The Health Service Journal, 108(5617), 26–27

29.

Niclasen

Teasdale

T. W.

Andersen

A. M. N.

Skovgaard

A. M.

Elberling

Obel

(2012). Psychometric properties of the Danish strength and difficulties questionnaire: The SDQ assessed for more than 70,000 raters in four different cohorts. PLoS ONE, 7(2), e32025. https://doi.org/10.1371/journal.pone.0032025

30.

Nishiyama

Sumi

Watanabe

Suzuki

Kuru

Shiino

Kimura

Wang

Lin

Ichiyanagi

Hirai

(2020). The kiddie schedule for affective disorders and schizophrenia present and lifetime version (K-SADS-PL) for DSM-5: A validation for neurodevelopmental disorders in Japanese outpatients. Comprehensive Psychiatry, Jan(96), 152148. https://doi.org/10.1016/j.comppsych.2019.152148.

31.

O’Brien

Harvey

Howse

Reardon

Creswell

(2016). Barriers to managing child and adolescent mental health problems: A systematic review of primary care practitioners’ perceptions. British Journal of General Practice, 66(651), e693–707. https://doi.org/10.3399/bjgp16X687061

32.

R Core Team (2013). A language and environment for statistical computing. http://www.r-project.org/.

33.

Rambøll Management & Center for Kvalitetsudvikling, R. M (2008). Henvisningsprojektet i børne- og ungdomspsykiatrien (in Danish)-. 978-87-7601-255-7. https://sum.dk/Aktuelt/Publikationer/∼/media/Filer-Publikationer_i_pdf/2008/Henvisningsprojektet.ashx

34.

Retsinformation, dk . (2019). Vejledning om medikamentel behandling af børn og unge med psykiske lidelser. (in Danish). https://www.retsinformation.dk/eli/retsinfo/2019/9733.

35.

Seierstad

T. G.

Brekke

Toftemo

Haavet

O. R.

(2017). GPS’ and child and adolescent psychiatry specialists’ experiences of joint consultations in the GP’s office: A qualitative study. BMC Research Notes, 10(1), 458. https://doi.org/10.1186/s13104-017-2766-7

36.

Smith

Kyle

R. G.

Daniel

Hubbard

(2018). Patterns of referral and waiting times for specialist child and adolescent mental health services. Child and Adolescent Mental Health, 23(1), 41–49. https://doi.org/10.1111/camh.12207

37.

Socialstyrelsen (2019). Psykiatrisk vård och behandling till barn och unga. (in Swedish) https://www.socialstyrelsen.se/globalassets/sharepoint-dokument/artikelkatalog/oppna-jamforelser/2019-12-6475.pdf.

38.

Stone

L. L.

Otten

Engels

R. C. M. E.

Vermulst

A. A.

Janssens

J. M. A. M.

(2010). Psychometric properties of the parent and teacher versions of the strengths and difficulties questionnaire for 4- to 12-Year-olds: A review. Clinical Child and Family Psychology Review, 13(3), 254–274https://doi.org/10.1007/s10567-010-0071-2

39.

Sundhedsstyrelsen (2017). Forløbsprogram for børn og unge med angst og/eller depression. https://www.sst.dk/da/udgivelser/2017/∼/media/E62CECC2AE9440818723CADE96438A7B.ashx

40.

Townsend

Kobak

Kearney

Milham

Andreotti

Escalera

Alexander

Gill

M. K.

Birmaher

Sylvester

Rice

Deep

Kaufman

(2020). Development of three web-based computerized versions of the kiddie schedule for affective disorders and schizophrenia child psychiatric diagnostic interview: Preliminary validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 59(2), 309–325. https://doi.org/10.1016/j.jaac.2019.05.009

41.

Weisser

K. H.

Diseth

T. H.

Boye

Faerden

Ekeberg

Ø.

(2019). Examining the organization and quality of the psychiatric consultative service in Norway. Nordic Journal of Psychiatry, 73(1), 9–15. https://doi.org/10.1080/08039488.2018.1525426

42.

World Health Organization (2004). ICD-10: International statistical classification of diseases and related health problems: Tenth revision (2nd ed). World Health Organization. https://apps.who.int/iris/handle/10665/42980

43.

Youth in Mind (2010). Development and well-being assessment. https://youthinmind.com/products-and-services/dawba/.

44.

Zeinoun

Bawab

Atwi

Hariz

Tavitian

Khani

Nahas

Maalouf

F. T.

(2013). Validation of an Arabic multi-informant psychiatric diagnostic interview for children and adolescents: Development and well being assessment-Arabic (DAWBA-Arabic). Comprehensive Psychiatry, 54(7), 1034–1041. https://doi.org/10.1016/j.comppsych.2013.04.012

The effect of the Development and Well-Being Assessment as an adjunct to standard referral letters on referral decisions by child and adolescent mental health services — a randomized feasibility trial

Abstract

Keywords

Get full access to this article

References