Effective advance care planning depends on clinician-patient communication quality. However, ACP-CAT, the only validated observer-rated instrument, remains untested in real-world clinical encounters and non-Western contexts.
Aim:
Validating ACP-CAT in assessing clinician-patient communication quality with advanced cancer and chronic kidney disease in Hong Kong, comparing against patient and family ratings of clinician communication.
Design:
Cross-sectional study of adult patients with advanced cancer or chronic kidney disease from five hospitals and one hospice service. Two independent raters evaluated audiotaped advance care planning conversations using ACP-CAT, while patients and family members assessed communication quality using the Chinese Quality of Communication Questionnaire (C-QOC). We assessed the psychometric properties, including interrater reliability, convergent and discriminant validity.
Setting/participants:
One hundred and thirty-seven advance care planning conversations involving 84 cancer patients, 53 renal patients, 107 family members, and 20 clinicians.
Results:
ACP-CAT demonstrated high interrater reliability (mean Gwet’s AC1 = 0.81; 88.6% agreement). Convergent validity was demonstrated through significant correlations between ACP-CAT total score and patient-rated C-QOC End-of-life planning subscale (r = 0.29, p < 0.01), family-rated C-QOC summary score (r = 0.27, p < 0.05), and family-rated C-QOC End-of-life planning subscale (r = 0.34, p < 0.01). Discriminant validity was supported by absence of correlations with patients’ self-rated health status and information or decision-making preferences (all p > 0.05). Clinicians frequently explored patients’ fears and health goals, but rarely discussed nonmedical priorities, valued activities, or surrogate decision makers.
Conclusions:
ACP-CAT demonstrates strong concurrent validity with patient- and family-rated measures and ecological validity in real clinical settings. These findings support its reliability for assessing advance care planning communication quality across diverse cultural contexts.
SudoreRLumHYouJ, et al. Defining advance care planning for adults: a consensus definition from a multidisciplinary Delphi Panel (S740). J Pain Symptom Manag2017; 53(2): 431–432.
2.
BernackiRPaladinoJNevilleBA, et al. Effect of the Serious Illness Care Program in outpatient oncology: a cluster randomized clinical trial. JAMA Intern Med2019; 179(6): 751–759.
3.
DeteringKMHancockADReadeMC, et al. The impact of advance care planning on end of life care in elderly patients: randomised controlled trial. BMJ2010; 340(1): c1345.
4.
TenoJMGruneirASchwartzZ, et al. Association between advance directives and quality of end-of-life care: a national study. J Am Geriatr Soc2007; 55(2): 189–194.
5.
EngelbergRDowneyLCurtisJR. Psychometric characteristics of a quality of communication questionnaire assessing communication about end-of-life care. J Palliat Med2006; 9(5): 1086–1098.
6.
YuenJKChanHYLChenTWT, et al. Cross-cultural adaptation and validation of the Chinese version of the quality of communication questionnaire. BMC Palliat Care2025; 24(1): 140.
7.
RötteleNSchöpf-LazzarinoACBeckerS, et al. Agreement of physician and patient ratings of communication in medical encounters: a systematic review and meta-analysis of interrater agreement. Patient Educ Couns2020; 103(10): 1873–1882.
8.
CurtisJREngelbergRAWenrichMD, et al. Studying communication about end-of-life care during the ICU family conference: development of a framework. J Crit Care2002; 17(3): 147–160.
9.
CurtisJRBackALFordDW, et al. Effect of communication skills training for residents and nurse practitioners on quality of communication with patients with serious illness: a randomized trial. JAMA2013; 310(21): 2271–2281.
10.
FiscellaKFranksPSrinivasanM, et al. Ratings of physician communication by real and standardized patients. Ann Fam Med2007; 5(2): 151–158.
11.
YuenJKKelleyASGelfmanLP, et al. Development and validation of the ACP-CAT for assessing the quality of advance care planning communication. J Pain Symptom Manag2020; 59(1): 1–8.e3.
12.
ChengSYLinCPChanHY, et al. Advance care planning in Asian culture. Jpn J Clin Oncol2020; 50(9): 976–989.
13.
LinCPEvansCJKoffmanJ, et al. The conceptual models and mechanisms of action that underpin advance care planning for cancer patients: a systematic review of randomised controlled trials. Palliat Med2019; 33(1): 5–23.
14.
BaileWFBuckmanRLenziR, et al. SPIKES—a six-step protocol for delivering bad news: application to the patient with cancer. Oncologist2000; 5(4): 302–311.
OkenMMCreechRHTormeyDC, et al. Toxicity and response criteria of the Eastern Cooperative Oncology Group. Am J Clin Oncol1982; 5(6): 649–656.
18.
DegnerLFSloanJAVenkateshP.Control preferences scale. Can J Nurs Res1997; 29(3): 21–43.
19.
KehlKLLandrumMBAroraNK, et al. Association of actual and preferred decision roles with patient-reported quality of care: shared decision making in cancer care. JAMA Oncol2015; 1(1): 50–58.
20.
CassilethBRZupkisRVSutton-SmithK, et al. Information and participation preferences among cancer patients. Ann Intern Med1980; 92(6): 832–836.
21.
GwetKL (ed.). Handbook of inter-rater reliability: the definitive guide to measuring the extent of agreement among raters. 4th ed.Advances Analytics, LLC, 2014. pp.410.
22.
WongpakaranNWongpakaranTWeddingD, et al. A comparison of Cohen’s Kappa and Gwet’s AC1 when calculating inter-rater reliability coefficients: a study conducted with personality disorder samples. BMC Med Res Methodol2013; 13(1): 61.
23.
Posit team. RStudio: Integrated development environment for R [Internet]. Posit Software, PBC;2024. http://www.posit.co/
SjobergDWhitingKCurryM, et al. Reproducible summary tables with the gtsummary package. R J2021; 13(1): 570–580.
26.
MoriMMoritaT.End-of-life decision-making in Asia: a need for in-depth cultural consideration. Palliat Med2020; 34(2): n4–n5.
27.
BélangerERodríguezCGroleauD.Shared decision-making in palliative care: a systematic mixed studies review using narrative synthesis. Palliat Med2011; 25(3): 242–261.
28.
HoLYWKwongEWYSongMS, et al. Decision-making preferences on end-of-life care for older people: Exploration and comparison of Japan, the Hong Kong SAR and South Korea in East Asia. J Clin Nurs2022; 31(23-24): 3498–3509.
29.
NanKLaiRYChanHY.Decision control preference for end-of-life care among older adults. Geriatr Gerontol Int2023; 23(2): 151–152.
30.
YennurajalingamSRodriguesLFShamiehOM, et al. Decisional control preferences among patients with advanced cancer: an international multicenter cross-sectional survey. Palliat Med2018; 32(4): 870–880.
31.
MoriMChanHYLLinCP, et al. Definition and recommendations of advance care planning: A Delphi study in five Asian sectors. Palliat Med2025; 39(1): 99–112.
32.
DaiXNingXLinJ, et al. Cultural adaptation and pilot testing of a basic palliative care curriculum for practicing physicians and nurses in Mainland China. J Palliat Med2025; 28: 1096–1101.
33.
ChenLAHuangCYWangYH, et al. Use of multimedia shared decision-making aids (EATING program) for improving advance care planning engagement among community-dwelling older adults with chronic diseases: A cluster randomized controlled trial. Appl Nurs Res2025; 82: 151931.
34.
DuJFuLCuiJ, et al. Effects of the heart to heart card game for patients with advanced cancer receiving home-based palliative care: A clinical randomized controlled trial. Int J Environ Res Public Health2022; 19(10): 6115.
35.
LiTPeiXChenX, et al. Identifying end-of-life preferences among Chinese patients with cancer using the heart to heart card game. Am J Hosp Palliat Med2021; 38(1): 62–67.
ChanAChanA-LKwanD.Considerations for the use of advance directives among older persons with dementia in Hong Kong. US-China Law Rev2016; 13(2): 89–111.
38.
Working Group on review of HACEC guidelines related to EOL decision-making. HA guidelines on life-sustaining treatment in the terminally Ill. 2020. https://www.ha.org.hk/haho/ho/psrm/LSTEng.pdf (2025, accessed 9 January 2025).
39.
ChanHMDorisMWTWongKH, et al. End-of-life decision making in Hong Kong: the appeal of the shared decision making model. In: FanR (ed.) Family-oriented informed consent: East Asian and American perspectives. Springer International Publishing, 2015, pp.149–167.
40.
MoriMLinCPChengSY, et al. Communication in cancer care in Asia: a narrative review. J Glob Oncol2023; 9(9): e2200266.
41.
TsohJPeisahCNarumotoJ, et al. Comparisons of guardianship laws and surrogate decision-making practices in China, Japan, Thailand and Australia: a review by the Asia Consortium, International Psychogeriatric Association (IPA) capacity taskforce. Int Psychogeriatr2015; 27(6): 1029–1037.
ChangHYTakemuraNChauPH, et al. Prevalence and predictors of advance directive among terminally ill patients in Taiwan before enactment of patient right to autonomy act: a nationwide population-based study. BMC Palliat Care2022; 21(1): 178.
44.
The American Geriatrics Society Expert Panel on Person-Centered Care. Person-centered care: A definition and essential elements. J Am Geriatr Soc2016; 64(1): 15–18.
45.
PunJKHCheungKMChowJCH, et al. Chinese perspective on end-of-life communication: a systematic review. BMJ Support Palliat Care2024; 14(e1): e30.
46.
PunJKHChanEAWangS, et al. Health professional-patient communication practices in East Asia: an integrative review of an emerging field of research and practice in Hong Kong, South Korea, Japan, Taiwan, and Mainland China. Patient Educ Couns2018; 101(7): 1193–1206.
47.
HuangRGionfriddoMRZhangL, et al. Shared decision-making in the People’s Republic of China: current status and future directions. Patient Prefer Adherence2015; 9: 1129–1141.
48.
MartinaDLinCPKristantiMS, et al. Advance Care Planning in Asia: A Systematic Narrative Review of healthcare professionals’ knowledge, attitude, and experience. J Am Med Dir Assoc2021; 22(2): 349.e1–349.e28.
49.
BernsSHCamargoMMeierDE, et al. Goals of care ambulatory resident education: training residents in advance care planning conversations in the outpatient setting. J Palliat Med2017; 20(12): 1345–1351.
50.
ChanWCHTinAFWongKLY. Effectiveness of an experiential workshop for enhancing helping professionals’ self-competence in death work in Hong Kong: a randomised controlled trial. Health Soc Care Community2017; 25(3): 1070–1079.
51.
MillsteinLSRosenblattPBellinMH, et al. Advance care planning and communication skills improve after an interprofessional team simulation with standardized patients. Palliat Med Rep2022; 3(1): 123–131.
52.
ChanHYKwokAOYuenKK, et al. Association between training experience and readiness for advance care planning among healthcare professionals: a cross-sectional study. BMC Med Educ2020; 20(1): 451.
