Abstract
Communication problems with their caregivers are common in people with dementia. Although interventions for improvement of communication are being developed, a tool to measure how participants experience their communication is lacking. The objective of this article is to describe the development of a questionnaire that measures the “experienced communication” of persons with dementia (ECD-P) as well as of their caregivers (ECD-C). Interviews were conducted with five person with dementia—caregiver dyads who had recently received a new communication intervention. Reflexive thematic analysis was performed on the transcripts using ATLAS.ti. Codes were created, categories and themes were identified, and items for the questionnaires were generated. Selection of items and response scales was done in collaboration with the same dyads. The final version was established after pilot testing with seven other dyads and discussion with five experts in the field of dementia care. Analysis of the transcripts resulted in 212 codes and 17 categories within four themes: caregiver competence, social communication, communication difficulties in daily life, and experienced emotions during conversations. The final version of the ECD-P consists of part 1 with 22 items and 4-point Likert scales, and part 2 with two items and 1 to 10 scales. In the final ECD-C (proxy version), part 1 and part 2 are similar to the ECD-P, while a part 3 was added to assess caregivers’ own perspective and emotions (five items). Based on the experiences of people with dementia and their caregivers, we constructed a face-valid questionnaire. This justifies future research to test its clinimetric characteristics.
Keywords
Communication problems are common in people with dementia, but there is no tool that measures how persons with dementia and their caregivers experience their communication.
Together with the target group we developed a questionnaire that aims to measure the “experienced communication” of persons with dementia (ECD-P) as well as of their caregivers (ECD-C), that can be used to evaluate communication interventions.
Although its clinimetric properties are not published yet, this face-valid list of items concerning the experienced communication of people with dementia and their caregivers is now available to healthcare professionals.
Introduction
Dementia is a chronic condition that can be caused by a variety of neurodegenerative diseases. Alzheimer’s disease is the most prevalent cause of dementia, followed by vascular or multi-infarct dementia, frontotemporal degeneration, and Lewy Body dementia. 1 Every type of dementia is dominated by cognitive decline, of which deterioration of language skills is an important symptom. These so-called “cognitive communication disorders” (CCDs) can arise in any phase of dementia and generally worsen during the course of the disease. 2 CCDs cause misunderstanding, miscommunication, and emotional stress. They have a negative impact on personal relationships and daily activities3,4 not just for the person with dementia, but also for family, friends, and caregivers.5,6
Research on the quality and efficacy of communication between the person with dementia and informal caregiver is scarce.7,8 In neurodegenerative diseases, where cure is basically absent, there is a strong need for non-pharmacological interventions that alleviate symptoms and troublesome consequences.9,10 Currently, we are evaluating a short-term logopedic (intervention by a speech-language therapist (SLT)) intervention program for optimizing communication between people with dementia and their caregivers at the Radboudumc in Nijmegen, The Netherlands. This intervention does not aim to improve language skills (word finding, grammar, or comprehension), but seeks to enhance positive interaction (verbal and non-verbal) between the person with dementia and the caregiver. The main focus is 2-fold: on educating dyads about the influence of dementia on communication skills and on how to optimize these skills in a personalized manner, explicitly taking into account the narrative of the person with dementia. 11 This intervention is expected to have a positive impact on how person with dementia-caregiver dyads experience their communication with each other and with the people in their social environment. 11 However, an instrument to measure experienced communication was lacking. When searching the literature for valid instruments to measure this concept of “experienced communication,” we only retrieved generic or dementia-specific instruments that measure language performances12-14 or instruments that assess communication disorders on a functional level.15,16 These instruments are usually filled out by informal caregivers (proxy measures) only or based on observations by health care professionals, thereby neglecting valuable input from the persons with dementia themselves. Because we failed to find instruments that specifically measure experienced communication of people with dementia and their caregivers, we decided to create a new questionnaire, with one version for the person with dementia and one for the primary informal caregiver. Communication is a complex process between a sender and a receiver, where information is exchanged (verbal and non-verbal) and a continual switching of roles between senders and receivers takes place. 17 Impaired communication skills disrupt this process on several levels, causing misunderstandings and frustration, 18 and leading to stress, anxiety, and other negative feelings for both persons with dementia and caregivers. 5 Since the aim of the logopedic intervention is to enhance positive interaction, and thereby diminish the negative consequences of CCDs, the questionnaire should contain items that correspond with the problems, feelings, and needs of persons with dementia and their caregivers. The aim of this article is to describe the development of this “Experienced Communication in Dementia” (ECD) questionnaire. The key research question was: what experiences did persons with dementia and their caregivers share about their communication difficulties and the impact of the intervention on these difficulties?
Methods
To determine which aspects of daily communication should be reflected in the questionnaires, a qualitative study with elements of participatory research was conducted.
For the development of the ECD, we took the following steps 19 : (1) generating items from interviews, (2) selection of items and response scales, and (3) pilot testing the items. The execution of each step is explained in further detail in the following paragraphs.
Participants
A purposive sampling strategy was applied. Person with dementia-caregiver dyads that had recently been treated with the new logopedic intervention 11 at the Radboudumc in Nijmegen, the Netherlands, were invited to participate in a semi-structured, in-depth interview.
Ethics
This study was approved by the regional medical ethics committee (file number 2014-1225). All participants were informed about the purpose and content of the study by researcher MO, both orally and in writing. All participants signed an informed consent form during their first meeting with researcher MO, knowing that their participation was voluntary and they had the right to withdraw at any time.
Gathering Data from Interviews
The interviews were performed face-to-face by researcher MO, who is a speech language therapist with expertise in working with communicatively impaired elderly as well as a trained interviewer with interpersonal and communication skills (like openness, sensitivity, active listening, and reflecting), which are imperative when trying to elicit detailed information from participants. 20 At the beginning of the interviews, aims and procedures were clearly explained. MO presented herself as a researcher, not mentioning her other role as an SLT, to avoid the suggestion of a therapeutic relationship. Additionally, she took ample time to establish a positive relationship, and if necessary she gave extra support to help persons with dementia remember and narrate their experiences, using cues like a photograph of their therapist or materials from the intervention. The interviews took place at the participants homes with both the person with dementia and the caregiver, also to make it possible for the caregivers to support the person with dementia and provide additional information if needed. 20 A carefully constructed interview guide was used, containing open-ended questions about (A) the communication difficulties the dyads encountered (e.g. barriers and facilitators; experienced emotions; needs) and (B) the impact of the intervention on their lives (e.g. changes that occurred; experiences with given advices, exercises, and materials).
Data Analysis
All interviews were audiotaped and transcribed verbatim. The transcripts were read, re-read and analyzed using ATLAS.ti by the first author and a research assistant. We applied reflexive thematic analysis, since this method best fits the study’s purpose for identifying patterns within data, 21 in this case problems, emotions, and needs of participants regarding their communication difficulties. Thematic analysis encompasses an active role for the researcher in identifying themes and selecting which are of interest for the questionnaire. 21 We followed the six recursive phases as described by Braun and Clarke 21 : familiarization by carefully reading the transcripts; an open coding cycle; generating initial categories and themes; reviewing and developing categories and themes; refining, defining and naming categories and themes; and writing up. This was an iterative process; analysis of a transcript was completed before conducting the next interview. This approach gave us the possibility to fine tune the interview questions and further specify the information given by the participants. Field notes and memos were created to provide insight in reasoning. The researchers conducted all coding processes independently, and discussed their findings after each coded transcript until consensus was reached on every code, every category, and every theme.
Generating Items from Interviews
We looked for categories that described the problems, feelings, and needs of the participants, especially those that were also influenced by the logopedic intervention according to the participants. These categories were the starting point for formulating items that were deemed relevant for the assessment of experienced communication. We tried to stay as close as possible to the language used by the participants, as this is the language we wanted to use in the questionnaires. Therefore, we constantly switched back and forth between categories and quotes of participants. We created two versions of every item: one for the person with dementia and one for the caregiver. We intentionally kept the preliminary pool of items quite broad, to allow selection of the most suitable items for the final questionnaires.
Selection of Items and Response Scales
In this phase of the study, we applied elements from participatory research by engaging in a collaborative partnership with the participants. 22 We invited the same person with dementia-caregiver dyads to review all preliminary items and help us with the selection process. The dyads were visited for a second time at their homes by researcher MO. They were asked to reflect aloud on every item and the corresponding response scale. Then, researcher and dyads collaborated to make a selection of items for the questionnaires. Finally, these items were discussed within the research team (all authors of this article), and the first versions of the questionnaires were established.
Pilot Testing the Questionnaires
To verify the relevance and comprehension of the questionnaires, the next step was pilot testing. First, the questionnaires were presented to several new person with dementia-caregiver dyads (on separate occasions) who had not received the logopedic intervention. They were recruited during their visit to the outpatient clinic of the Geriatrics Department of the Radboudumc in Nijmegen. They were asked to articulate their thoughts while responding to all items (the “think aloud technique”). 23 Notes were kept during this process. Second, the questionnaires were discussed with experts in the field of dementia or communication disorders from the Radboud Alzheimer Center. All comments were used to make final adjustments in wording and sequence of the items. Then, the research team (also the authors of this article) decided on the final versions of the questionnaires.
Results
Participants
Five person with dementia-caregiver dyads could be invited for an interview, and all of them agreed to participate. Their characteristics are shown in Table 1. Except from the daughter in law, all participants were retired from work.
Participant Characteristics.
PwD = person with dementia.
Time since diagnosis, not since first symptoms.
Generating Items from Interviews
The interviews with the dyads lasted between 45 and 75 minutes. The open coding process of the complete transcripts resulted in 212 codes. We generated 17 relevant categories which we classified within four themes. An overview of the four themes (
Themes, Categories, and Quotes from Interviews.
The 12 categories in italic were described by the participants as problems, feelings, or needs with regards to communication difficulties (part A of the interview guide), as well as being subject to change by the intervention (part B of the interview guide). In the construction of the items, our aim was to stay as close as possible to the language in the quotes of the interviewees. For example, the category “Reactions of the person with dementia to communication difficulties” consists of two items: “I try to avoid events were there are many people present” and “I continue to participate in conversations, although I find it difficult to do so.” Eventually two preliminary pools of 43 items were composed: one pool for the person with dementia and one with comparable items from the perspective of the caregiver. An example for this change of perspective: “I’ve become more quiet than I used to be” for the person with dementia and “My partner has become more quiet than he/she used to be” for the caregiver. We used the word “partner” to refer to the person with dementia, but in the instructions of the questionnaires it is explained that for “partner” also mother, father, or any other relation can be read.
Finally, a suitable response scale was assigned to every item. The first scale for satisfaction contained five colored smiley’s ranging from happy (green) to sad (red) (17 items). The second scale for frequency had the following response options: never, monthly, weekly, daily, in every conversation (7 items). The third scale for agreement contained the following five response options: fully disagree, partially disagree, neutral, partially agree, fully agree (17 items). The fourth scale was a grading between 1 (poor) and 10 (excellent) for the quality of conversations (2 items).
Selection of Items and Response Scales
All 43 items were field-tested and discussed extensively with the same five persons with dementia-caregiver dyads. Based on their experiences and input, 19 items were eliminated that either were too abstract, too difficult to respond to, or too specific. Some examples of these items: “My caregiver arranges for a quiet environment when we talk to each other” was too difficult to respond to by the persons with dementia. The item “People in my social environment give me enough time to react during a conversation” was not applicable to all participants and therefore considered not adequate enough to be in the questionnaires.
Although we presumed that the colored smiley response options would be helpful, all persons with dementia told us that they disliked the smileys or did not fully understand their meaning. In collaboration with these five dyads, the research team decided to delete the neutral response option, thus changing the 5-point Likert scales for frequency and agreement to 4-point scales. This was done because everyone with communication difficulties is supposed to have an opinion about these topics, while a neutral response is meaningless.
Finally, five items were added about the caregiver’s personal perspective and emotions. According to the caregivers, their emotions (eg, sadness, anger, and frustration) obviously have an impact on the interaction with the person with dementia, and these emotions had also changed during and after the intervention. Therefore these items were added as a separate part of the caregiver version.
Pilot Testing the Questionnaires
In a first round of the pilot testing of the questionnaires we consulted seven dyads (whereof three women and four men with early stage dementia). In a second round the items were discussed by five experienced health care professionals: a geriatrician, a physician assistant, and three SLTs. This phase led to some changes in wording to improve comprehensibility. Two examples of sentences that were adapted: “I use words that are wrong” was changed into “I can’t find the right words,” and “I withdraw from conversations” was changed into “I tend to withdraw from conversations.” Lastly, the sequence of the items was discussed with all dyads and health care professionals. We decided to bundle items from the same themes, since this would prevent persons with dementia from having to make too many topic shifts. After these adjustments, the final versions of both questionnaires were established.
The development process of the questionnaires is also shown in the flow chart (Figure 1).

Flow chart of the development process of the ECD questionnaire.
Final Result: ECD-P and ECD-C
The items and corresponding score options (3 = strongly disagree to 0 = strongly agree) of the final ECD-P and ECD-C are displayed in Tables 3 and 4. For four items we reversed the score options (0 = strongly disagree to 3 = strongly agree), because we wanted to stay close to the words that had been used by the participants. The items were translated into English by the first author for the purpose of this article only.
Experienced Communication in Dementia Questionnaire—Version for the Person with Dementia.
Experienced Communication in Dementia Questionnaire—Caregiver Version.
The ECD-P consists of two parts with a total of 24 items: one part with 22 items and one part with 2 items. The ECD-C is comparable, but items are formulated from the perspective of the caregiver and it contains a third part of 5 items (total 29 items). We consider part 1 of both questionnaires as “the body” of the instrument, because these parts contain items about all four themes: caregiver competence, social communication, communication difficulties in daily life and experienced emotions during a conversation.
Response options are 4-point Likert scales, either for agreement (“fully disagree-partially disagree-partially agree-fully agree”) or for frequency (during every conversation-every day-every week-(almost) never). Parts 2 of both versions contain two items for assessment of conversation quality between the person with dementia and the caregiver and between the person with dementia and closest family members and friends. These items are to be answered on a scale of 1 (poor) to 10 (excellent). Part 3 is for ECD-C only, and contains five items regarding the caregivers’ own perspective and emotions about the current situation, with the same 4-point response scales as part 1 (agreement or frequency).
Finally, scores between 0 and 3 were assigned to every response option. A lower score is an indication for a more positive experienced communication, a higher score indicates a more negative experienced communication.
Discussion
This qualitative study resulted in a carefully constructed and face-valid new tool aimed to grasp changes in the experienced communication of a person with dementia and his or her caregiver. In the following paragraphs we will discuss this result and the next steps to the validation and implementation of the ECD.
Involving persons with dementia and their caregivers in the development of the ECD was an inspiring experience, and empowering for both researchers and dyads. The persons with dementia were capable to remember and verbalize their experiences, even though this required patience and sometimes visual cues or verbal repetition of the last sentences by the researcher or assistance of the caregivers. Their valuable input was endorsed in the phase where we selected the items and response scales together with the dyads: the recognition and acknowledgement of the items by the participants confirmed that we had distilled appropriate information from the initial interviews and used adequate wording in the questionnaire. Based on our experiences, we suspect that self-administration of the ECD by persons with dementia could be difficult, depending on the severity of the dementia as well as on the level of literacy. We therefore recommend always administering the ECD in the presence of a speech and language therapist (SLT), researcher, or other trained professional, who can also conduct the questionnaire as an interview if this is preferred. Joint interviews are commonly used in quality of life research and have already proven to be a reliable method to assess characteristics of people with dementia.24,25
During this study, it became clear that the participants described a wide range of problems, feelings, and needs related to communication difficulties, which is inherent to the complexity of communication and the many factors that are involved. 26 Topics that were highly prevalent and relevant to one dyad could be far less of an issue to another. Our aim was to capture this variation, which meant that we had to be very considerate about the wording of the items, as well as the response options. By involving persons with dementia, caregivers and health care professionals in every step of the development process we hope to have optimized the likelihood that the ECD questionnaires are acceptable to future users.
Previous research by Muò et al 27 provided a detailed description of dementia-associated disabilities in people with Alzheimer’s disease through the International Classification of Functioning, Disability and Health (ICF) model for classification of human functioning. 28 We noticed that the four themes that we extracted from the interview transcripts, and the fifth of “caregiver emotions” correspond with significant components in the ICF model (activities, participation, personal, and environmental factors). This suggests that our study has resulted in a valid coverage of relevant aspects of communication in dementia.
We observed that administration of the ECD is feasible within a limited timeframe (less than 15 minutes, but this will be tested more accurately in a future study), which is helpful for application in clinical practice. Objective assessments are usually much more time consuming, for instance the recently developed “Verbal and Nonverbal Interaction Scale for Care Recipient” (VNVIS-CR). 29 This is a reliable and valid observer rating scale that provides relevant information about verbal and nonverbal communication skills of persons with dementia. Application of this scale requires multiple video-recorded conversations from daily situations at participants homes, which have to be analyzed by researchers or other trained professionals, taking considerable amounts of time. Adequate evaluation requires both objective and subjective measurements and comparison of our new tool with a clinician-rated instrument like the VNVIS-CR seems a relevant next step, even though it measures a different but related concept.
Although the construction of twin-questionnaires—a patient measure and a comparable proxy measure—is relatively new to the field of speech and language therapy, it has been long used in dementia care research with quality of life questionnaires.24,30,31 Logsdon et al 30 describe that reports from persons with dementia and caregivers are related, but not identical. It is also found that people with dementia tend to give higher rates to their quality of life than their caregivers do.30,31 We suspect this phenomenon might also occur in ECD scores, so it is important to keep this in mind when interpreting, comparing, and discussing ECD scores. Finally, previous research has also shown that even moderate levels of cognitive impairment did not have a negative impact on reliability or validity of the outcomes. 27 We therefore consider the use of the ECD to be enriching for both research on communication interventions as well as for clinical practice by SLTs. Information from both conversation partners can support SLTs to identify individualized therapy goals or areas that need specific attention during therapy sessions, and to address differences in experiences between persons with dementia and caregivers.
A potential limitation of this study is that we based the items of the questionnaires on five interviews, and that all persons with dementia were men. This was due to the small number of people who already had received the communication intervention not too long before the interviews were conducted. Caregiver management strategies differ between women and men, and are important predictors for patient agitation and caregiver burden. 32 These strategies might also affect communication skills of both persons involved, which potentially could have influenced our results. It was however a considered choice to recruit only persons who underwent our logopedic intervention, since they acknowledged their communication difficulties and they could also reflect on which elements of the intervention were helpful for them. The pilot-testing round showed us that seven new dyads (whereof both male and female persons with dementia), who had not received the logopedic intervention, also recognized and related to the items we formulated. Additionally, the last transcript that was coded, did not elicit new and relevant information compared to the four previous transcripts. However, we recommend that future research should include a broader sample with better distribution of participants demographics.
We included people with various types of dementia and disease durations, which we consider to be a potential limitation as well as a strength. It helped us to cover a broad range of topics and making the ECD items as recognizable as possible to future users. On the other hand, as dementia progresses, language skills deteriorate in each type. 2 This made the interviews challenging sometimes, especially with participant 5, who had been affected by Primary Progressive Aphasia for 9 years. But as described above, with patience and (visual) help from the researcher and caregiver, and continuously checking whether we understood him correctly, this person also contributed to the development of the ECD in a meaningful way.
The ECD now seems face-valid, but its usefulness needs to be established by clinimetric research to test reproducibility and validity and also its ability to grasp improvement or deterioration of experienced communication. Until then, a list of items is available that has carefully put the experienced communication of people with dementia and their caregivers into words.
Footnotes
Acknowledgements
The authors would like to express their appreciation to all participants. We thank Hannes Kruse for his help with the qualitative analyses and the composition of the questionnaire. We thank Britt Lambregts for her help in the pilot testing phase. We thank Zorggroep Maas & Waal, Beneden-Leeuwen, The Netherlands, for providing MO the opportunity to perform this study.
Author Contributions
MO, ED, BdS, MN, and JK designed the study. MO collected the data. MO, ED, JK, and MN were involved in data analysis and interpretation. All authors contributed to writing the article and approved the manuscript.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Ethical Approval
This study was approved by the regional medical ethics committee (Arnhem-Nijmegen, file number 2014-1225) and all persons with dementia and caregivers signed an informed consent form, knowing that their participation was voluntary, and they had the right to withdraw at any time.
Data Availability
The data that support the findings of this study are available on request from the corresponding author (in Dutch only).
