To estimate the content validity of the outcome Knowledge: Heart Failure Management (1835) of the Nursing Outcomes Classification (NOC).
Methods
A methodological study conducted in Brazil with nurses with expertise in cardiovascular nursing and nursing process. The nurse experts evaluated the relevance of the indicators for the nursing outcome on a 5-point Likert scale. A total of 55 indicators were analyzed, including 50 NOC indicators, four indicators located from a scoping review, and one suggested by an expert during the content validation process. The relevance ratio supported the categorization of indicators as critical, supplemental, or unnecessary. Relevance ratios of critical and supplemental indicators were summed and divided by the total number of the indicators to calculate the outcome content validity (OCV) score of the nursing outcome.
Findings
Fifteen nurse experts, mostly females (n = 13) with a mean age of 36.0 ± 6.3 years, 13.9 ± 6.5 years of professional experience, and extensive use of the nursing process in their clinical practice (n = 10), teaching (n = 13), and research (n = 11), participated in this study. Regarding the content validation, 43 (78.2%) out of 55 indicators were categorized as critical (relevance ratio .80–.98), 11 (20%) as supplemental (relevance ratio .67–.79), and one indicator (1.8%) was categorized as unnecessary (relevance ratio .48). The OCV score of the nursing outcome was .87.
Conclusion
The study provided evidence of content validity of 49 indicators of the NOC outcome, Knowledge: Heart Failure Management, and five new indicators identified through the validation process based on nurse experts’ opinions.
Implications for the nursing practice
These findings provide evidence-based indicators for the measurement of heart failure patients' knowledge about disease management. As a result, nurses can test the effectiveness of nursing interventions based on valid outcome indicators.
AlbertC. M.SmithM. A.HummelS. L.HummelE. K. (2017). Symptom burden in heart failure: Assessment, impact on outcomes, and management. Heart Failure Reviews, 22(1), 25–39. https://doi.org/10.1007/s10741-016-9581-4
2.
ArtinianN.MagnanM.ChristianW.LangeM. (2002). What do patients know about their heart failure?Applied Nursing Research, 15(4), 200–208. https://doi.org/10.1053/apnr.2002.35959
3.
AwokeM. S.BaptisteD. L.DavidsonP.RobertsA.Dennison-HimmelfarbC. (2019). A quasi-experimental study examining a nurse-led education program to improve knowledge, self-care, and reduce readmission for individuals with heart failure. Contemporary Nurse, 55(1), 15–26. https://doi.org/10.1080/10376178.2019.1568198
4.
BenjaminE. J.ViraniS. S.CallawayC. W.ChamberlainA. M.ChangA. R.ChengS.MuntnerP. (2018). American Heart Association Council on epidemiology and prevention statistics committee and stroke statistics subcommittee heart disease and stroke statistics-2018 Update: A report from the American Heart Association. Circulation, 137, e67–e492. https://doi.org/10.1161/CIR.0000000000000558
5.
CarneiroC. S.OliveiraA. P. D.LopesJ. L.BachionM. M.HerdmanT. H.MoorheadS. A.BarrosA. L. B. L. (2016). Outpatient clinic for health education: Contribution to self-management and self-care for people with heart failure. International Journal of Nursing Knowledge, 27(1), 49–55. https://doi.org/10.1111/2047-3095.12071
6.
DavisK. K.DennisonR. C. H.SzantonS. L.HayatM. J.AllenJ. K. (2015). Predictors of heart failure self-care in patients who screened positive for mild cognitive impairment. Journal of Cardiovascular Nursing, 30(2), 152–160. https://doi.org/10.1097/JCN.0000000000000130
7.
EmidioS. C. E.MoorheadS.OliveiraH. C.HerdmanT. H.Oliveira-KumakuraA. R. S.CarmonaE. V. (2020). Validation of nursing outcomes related to breastfeeding. International Journal of Nursing Knowledge, 31(2), 134–144. https://doi.org/10.1111/2047-3095.12256
8.
FarmerS. A.MagasiS.BlockP.WhelenM. J.HansenL. O.BonowR. O.GradyK. L. (2016). Patient, caregiver, and physician work in heart failure disease management: A qualitative study of issues that undermine wellness. Mayo Clinic Proceedings, 91(8), 1056–1065. https://doi.org/10.1016/j.mayocp.2016.05.016
9.
FarréN.VelaE.ClèriesM.BustinsM.Cainzos-AchiricaM.EnjuanesC.Comín-ColetJ. (2017). Real world heart failure epidemiology and outcome: A population-based analysis of 88,195 patients. PLOS ONE, 12(2), e0172745. https://doi.org/10.1371/journal.pone.0172745
10.
Gioli-PereiraL.Marcondes-BragaF. G.Bernardez-PereiraS.BacalF.FernandesF.MansurA. J.KriegerJ. E. (2019). Predictors of one-year outcomes in chronic heart failure: The portrait of a middle-income country. BMC Cardiovascular Disorders, 19(1), 251. https://doi.org/10.1186/s12872-019-1226-9
11.
GuimarãesH. C. Q. C. P.PenaS. B.LopesJ. L.LopesC. T.BarrosA. L. B. L. (2016). Experts for validation studies in nursing: New proposal and selection criteria. International Journal of Nursing Knowledge, 27(3), 130–135. https://doi.org/10.1111/2047-3095.12089
12.
HagglundE.LyngaP.FrieF.UllmanB.PerssonH.MelinM.HagermanI. (2015). Patient-centred home-based management of heart failure: Findings from a randomized clinical trial evaluating a tablet computer for self-care, quality of life and effects on knowledge. Scandinavian Cardiovascular Journal, 49(4), 193–199. https://doi.org/10.3109/14017431.2015.1035319
13.
HeadB. J.AquilinoM. L.JohnsonM.ReedD.MaasM.MoorheadS. (2004). Content validity and nursing sensitivity of community-level outcomes from the Nursing Outcomes Classification (NOC). Journal of Nursing Scholarship: An official Publication of Sigma Theta Tau International Honor Society of Nursing, 36(3), 251–259. https://doi.org/10.1111/j.1547-5069.2004.04046.x
14.
HeadB. J.MaasM.JohnsonM. (2003). Validity and community-health-nursing sensitivity of six outcomes for community health nursing with older clients. Public Health Nursing (Boston, Mass.), 20(5), 385–398. https://doi.org/10.1046/j.1525-1446.2003.20507.x
15.
HoskinsL. M. (1989). Clinical validation, methodologies for nursing diagnoses research. In Carrol-JohnsonR. M. (Ed.), Classification of nursing diagnoses: Proceedings of the eighth conference of North America Nursing Diagnosis Association (pp. 126–131). New York: Lippincott.
16.
InamdarA. A.InamdarA. C. (2016). Heart failure: Diagnosis, management and utilization. Journal of Clinical Medicine, 5(7), 62. https://doi.org/10.3390/jcm5070062
17.
JacobsonA. F.SumodiV.AlbertN. M.ButlerR. S.DeJohnL.WalkerD.RossD. M. (2018). Patient activation, knowledge, and health literacy association with self-management behaviors in persons with heart failure. Heart & Lung, 47(5), 447–451. https://doi.org/10.1016/j.hrtlng.2018.05.021
18.
JaniB. D.MairF. S.RogerV. L.WestonS. A.JiangR.ChamberlainA. M. (2016). Comorbid depression and heart failure: A community cohort study. PloS One, 11(6), e0158570. https://doi.org/10.1371/journal.pone.0158570
19.
KatoN.KinugawaK.NakayamaE.HatakeyamaA.TsujiT.KumagaiY.NagaiR. (2013). Development and psychometric properties of the Japanese heart failure knowledge scale. International Heart Journal, 54(4), 228–233. https://doi.org/10.1536/ihj.54.228
20.
MoorheadS.SwansonE.JohnsonM.MaasM. L. (2018). Nursing Outcomes Classification (NOC): Measurement of health outcomes (6th ed). Elsevier.
21.
OhH.MoorheadS. (2019). Validation of the knowledge and self-management nursing outcomes classification for adults with diabetes. Computers, Informatics, Nursing: CIN, 37(4), 222–228. https://doi.org/10.1097/CIN.0000000000000495
Pancorbo-HidalgoP. L.Bellido-VallejoJ. C. (2019). Psychometric evaluation of the nursing outcome knowledge: Pain Management in people with chronic pain. International Journal of Environmental Research and Public Health, 16(23), 4604. https://doi.org/10.3390/ijerph16234604
24.
PasqualiL. (2010). Instrumentação Psicológica: Fundamentos e práticas. Psychological instrumentation: Fundamentals and practices. Porto Alegre, Brazil: Artmed.
25.
PetersM. D.GodfreyC. M.KhalilH.McInerneyP.ParkerD.SoaresC. B. (2015). Guidance for conducting systematic scoping reviews. International Journal of Evidence-Based Healthcare, 13, 141–146. https://doi.org/10.1097/XEB.0000000000000050
26.
PolitD. F.BeckC. T. (2011). Essentials of nursing research: Appraising evidence for nursing practice (7th ed.). Artmed:.
27.
RabeloE. R.MantovaniV. M.AlitiG. B.DominguesF. B. (2011). Cross-cultural adaptation and validation of a disease knowledge and self-care questionnaire for a Brazilian sample of heart failure patients. Revista Latino-Americana de Enfermagem, 19(2), 277–284. https://doi.org/10.1590/S0104-11692011000200008
28.
ReillyC. M.HigginsM.SmithA.GaryR. A.RobinsonJ.ClarkP. C.DunbarS. B. (2009). Development, psychometric testing, and revision of the Atlanta Heart Failure Knowledge Test. Journal of Cardiovascular Nursing, 24(6), 500–509. https://doi.org/10.1097/JCN.0b013e3181aff0b0
29.
RosenD.Berrios-ThomasS.EngelR. J. (2016). Increasing self-knowledge: Utilizing tele-coaching for patients with congestive heart failure. Social Work in Health Care, 55(9), 711–719. https://doi.org/10.1080/00981389.2016.1191581
30.
SantosC. T.Almeida MdeA.Lucena AdeF. (2016). The nursing diagnosis of risk for pressure ulcer: Content validation. Revista Latino—Americana de Enfermagem, 24, e2693, 1–8. https://doi.org/10.1590/1518-8345.0782.2693
31.
ScherbC. A.RappC. G.JohnsonM.MaasM. (1998). The nursing outcomes classification: Validation by rehabilitation nurses. Rehabilitation Nurses, 23(4), 174–178.
32.
SedlarN.LainscakM.MårtenssonJ.StrömbergA.JaarsmaT.FarkasJ. (2017). Factors related to self-care behaviors in heart failure: A systematic review of European Heart Failure Self-Care Behavior Scale studies. European Journal of Cardiovascular Nursing, 16, 272–282. https://doi.org/10.1177/1474515117691644
33.
SousaJ. P.SantosM. (2019). Symptom management and hospital readmission in heart failure patients: A qualitative study from Portugal. Critical Care Nursing Quarterly, 42(1), 81–88. https://doi.org/10.1097/CNQ.0000000000000241
34.
SouzaL. M. S. A.AyoubA. C.CavalcanteA. M. R. Z. (2017). Nursing diagnosis for people with heart failure based on the hemodynamic profiles. International Journal of Nursing Knowledge, 28(4), 199–203. https://doi.org/10.1111/2047-3095.12151
35.
TawalbehL. I.QadireM. A.AhmadM. M.AloushS.SumaqaY. A.HalabiM. (2017). Knowledge and self-care behaviors among patients with heart failure in Jordan. Research in Nursing and Health, 40(4), 350–359. https://doi.org/10.1002/nur.21805
van derWalM. H.JaarsmaT.MoserD. K.vanVeldhuisenD. J. (2005). Development and testing of the Dutch Heart Failure Knowledge Scale. European Journal of Cardiovascular Nursing: Journal of the Working Group on Cardiovascular Nursing of the European Society of Cardiology, 4(4), 273–277. https://doi.org/10.1016/j.ejcnurse.2005.07.003
38.
Van SpallH. G. C.RahmanT.MyttonO.RamasundarahettigeC.IbrahimQ.KabaliC.ConnollyS. (2017). Comparative effectiveness of transitional care services in patients discharged from the hospital with heart failure: A systematic review and network meta-analysis. European Journal of Heart Failure, 19(11), 1427–1443. https://doi.org/10.1002/ejhf.765
39.
VieiraA. M.CostaI. Z.OhP.LimaG. G. M. (2016). Questionnaires designed to assess knowledge of heart failure patients: A systematic review. Journal of Cardiovascular Nursing, 31(5), 469–478. https://doi.org/10.1097/JCN.0000000000000281
40.
ViraniS. S.AlonsoA.BenjaminE. J.BittencourtM. S.CallawayC. W.CarsonA. P.HeardD. G. (2020). Heart disease and stroke statistics—2020 update: A report from the American Heart Association. Circulation, 141, E139–E596. https://doi.org/10.1161/CIR.0000000000000757
41.
YuM.ChairS. Y.ChanC. W. H.ChoiK. C. (2015). A health education booklet and telephone follow-ups can improve medication adherence, health-related quality of life, and psychological status of patients with heart failure. Heart & Lung, 44(5), 400–407. https://doi.org/10.1016/j.hrtlng.2015.05.004
