Using a case study analysis of the Expert Panel Report 3 (EPR-3): Guidelines for the Diagnosis and Treatment of Asthma, this article compares the workflows and knowledge requirements of primary care practice to the structure and content of a well-respected set of clinical guidelines. The authors show that there are discrepancies between physician workflow and the structure of the EPR-3, as well as between physicians’ knowledge requirements and the content of the EPR-3. The analysis suggests that closing the gap between medical knowledge and practice will require alternative ways to represent guidelines’ knowledge and recommendations.
AgrawalA.ShiffmanR. (2001). Evaluation of guideline quality using GEM-Q. In PatelV. L. . (Eds.), MEDINFO 2001. Proceedings of the 10th World Congress on Medical Informatics (Vol. 84, pp. 1097–1101). Amsterdam, Netherlands: IOS Press.
2.
AnnettJ.DuncanK. (1967). Task analysis and training design. Occupational Psychology, 41, 211–221.
3.
AnnettJ.StantonN, (Eds.) (2000). Task analysis. London, England: Taylor & Francis.
4.
BarahonaP.AzevedoF.VelosoM.EstêvãoN.GallegoR. (2001). Computerising a guideline for the management of diabetes. International Journal of Medical Informatics, 64, 275–284.
5.
BarnardP.MayJ. (2000). Towards a theory-based form of cognitive task analysis of broad scope and applicability. In SchraagenJ.ChipmanS.ShalinV. (Eds.), Cognitive task analysis (pp. 147–164). Mahwah, NJ: Lawrence Erlbaum.
6.
BatesD. W.KupermanG. J.WangS.GandhiT.KittlerA.VolkL.MiddletonB. (2003). Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. Journal of the American Medical Informatics Association, 10, 523–530.
7.
BhattacharyyaO.ReevesS.ZwarensteinM. (2009). What is implementation research?: Rationale, concepts, and practices. Research on Social Work Practice, 19, 491–502.
8.
BisantzA. M.OckermanJ. J. (2003). Lessons from a focus on artefacts and implicit theories: Case studies in analysis and design. In HollnagelE. (Ed.), Handbook of cognitive task design (pp. 633–652). Mahwah, NJ: Lawrence Erlbaum.
9.
CabanaM. D.RandC. S.BecherO. J.RubinH. R. (2001). Reasons for Pediatrician nonadherence to asthma guidelines. Archives of Pediatrics and Adolescent Medicine, 155, 1057–1062.
10.
CabanaM. D.RandC. S.PoweN. R.WuA. W.WilsonM. H.AbboudP.-A.RubinH. R. (1999). Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA, 282, 1458–1465.
11.
ChipmanS.SchraagenJ.ShalinV. (2000). Introduction to cognitive task analysis. In SchraagenJ.ChipmanS.ShalinV. (Eds.), Cognitive task analysis (pp. 3–23). Mahwah, NJ: Lawrence Erlbaum.
12.
ChoiB. C. K. (2005). Understanding the basic principles of knowledge translation. Journal of Epidemiology and Community Health, 59, 93–93.
13.
CodishS.ShiffmanR. (2005). A model of ambiguity and vagueness in clinical practice guideline recommendations. AMIA Annual Symposium Proceedings Archive, 2005, 146–150.
ConnellyD.RichE.CurleyS.KellyJ. (1990). Knowledge resource preferences of family physicians. Journal of Family Practice, 30, 353–359.
16.
CrystalA.EllingtonB. (2004). Task analysis and human–computer interaction: Approaches, techniques, and levels of analysis. Paper presented at the Tenth Americas Conference on Information Systems, New York, NY.
17.
DamianiG.PinnarelliL.ColosimoS.AlmientoR.SicuroL.GalassoR.RicciardiW. (2010). The effectiveness of computerized clinical guidelines in the process of care: A systematic review. BMC Health Services Research, 10, 2.
18.
DawesM.SampsonU. (2003). Knowledge management in clinical practice: A systematic review of information seeking behavior in physicians. International Journal of Medical Informatics, 71, 9–15.
19.
de ClercqP. A.BlombJ. A.KorstenH. H. M.HasmanA. (2004). Approaches for creating computer-interpretable guidelines that facilitate decision support. Artificial Intelligence in Medicine, 31, 1–27.
20.
DopsonS.FitzgeraldL.FerlieE.GabbayJ.LocockL. (2002). No magic targets! Changing clinical practice to become more evidence based. Health Care Management Review, 27, 35.
DuboisD.ShalinV. (2000). Describing job expertise using cognitively oriented task analysis (COTA). In SchraagenJ.ChipmanS.ShalinV. (Eds.), Cognitive task analysis (pp. 41–56). Mahwah, NJ: Lawrence Erlbaum.
23.
DuffL.CaseyA. (1998). Implementing clinical guidelines. How can informatics help?Journal Americal Medical Information Association, 5, 225–226.
24.
EricssonK. A.SmithJ. (1991). Prospects and limits of the empirical study of expertise: An Introduction. In EricssonK. A.SmithJ. (Eds.), Towards a general theory of expertise: Prospects and limits (pp. 1–38). Cambridge, UK: Cambridge University Press.
25.
EstabrooksC. A.ThompsonD. S.LovelyJ. J. E.HofmeyerA. (2006). A guide to knowledge translation theory. Journal of Continuing Education in the Health Professions, 26, 25–36.
26.
FerlieE.FitzgeraldL.WoodM. (2000). Getting evidence into clinical practice: An organisation behaviour perspective. Journal of Health Services Research and Policy, 5, 96–102.
27.
FerlieE.GabbayJ.FitzgeraldL.LocockL.DopsonS. (2001). Evidence-based medicine and organisational change: An overview of some recent qualitative research. In AshburnerL. (Ed.), Organisational behaviour and organisational stuides in health care: Reflections on the future (pp. 18–42). Basingstoke, UK: Palgrave.
28.
GabbayJ.Le MayA. (2004). Evidence based guidelines or collectively constructed “mindlines?” Ethnographic study of knowledge management in primary care. British Medical Journal, 329, 1013–1017.
29.
GargA. X.AdhikariN. K. J.McDonaldH.Rosas-ArellanoM. P.DevereauxP. J.BeyeneJ.HaynesR. B. (2005). Effects of computerized clinical decision support systems on practitioner performance and patient outcomes. JAMA, 293, 1223–1238.
30.
GenuisS. K.GenuisS. J. (2006). Exploring the continuum: Medical information to effective clinical practice. Paper I: The translation of knowledge into clinical practice. Journal of Evaluation in Clinical Practice, 12, 49–62.
31.
GrahamI. D.LoganJ.HarrisonM. B.StrausS. E.TetroeJ.CaswellW.RobinsonN. (2006). Lost in knowledge translation: Time for a map?Journal of Continuing Education in the Health Professions, 26, 13–24.
32.
GrimshawJ.RussellI. (1993). Effect of clinical guidelines on medical practice: A systematic review of rigorous evaluations. Lancet, 342, 1317–1322.
33.
GrimshawJ. M.ThomasR. E.MacLennanG.FraserC.RamsayC. R.ValeL.DonaldsonC. (2005). Effectiveness and efficiency of guideline dissemination and implementation strategies. International Journal of Technology Assessment in Health Care, 21, 149–149.
34.
GrolR.DalhuijsenJ.ThomasS.VeldC. i. t.RuttenG.MokkinkH. (1998). Attributes of clinical guidelines that influence use of guidelines in general practice: Observational study. BMJ, 317, 858–861.
35.
HardernR. D.HampshawS. (1997). What do accident and emergency medical staff think of practice guidelines?European Journal of Emergency Medicine, 4, 68–71.
36.
HellerB.LofflerM.MusenM.StefanelliM. (Eds.). (2001). Computer-based support for clinical guidelines and protocols (Vol. 83). Amsterdam, Netherlands: IOS Press.
37.
HeselmansA.Van de VeldeS.DonceelP.AertgeertsB.RamaekersD. (2009). Effectiveness of electronic guideline-based implementation systems in ambulatory care settings—A systematic review. Implementation Science, 4, 82.
38.
HollnagelE. (2003). Prolegomenon to cognitive task design. In HollnagelE. (Ed.), Handbook of cognitive task design (pp. 3–16). Mahwah, NJ: Lawrence Erlbaum.
39.
IsernD.MorenoA. (2008). Computer-based execution of clinical guidelines: A review. Journal of the American Medical Informatics Association, 77, 787–808.
40.
JacksonR.FederG. (1998). Guidelines for clinical guidelines. BMJ, 317, 427–428.
41.
KawamotoK.HoulihanC. A.BalasE. A.LobachD. F. (2005). Improving clinical practice using clinical decision support systems: A systematic review of trials to identify features critical to success. BMJ, 330, 765.
42.
KirlikA. (1995). Requirements for psychological models to support design: Toward ecological task analysis. In FlachJ. M.HancockP. A.CairdJ.VicenteK. J. (Eds.), Global perspectives on the ecology of human-machine systems (Vol. 1. Resources for ecological psychology, pp. 68–120). Hillsdale, NJ: Lawrence Erlbaum.
43.
KleinG.MilitelloL. (2001). Some guidelines for conducting a cognitive task analysis. In, SalasE., (Ed.) Advances in human performance and cognitive engineering research (pp. 163–199): Emerald Group Publishing.
44.
KushnirukA. W. (2001). Analysis of complex decision-making processes in health care: Cognitive approaches to health informatics. Journal of Biomedical Informatics, 34, 365–376.
45.
LathleanJ.Le MayA. (2002). Communities of practice: An opportunity for interagency working. Journal of Clinical Nursing, 11, 394–398.
46.
LobachD. (1995). A model for adapting clinical guidelines for electronic implementation in primary care. Proceedings of the Annual Symposium on Computer Application in Medical Care, 1995, 581–585.
47.
LocockL.DopsonS.ChambersD.GabbayJ. (2001). Understanding the role of opinion leaders in improving clinical effectiveness. Social Science & Medicine, 53, 745–757.
48.
LugtenbergM.Zegers-van SchaickJ.WestertG.BurgersJ. (2009). Why don’t physicians adhere to guideline recommendations in practice? An analysis of barriers among Dutch general practitioners. Implementation Science, 4, 54.
49.
MargolisA.BrayB.GilbertE.WarnerH. (1995). Computerized practice guidelines for heart failure management: The HeartMan system. Proceedings of the Annual Symposium on Computer Application on Medical Care, 1995, 228–232.
50.
MavigliaS. M.ZielstorffR. D.PaternoM.TeichJ. M.BatesD. W.KupermanG. J. (2003). Automating complex guidelines for chronic disease: Lessons learned. Journal of the American Medical Informatics Association, 10, 154–165.
51.
McDonaldC. J.OverhageJ. M. (1994). Guidelines you can follow and trust. An ideal and an example. JAMA, 271, 872–873.
52.
McGlynnE. A.AschS. M.AdamsJ.KeeseyJ.HicksJ.DeCristofaroA.KerrE. A. (2003). The quality of health care delivered to adults in the United States. New England Journal of Medicine, 348, 2635–2645.
53.
MichieS.JohnstonM. (2004). Changing clinical behaviour by making guidelines specific. BMJ, 328, 343–345.
54.
MittmanB.ToneskX.JacobsonP. (1992). Implementing clinical practice guidelines: Social influence strategies and practitioner behavior change. Quality Review Bulletin, 18, 413–422.
55.
NaylorC. D. (2002). Putting evidence into practice. The American Journal of Medicine, 113, 161–163.
56.
NaylorC. D. (2004). The complex world of prescribing behavior. JAMA, 291, 104–106.
57.
NewtonJ.KnightD.WoolheadG. (1996). General practitioners and clinical guidelines: A survey of knowledge, use and beliefs. British Journal of General Practice, 46, 513–517.
58.
NHLBI Communications Office (2007, August29, 2007). National Asthma Guidelines Updated. New Approaches for Monitoring Asthma Control, Expanded Recommendations for Children. NIH News. Retrieved November 17, 2009, fromhttp://public.nhlbi.nih.gov/newsroom/home/GetPressRelease.aspx?id=2442
59.
NoninoF.LiberatiA. (2004). Essential requirements for practice guidelines at national and local levels. Neurological Sciences, 25, 2–7.
60.
NormanD. (2000). The design of everyday things. New York, NY: MIT Press.
61.
PatelV. L.ArochaJ. F.KaufmanD. R. (2001). A primer on aspects of cognition for medical informatics. Journal of the American Medical Informatics Association, 8, 324–343.
62.
PatelV. L.GroenG. (1986). Knowledge based solution strategies in medical reasoning. Cognitive Science, 10, 91–116.
63.
PatelV. L.GroenG. (1991). The general and specific nature of medical expertise: A critical look. In EricssonK. A.SmithJ. (Eds.), Towards a general theory of expertise: Prospects and limits (pp. 93–125). Cambridge, UK: Cambridge University Press.
64.
PatelV. L.GroenG.ArochaJ. (1990). Medical expertise as a function of task difficulty. Memory and Cognition, 18, 394–406.
65.
RosenfeldR. M.ShiffmanR. N. (2009). Clinical practice guideline development manual: A quality-driven approach for translating evidence into action. Otolaryngology-Head and Neck Surgery, 140, S1–S43.
66.
RousseauN.McCollE.NewtonJ.GrimshawJ.EcclesM. (2003). Practice based, longitudinal, qualitative interview study of computerised evidence based guidelines in primary care. BMJ, 326, 314.
67.
ScottI. A.DenaroC. P.BennettC. J.MudgeA. M. (2004). Towards more effective use of decision support in clinical practice: What the guidelines for guidelines don’t tell you. Internal Medicine Journal, 34, 492–500.
68.
SeroussiaB.BouaudaJ.ChatellierG. (2005). Guideline-based modeling of therapeutic strategies in the special case of chronic diseases. International Journal of Medical Informatics, 74, 89–99.
69.
ShaneyfeltT. M.Mayo-SmithM. F.RothwanglJ. (1999). Are guidelines following guidelines?: The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. JAMA, 281, 1900–1905.
70.
ShekelleP. G.KravitzR. L. (2000). Are nonspecific practice guidelines potentially harmful? A randomized comparison of the effect of nonspecific versus specific guidelines on physician decision making. Health Services Research, 34, 1429–1448.
71.
ShepherdA. (2001). Hierarchical task analysis. New York, NY: Taylor & Francis.
72.
ShiffmanR.DixonJ.BrandtC. A.EssaihiA.HsiaoA.MichelG.O’ConnellR. (2005). The guideline implementability appraisal (GLIA): Development of an instrument to identify obstacles to guideline implementation. BMC Medical Informatics and Decision Making, 5, 23.
73.
ShiffmanR. N.MichelG.EssaihiA.ThornquistE. (2004). Bridging the guideline implementation gap: A systematic, document-centered approach to guideline implementation. Journal of the American Medical Informatics Association, 11, 418–426.
74.
StrausS. E.TetroeJ.GrahamI. (2009). Defining knowledge translation. Canadian Medical Association Journal, 181, 165–168.
75.
SunY.van WingerdeF.KohaneI.HararyO.MandlK.Salem-SchatzS.HomerC. J. (1999). The challenges of automating a real-time clinical practice guideline. Clinical Performance and Quality Health Care, 7, 28–35.
76.
TaylorV. M.GoldbergH. I.DeyoR. A.CooperS.LeekM.NordgulenL. L. (1996). Modifying community practice styles: The back pain outcome assessment team information dissemination effort. Journal of Continuing Education in the Health Professions, 16, 203–214.
TierneyW. M.OverhageJ. M.TakesueB. Y.HarrisL. E.MurrayM. D.VargoD. L.McDonaldC. J. (1995). Computerizing guidelines to improve care and patient outcomes: The example of heart failure. Journal of the American Medical Informatics Association, 2, 316–322.
79.
U.S. Department of Health and Human Services, National Institutes of Health, & National Heart Lung and Blood Institute. (2007, August28). Expert Panel Report 3 (EPR3): Guidelines for the Diagnosis and Management of Asthma. Retrieved October 18, 2009, fromhttp://www.nhlbi.nih.gov/guidelines/asthma/asthgdln.htm
80.
WoodsD. D. (1998). Designs are hypotheses about how artifacts shape cognition and collaboration. Ergonomics, 41, 168–173.
81.
WoodsD. D.RothE. M.BennettK. B. (1990). Explorations in joint human-machine cognitive systems. In RobertsonS. P.ZacharyW.BlackJ. B. (Eds.), Cognition, computing and cooperation (pp. 123–158). Norwood, NJ: Ablex Publishing Company.
