Challenges in Developing Recommendations Based on Low-Quality Evidence in Thyroid Guidelines

Guyatt GH , Oxman AD , Schünemann HJ , Tugwell P , Knottnerus A . 2011. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol, 64:380–382.

Qaseem A , Snow V , Owens DK , Shekelle P , Clinical Guidelines Committee of the American College of Physicians . 2010. The development of clinical practice guidelines and guidance statements of the American College of Physicians: summary of methods. Ann Intern Med, 153:194–199.

Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Board on Health Care Services, Institute of Medicine 2011 Clinical Practice Guidelines We Can Trust. National Academies Press, Washington, DC. Available at http://www.nap.edu (accessed April 12, 2020 ).

Ansari MT , Tsertsvadze A , Moher D . 2009. Grading quality of evidence and strength of recommendations: a perspective. PLoS Med, 6:e1000151.

Qaseem A , Kansagara D , Lin JS , Mustafa RA , Wilt TJ , Clinical Guidelines Committee of the American College of Physicians . 2019. The Development of Clinical Guidelines and Guidance Statements by the Clinical Guidelines Committee of the American College of Physicians: update of methods. Ann Intern Med, 170:863–870.

Sawka AM , Carty SE , Haugen BR , Hennessey JV , Kopp PA , Pearce EN , Sosa JA , Tufano RP , Jonklaas J . 2018. American Thyroid Association guidelines and statements: past, present, and future. Thyroid, 28:692–706.

Guyatt G , Agoritsas T , Lytvyn L , Siemieniuk R , Vandvik P . 2019. BMJ rapid recommendations: creating tools to support a revolution in clinical practice guideline adoption. Canad J Gen Intern Med, 14:6–12.

Tricoci P , Allen JM , Kramer JM , Califf RM , Smith SC . 2009. Scientific evidence underlying the ACC/AHA clinical practice guidelines. JAMA, 301:831–841.

Brito JP , Domecq JP , Murad MH , Guyatt GH , Montori VM . 2013. The Endocrine Society guidelines: when the confidence cart goes before the evidence horse. J Clin Endocrinol Metab, 98:3246–3252.

Alexander PE , Gionfriddo MR , Li SA , Bero L , Stoltzfus RJ , Neumann I , Brito JP , Djulbegovic B , Montori VM , Norris SL , Schünemann HJ , Thabane L , Guyatt GH . 2016. A number of factors explain why WHO guideline developers make strong recommendations inconsistent with GRADE guidance. J Clin Epidemiol, 70:111–122.

Alexander PE , Bero L , Montori VM , Brito JP , Stoltzfus R , Djulbegovic B , Neumann I , Rave S , Guyatt G . 2014. World Health Organization recommendations are often strong based on low confidence in effect estimates. J Clin Epidemiol, 67:629–634.

Agoritsas T , Merglen A , Heen AF , Kristiansen A , Neumann I , Brito JP , Brignardello-Petersen R , Alexander PE , Rind DM , Vandvik PO , Guyatt GH . 2017. UpToDate adherence to GRADE criteria for strong recommendations: an analytical survey. BMJ Open, 7:e018593.

Agoritsas T , Neumann I , Mendoza C , Guyatt GH . 2017. Guideline conflict of interest management and methodology heavily impacts on the strength of recommendations: comparison between two iterations of the American College of Chest Physicians Antithrombotic Guidelines. J Clin Epidemiol, 81:141–143.

Meyer C , Bowers A , Wayant C , Checketts J , Scott J , Musuvathy S , Vassar M . 2018. Scientific evidence underlying the American College of Gastroenterology's clinical practice guidelines. PLoS One, 13:e0204720.

Schumacher RC , Nguyen OK , Makam AN . 2019. Evidence-based medicine and the American Thoracic Society guidelines-reply. JAMA Intern Med, 179:1004–1005.

Schumacher RC , Nguyen OK , Deshpande K , Makam AN . 2019. Evidence-based medicine and the American Thoracic Society Clinical Practice Guidelines. JAMA Intern Med, 179:584–586.

Bautista-Orduno KG , Dorsey-Trevino EG , Gonzalez-Gonzalez JG , Castillo-Gonzalez DA , Garcia-Leal M , Raygoza-Cortez K , Gionfriddo MR , Rodriguez-Gutierrez R . 2020. American Thyroid Association Guidelines are Inconsistent with GRADE—A meta-epidemiological study. J Clin Epidemiol, 123:180–188.e2.

Rabi DM , Kunneman M , Montori VM . 2020. When guidelines recommend shared decision-making. JAMA, 323:1345–1346.

Smallridge RC , Ain KB , Asa SL , Bible KC , Brierley JD , Burman KD , Kebebew E , Lee NY , Nikiforov YE , Rosenthal MS , Shah MH , Shaha AR , Tuttle RM . 2012. American Thyroid Association guidelines for management of patients with anaplastic thyroid cancer. Thyroid, 22:1104–1139.

Jonklaas J , Bianco AC , Bauer AJ , Burman KD , Cappola AR , Celi FS , Cooper DS , Kim BW , Peeters RP , Rosenthal MS , Sawka AM . 2014. Guidelines for the treatment of hypothyroidism: prepared by the American Thyroid Association Task Force on thyroid hormone replacement. Thyroid, 24:1670–1751.

Alexander EK , Pearce EN , Brent GA , Brown RS , Chen H , Dosiou C , Grobman WA , Laurberg P , Lazarus JH , Mandel SJ , Peeters RP , Sullivan S . 2017. Guidelines of the American Thyroid Association for the diagnosis and management of thyroid disease during pregnancy and the postpartum. Thyroid, 27:315–389.

Haugen BR , Alexander EK , Bible KC , Doherty GM , Mandel SJ , Nikiforov YE , Pacini F , Randolph GW , Sawka AM , Schlumberger M , Schuff KG , Sherman SI , Sosa JA , Steward DL , Tuttle RM , Wartofsky L . 2016. 2015 American Thyroid Association Management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association guidelines task force on thyroid nodules and differentiated thyroid cancer. Thyroid, 26:1–133.

Ross DS , Burch HB , Cooper DS , Greenlee MC , Laurberg P , Maia AL , Rivkees SA , Samuels M , Sosa JA , Stan MN , Walter MA . 2016. American Thyroid Association guidelines for diagnosis and management of hyperthyroidism and other causes of thyrotoxicosis. Thyroid, 26:1343–1421.

Guyatt GH , Alonso-Coello P , Schünemann HJ , Djulbegovic B , Nothacker M , Lange S , Murad MH , Akl EA . 2016. Guideline panels should seldom make good practice statements: guidance from the GRADE Working Group. J Clin Epidemiol, 80:3–7.

Castillo-Gonzalez DA , Dorsey-Trevino EG , Gonzalez-Gonzalez JG , Garcia-Leal M , Bautista-Orduño KG , Raygoza K , Gionfriddo MR , Ospina NMS , Rodriguez-Gutierrez R . 2020. A deeper analysis in thyroid research: a meta-epidemiological study of the American Thyroid Association clinical guidelines. PLoS One, 15:e0234297.

Sinclair D , Isba R , Kredo T , Zani B , Smith H , Garner P . 2013. World Health Organization guideline development: an evaluation. PLoS One, 8:e63715.

Barbui C , Dua T , van Ommeren M , Yasamy MT , Fleischmann A , Clark N , Thornicroft G , Hill S , Saxena S . 2010. Challenges in developing evidence-based recommendations using the GRADE approach: the case of mental, neurological, and substance use disorders. PLoS Med, 7:e1000322.

Gärtner FR , Portielje JE , Langendam M , Hairwassers D , Agoritsas T , Gijsen B , Liefers GJ , Pieterse AH , Stiggelbout AM . 2019. Role of patient preferences in clinical practice guidelines: a multiple methods study using guidelines from oncology as a case. BMJ Open, 9:e032483.

Kumar A , Miladinovic B , Guyatt GH , Schünemann HJ , Djulbegovic B . 2016. GRADE guidelines system is reproducible when instructions are clearly operationalized even among the guidelines panel members with limited experience with GRADE. J Clin Epidemiol, 75:115–118.

Luster M , Aktolun C , Amendoeira I , Barczyński M , Bible KC , Duntas LH , Elisei R , Handkiewicz-Junak D , Hoffmann M , Jarząb B , Leenhardt L , Musholt TJ , Newbold K , Nixon IJ , Smit J , Sobrinho-Simões M , Sosa JA , Tuttle RM , Verburg FA , Wartofsky L , Führer D . 2019. European Perspective on 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: Proceedings of an Interactive International Symposium. Thyroid, 29:7–26.

Tuttle RM , Ahuja S , Avram AM , Bernet VJ , Bourguet P , Daniels GH , Dillehay G , Draganescu C , Flux G , Führer D , Giovanella L , Greenspan B , Luster M , Muylle K , Smit JWA , Van Nostrand D , Verburg FA , Hegedüs L . 2019. Controversies, consensus, and collaboration in the use of ¹³¹I therapy in differentiated thyroid cancer: a joint statement from the American Thyroid Association, the European Association of Nuclear Medicine, the Society of Nuclear Medicine and Molecular Imaging, and the European Thyroid Association. Thyroid, 29:461–470.

Mercuri M , Gafni A . 2018. The evolution of GRADE (part 3): a framework built on science or faith?. J Eval Clin Pract, 24:1223–1231.

Mercuri M , Gafni A . 2018. The evolution of GRADE (part 2): still searching for a theoretical and/or empirical basis for the GRADE framework. J Eval Clin Pract, 24:1211–1222.

Mercuri M , Gafni A . 2018. The evolution of GRADE (part 1): is there a theoretical and/or empirical basis for the GRADE framework?. J Eval Clin Pract, 24:1203–1210.