Inter-Rater Reliability in Traditional Chinese Medicine: Challenging Paradigmatic Assumptions

World Health Organization. International Statistical Classification of Diseases and Related Health Problems (11th Revision). 2018. Online document at: https://icd.who.int/browse11/l-m/en, accessed September 11, 2019 .

Vickers AJ , Vertosick EA , Lewith G , et al.; Acupuncture Trialists' Collaboration. Acupuncture for chronic pain: Update of an individual patient data meta-analysis. J Pain, 2018; 19:455–474.

Mann B , Burch E , Shakeshaft C . Attitudes toward acupuncture among pain fellowship directors. Pain Med, 2015; 17:494–500.

Gorski D . ICD-11: A triumph of the “integration” of quackery with real medicine. Science-Based Medicine. 2018. Online document at: https://sciencebasedmedicine.org/icd-11-a-triumph-of-the-integration-of-quackery-with-real-medicine, accessed August 29, 2019 .

Cook T , Campbell D . Quasi-Experimentation: Design and Analysis Issues for Field Settings. Chicago IL: Rand Mc Nally, 1979.

Chen RQ , Wong CM , Cao KJ , Lam TH . An evidence-based validation of traditional Chinese medicine syndromes. Complement Ther Med, 2010; 18:199–205.

Fu MC , Buerba RA , Long WD 3rd , et al. Interrater and intrarater agreements of magnetic resonance imaging findings in the lumbar spine: Significant variability across degenerative conditions. Spine J, 2014; 14:2442–2448.

Maldaner N , Stienen MN , Bijlenga P , et al. Interrater agreement in the radiologic characterization of ruptured intracranial aneurysms based on computed tomography angiography. World Neurosurg, 2017; 103:876.e1–882.e1.

Schnyer R , Conboy L , Jacobson E , et al. Development of a Chinese medicine assessment measure: An interdisciplinary approach using the Delphi method. J Altern Complement Med, 2005; 11:1005–1013.

Lobbestael J , Leurgans M , Arntz A . Inter-rater reliability of the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID I) and Axis II Disorders (SCID II). Clin Psychol Psychother, 2011; 18:75–79.

Dreessen L , Arntz AA . Short-interval test-retest interrater reliability of the Structured Clinical Interview for DSM-III-R Personality Disorders (SCID-II) in outpatients. J Pers Disord, 1998; 2:138–148.

Wakefield JC . Diagnostic issues and controversies in DSM-5: Return of the false positives problem. Annu Rev Clin Psychol, 2016; 12:105–132.

Madhoo M , Levine SZ . Network analysis of the Quick Inventory of Depressive Symptomatology: Reanalysis of the STAR*D clinical trial. Eur Neuropsychopharmacol, 2016; 26:1768–1774.

Koithan M , Bell IR , Niemeyer K , Pincus D . A complex systems science perspective for whole systems of complementary and alternative medicine research. Complement Med Res, 2012; 19(Suppl 1):7–14.

Schnyer RN , Allen JJ . Bridging the gap in complementary and alternative medicine research: Manualization as a means of promoting standardization and flexibility of treatment in clinical trials of acupuncture. J Altern Complement Med, 2002; 8:623–634.

Spitzer RL , Williams JB , Gibbon M , First MB . The Structured Clinical Interview for DSM-III-R (SCID). I: History, rationale, and description. Arch Gen Psychiatry, 1992; 49:624–629.

Shugen W . Framework of pattern recognition model based on the cognitive psychology. Geo Spat Inform Sci, 2002; 5:74–78.

Allsopp K , Read J , Corcoran R , Kinderman P . Heterogeneity in psychiatric diagnostic classification. Psychiatry Res, 2019; 279:15–22.

Boes AD , Prasad S , Liu H , et al. Network localization of neurological symptoms from focal brain lesions. Brain, 2015; 138:3061–3075.

Hui KK , Pritzker S . Terminology standardization in Chinese medicine: The perspective from UCLA Center for East-West medicine. Chin J Integr Med, 2007; 13:64–66.

Kottner J , Audigé L , Brorson S , et al. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Int J Nurs Stud, 2011; 48:661–671.

Cassidy CM . Chinese medicine users in the United States part II: Preferred aspects of care. J Altern Complement Med, 1998; 4:189–202.

Paterson C , Britten N . The patient's experience of holistic care: Insights from acupuncture research. Chronic Illn, 2008; 4:264–277.

MacPherson H , Hammerschlag R , Coeytaux RR , et al. Unanticipated insights into biomedicine from the study of acupuncture. J Altern Complement Med, 2016; 22:101–107.

Vickers A , Goyal N , Harland R , Rees R . Do certain countries produce only positive results? A systematic review of controlled trials. Control Clin Trials, 1998; 19:159–166.

Liu B , Zhou X , Wang Y , et al. Data processing and analysis in real-world traditional Chinese medicine clinical data: Challenges and approaches. Stat Med, 2012; 31:653–660.

Liu J , Zhai X , Han A , et al. The future development of traditional Chinese medicine from the perspective of artificial intelligence with Big Data. In: 2018 IEEE 4th International Conference on Big Data Security on Cloud (BigDataSecurity), IEEE International Conference on High Performance and Smart Computing (HPSC), and IEEE International Conference on Intelligent Data and Security (IDS). Omaha, NE: IEEE; 2018, 204–209.

Tuijn S , Janssens F , Robben P , van den Bergh H . Reducing interrater variability and improving health care: A meta-analytical review. J Eval Clin Pract, 2012; 18:887–895.

Lee MS , Lee JA , Alraek T , et al. Current research and future directions in pattern identification: Results of an international symposium. Chin J Integr Med, 2016; 22:947–955.

Zhou X , Chen S , Liu B , et al. Development of traditional Chinese medicine clinical data warehouse for medical knowledge discovery and decision support. Artif Intell Med, 2010; 48:139–152.

Fava GA , Tomba E , Sonino N . Clinimetrics: The science of clinical measurements. Int J Clin Pract, 2012; 66:11–15.

Vickers AJ , Cronin AM , Maschino AC , et al.; Acupuncture Trialists' Collaboration. Acupuncture for chronic pain: Individual patient data meta-analysis. Arch Intern Med, 2012; 172:1444–1453.

MacPherson H , Altman DG , Hammerschlag R , et al. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): Extending the CONSORT statement. PLoS Med, 2010; 7:e1000261.