The Principles of Weight of Evidence Validation of Test Methods and Testing Strategies

ECVAM (1994). ECVAM News & Views. ATLA 22, 7–11.

Weed D.L. (2005). Weight of evidence: A review of concept and methods. Risk Analysis 25, 1545–1557.

Frazier J.M. (1990). Scientific Criteria for Validation of In Vitro Toxicity Tests. OECD Environment Monographs No. 36, 62 pp. Paris, France: OECD.

Balls M. , Blaauboer B. , Brusick D. , Frazier J. , Lamb D. , Pemberton M. , Reinhardt C. , Roberfroid M. , Rosenkranz H. , Schmid B. , Spielmann H. , Stammati A-L. , & Walum E. (1990). The report and recommendations of the CAAT/ERGATT workshop on the validation of toxicity test procedures. ATLA 18, 313–337

Balls M. , Blaauboer B.J. , Fentem J.H. , Bruner L. , Combes R.D. , Ekwall B. , Fielder R.J. , Guillouzo A. , Lewis R.W. , Lovell D.P. , Reinhardt C.A. , Repetto G. , Sladowski D. , Spielmann H. , & Zucco F. (1995). Practical aspects of the validation of toxicity test procedures. The report and recommendations of ECVAM workshop 5. ATLA 23, 129–147.

Balls M. , & Karcher W. (1995). The validation of alternative test methods. ATLA 23, 884–886.

ICCVAM (1997). Validation and Regulatory Acceptance of Toxicological Test Methods: A Report of the ad hoc Interagency Coordinating Committee on the Validation of Alternative Methods. NIH Publication No: 97–3981, 105 pp. Research Triangle Park, NC, USA: National Institute of Environmental Health Sciences, (NIEHS). Website http://iccvam.niehs.nih.gov/docs/guidelines/validate.pdf

OECD (1996). Report of the OECD Workshop on Harmonisation of Validation and Acceptance Criteria for Alternative Toxicological Test Methods. ENV/MC/CHEM(96)9, 60 pp. Paris, France: OECD.

Hartung T. , Bremer S. , Casati S. , Coecke S. , Corvi R. , Fortaner S. , Gribaldo L. , Halder M. , Hoffmann S. , Janusch Roi A. , Prieto P. , Sabbioni E. , Scott L. , Worth A. , & Zuang V. (2004). A modular approach to the ECVAM principles on test validity. ATLA 32, 467–472.

Stokes W. , Schechtman L. , & Hill R. (2002). The Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM): A Review of the ICCVAM Test Method Evaluation Process and International Collaborations with the European Centre for the Validation of Alternative Methods (ECVAM). ATLA 30, Suppl. 2, 23–32.

Schechtman L.M. , Wind M.L. , & Stokes W.S. (2006). Streamlining the validation process: The ICCVAM nomination and submission process and guidelines for new, revised and alternative test methods. ALTEX 22, Special Issue, 337–342.

OECD (2005). Guidance Document on the Validation and International Acceptance of New or Updated Test Methods for Hazard Assessment. OECD Series on Testing and Assessment No. 34, ENV/JM/MONO (2005)14, 96 pp. Paris, France: OECD. Website http://appli1.oecd.org/olis/2005doc.nsf/linkto/env-jm-mono (2005)14

Balls M. , & Combes R. (2006). Validation via weight-of-evidence approaches. ALTEX 22, Special Issue, 288–291.

Horvath A.R. , & Pewsner D. (2004). Systematic reviews in laboratory medicine: principles, processes and practical considerations. Clinica Chimica Acta 342, 23–39.

Teagarden J.R. (1989). Meta-analysis: whither narrative review? Pharmacotherapy 9, 274–284.

Katrak P. , Bialocerkowski A. , Massy-Westropp N. , Kumar V.S. , & Grimmer K. (2004). A systematic review of the content of critical appraisal tools. BMC Medical Research Methodology 4, 22.

Egger M. , & Smith D.G. (1997). Meta-analysis: Potentials and promise. British Medical Journal 315, 1371–1374.

Egger M. , Smith G.D. , & Phillips A.N. (1997). Meta-analysis: Principles and procedures. British Medical Journal 315, 1533–1537.

Hoffmann S. , & Hartung T. (2005). Diagnosis: toxic! — Trying to apply approaches of clinical diagnostics and prevalence in toxicology considerations. Toxicological Sciences 85, 422–428.

Irwig L. , Bossuyt P.M. , Glasziou P. , Gatsonis C. , & Lijmer J.G. (2002). Designing studies to ensure that estimates of test accuracy are transferable. British Medical Journal 324, 669–671.

Whiting P. , Rutjes A.W. , Reitsma J. , Bossuyt P.M. , & Kleijnen J. (2003). The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Medical Research Methodology 3, 25.

Whiting P. , Rutjes A.W. , Dinnes J. , Reitsma J.B. , Bossuyt P.M. , & Kleijnen J. (2005). A systematic review finds that diagnostic reviews fail to incorporate quality despite available tools. Journal of Clinical Epidemiology 58, 1–12.

Bossuyt P.M. , Reitsma J.B. , Bruns D.E. , Gatsonis C.A. , Glasziou P.P. , Irwig L.M. , Lijmer J.G. , Moher D. , Rennie D. , & de Vet H.C. ; standards for Reporting of Diagnostic Accuracy (2003). Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. British Medical Journal 326, 41–44.

Irwig L. , Macaskill P. , Glasziou P. , & Fahey M. (1995). Meta-analytic methods for diagnostic test accuracy. Journal of Clinical Epidemiology 48, 119–130.

Walter S.D. , Irwig L. , & Glasziou P. (1999). Meta-analysis of diagnostic tests with imperfect reference standards. Journal of Clinical Epidemiology 52, 943–951.

Guzelian P.S. , Victoroff M.S. , Halmes N.C. , Janes R.C. , & Guzelian C.P. (2005). Evidence-based toxicology: a comprehensive framework for causation. Human and Experimental Toxicology 24, 161–201.

Hoffmann S. , & Hartung T. (2006). Toward an evidence-based toxicology. Human and Experimental Toxicology 25, 497–513.

ICCVAM (2003). ICCVAM Guidelines for the Nomination and Submission of New, Revised, and Alternative Test Methods. NIH Publication No. 03-4508, 50 pp. Research Triangle Park, NC, USA: National Institute of Environmental Health Sciences (NIEHS). Website http://iccvam.niehs.nih.gov/docs/guidelines/subguide.htm

OECD (1998). OECD Series on Principles of Good Laboratory Practice and Compliance Monitoring. Paris, France: OECD. Website http://www.oecd.org/document/63/0,2340,en_2649_34381_2346175_1_1_1_1,00.html

OECD (Draft). OECD Principles for the Validation, for Regulatory Purposes, of (Quantitative) Structure-Activity Relationship Models. Paris, France: OECD. Website http://www.oecd.org/document/23/0,2340,en_2649_34799_33957015_1_1_1_1,00.html.

Corvi R. , Ahr H-J. , Albertini A. , Blakey D.H. , Clerici L. , Coecke S. , Douglas G.R. , Gribaldo L. , Groten J.P. , Haase B. , Hamernik K. , Hartung T. , Inoue T. , Indans I. , Maurici D. , Orphanides G. , Rembges D. , Sansone S-A. , Snape J.R. , Toda E. , Tong W. , van Delft J.H. , Weis B. , & Schechtman L.M. (2006). Meeting Report: Validation of Toxicogenomics-based Test Systems: ECVAM-ICCVAM/NICEATM Considerations for Regulatory Use. Report of the ECVAM-ICCVAM/NICEATM Toxicogenomics Workshop Report. Environmental Health Perspectives 114, 420–429. Website http://dx.doi.org/ by using the following doi code: 10.1289/ehp.8247

Balls M. , & Combes R. (2005). The need for a formal invalidation process for animal and non-animal tests. ATLA 33, 299–308.

ECVAM (1997). Statement on the scientific validity of the 3T3 NRU PT test (an in vitro test for photo-toxic potential). ATLA 26, 7–8.

ECVAM (1998). Statement on the application of the 3T3 NRU PT test to UV filter chemicals. ATLA 26, 385–386.

ECVAM (1998). Statement on the scientific validity of the rat skin transcutaneous electrical resistance (TER) test (an in vitro test for skin corrosivity). ATLA 26, 275–277.

ICCVAM (2002). ICCVAM Evaluation of EPISKIN™, EpiDerm™, (EPI-200), and Rat Skin Transcutaneous Electrical Resistance (TER): In Vitro Test Methods for Assessing Dermal Corrosivity Potential of Chemicals. NIH Publication No. 02-4502, Research Triangle Park, NC, USA: National Institute of Environmental Health Sciences (NIEHS). Website http://iccvam.niehs.nih.gov/methods/epiderm.htm

ICCVAM (2004). Recommended Performance Standards for In vitro Test Methods for Skin Corrosion, NIH Publication No. 04-4510, Research Triangle Park, NC, USA: National Institute of Environmental Health Sciences (NIEHS). Website http://iccvam.niehs.nih.gov/docs/docs.htm#invitro

ECVAM (1998). Statement on the scientific validity of the EPISKIN™ test (an in vitro test for skin corrosivity). ATLA 26, 277–288.

ECVAM (2000). Statement on the application of the EpiDerm™ human skin model for skin corrosivity testing. ATLA 28, 365–366.

ECVAM (2001). Statement on the application of the CORROSITEX® assay for skin corrosivity testing. ATLA 29, 96–97.

ICCVAM (1999). Corrositex®: An In vitro Test Method for Assessing Dermal Corrosivity Potential of Chemicals. NIH Publication No. 99-4495, Research Triangle Park, NC, USA: National Institute of Environmental Health Sciences (NIEHS). Website http://iccvam.niehs.nih.gov/docs/reports/corprrep.pdf

ECVAM (2000). Statement on the scientific validity of local lymph node assay for skin sensitisation testing. ATLA 28, 366–367.

ICCVAM (1999). The Murine Local Lymph Node Assay: A Test Method for Assessing the Allergic Contact Dermatitis Potential of Chemicals/Compounds. NIH Publication No. 99-4494, Research Triangle Park, NC, USA: National Institute of Environmental Health Sciences (NIEHS). Website http://iccvam.niehs.nih.gov/methods/llnadocs/llnarep.pdf

Sailstad D. , Hattan D. , Hill R. , & Stokes W. (2001). Evaluation of the murine local lymph node assay (LLNA) I: The ICCVAM review process. Regulatory Toxicology and Pharmacology 34, 258–273.

Dean J. , Twerdok L. , Tice R. , Sailstad D. , Hattan D. , & Stokes W. (2001). Evaluation of the murine local lymph node assay (LLNA) II: Conclusions and recommendations of an independent scientific peer review panel. Regulatory Toxicology and Pharmacology 34, 274–286.

Haneke K. , Tice R. , Carson B. , Margolin B. , & Stokes W. (2001). Evaluation of the murine local lymph node assay (LLNA): III. Data analyses completed by the national toxicology program (NTP) interagency center for the evaluation of alternative toxicological methods. Regulatory Toxicology and Pharmacology 34, 287–291.

ECVAM (2002). Statement on the scientific validity of the embryonic stem cell test (EST) — an in vitro test for embryotoxicity. ATLA 30, 265–268.

ECVAM (2002). Statement on the scientific validity of the postimplantation rat whole-embryo culture assay — an in vitro test for embryotoxicity. ATLA 30, 271–273.

ECVAM (2002). Statement on the scientific validity of the micromass test — an in vitro test for embryotoxicity. ATLA 30, 268–270.

ICCVAM (2006). ICCVAM Test Method Evaluation Report. In vitro Cytotoxicity Test Methods for Estimating Starting Doses for Acute Oral Systemic Toxicity Testing. Website http://iccvam.niehs.nih.gov/methods/BRDU_TMER/AcuteTxTMER_Total.pdf

ICCVAM (2001). Report of the International Workshop on In vitro Methods for Assessing Acute Systemic Toxicity: Results of an International Workshop Organized by the Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM) and the National Toxicology Program (NTP) Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM). NIH Publication No. 01-4499, Research Triangle Park, NC, USA: National Institute of Environmental Health Sciences (NIEHS). Website http://iccvam.niehs.nih.gov/methods/invidocs/finalall.pdf

ICCVAM (2001). Guidance Document on Using In Vitro Data to Estimate In Vivo Starting Doses for Acute Toxicity, Based on Recommendations from an International Workshop Organized by the Interagency Coordinating Committee on the Validation of Alternative Methods and the National Toxicology Program (NTP) Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM). NIH Publication No. 01-4500, Research Triangle Park, NC, USA: National Institute of Environmental Health Sciences (NIEHS). Website http://iccvam.niehs.nih.gov/methods/invitro.htm.

OECD (2004). Draft Proposal for a New Guideline 487: In Vitro Micronucleus Test. 13 pp. Paris, France: OECD. Website http://www.oecd.org/dataoecd/60/28/32106288.pdf

ICCVAM (2001). The Revised Up-and-Down Procedure: A Test Method for Determining the Acute Oral Toxicity of Chemicals, Volumes I and II. NIH Publication No. 02-4501, Research Triangle Park, NC, USA: National Institute of Environmental Health Sciences (NIEHS). Website http://iccvam.niehs.nih.gov/methods/udpdocs/udpfin/vol_1.pdf and http://iccvam.niehs.nih.gov/methods/udpdocs/udpfin/vol_2.pdf

OECD (Draft). Draft Guideline for the Testing of Chemicals — The Uterotrophic Bioassay in Rodents: A Short-term Screening Test for (Anti) oestrogenic Properties. 22 pp. Paris, France: OECD. Website http://www.oecd.org/dataoecd/26/53/37206177.pdf

OECD (2006). Final OECD Report on the Initial Work Towards the Validation of the Rat Hershberger Assay: Phase 1, Androgenic Response to Testosterone propionate, and Anti-androgenic Effects of Flutamide. OECD Environment, Health and Safety Publications. Series on Testing and Assessment No. 62, 209 pp. Paris, France: OECD. Website http://www.oecd.org/dataoecd/43/25/37468632.pdf

OECD (Draft). Draft OECD Guideline for the Testing of Chemicals: The Hershberger Bioassay in Rats. 17 pp. Paris, France: OECD. Website http://www.oecd.org/dataoecd/49/60/37478355.pdf

OECD (2006). Report of the Validation of the Updated Test Guideline 407 — Repeat Dose 28-day Oral Toxicity Study in Laboratory Rats. OECD Environment, Health and Safety Publications. Series on Testing and Assessment No. 59, 229 pp. Paris, France: OECD. Website http://www.oecd.org/dataoecd/56/24/37376909.pdf

ICCVAM (2003). ICCVAM Evaluation of In Vitro Test Methods for Detecting Potential Endocrine Disruptors: Estrogen and Androgen Receptor Binding and Transcriptional Activation Assays. NIH Publication No. 03-4503, Research Triangle Park, NC, USA: National Institute of Environmental Health Sciences (NIEHS). Website http://iccvam.niehs.nih.gov/methods/endodocs/edfinrpt/edfinrpt.pdf

OECD (2004). Draft Guidance Document on Reproductive Testing and Assessment. OECD Environment, Health and Safety Publications. Series on Testing and Assessment No. 43, 68 pp. Website http://www.oecd.org/dataoecd/38/46/34030071.pdf