We describe verification, validation, and accreditation (VV&A) activities as components of risk assessment and risk mitigation in the defense systems acquisition process. We review risk assessment methodologies, application of those methodologies to models and simulations (M&S), and how this application relates to the overall risk mitigation process for the systems acquisition process.
1. U.S. Department of Defense. DoD Modeling and Simulation (M&S) Management. DoD Directive 5000.59. (Administrative Change 1 to the original document dated Jan 4, 1994). January 20, 1998.
2.
2. U.S. Department of Defense. Operation of the Defense Acquisition System. DoD Instruction 5000.2. May 12, 2003.
3.
3. U.S. Department of Defense. DoD Modeling and Simulation (M&S) Verification, Validation, and Accreditation (VV&A). DoD Instruction 5000.61. May 13, 2003.
4.
4. U.S. Air Force. Operations Support: Verification, Validation and Accreditation (VV&A). Air Force Instruction AFI 16–1001. June 1, 1996.
5.
5. U.S. Army. Management of Army Models and Simulations. Department of the Army Regulation AR 5–11. February 1, 2005.
6.
6. U.S. Army. Verification, Validation and Accreditation of Army Models and Simulations. Department of the Army Pamphlet PAM 5–11. September 30, 1999.
7.
7. U.S. Navy. Verification, Validation and Accreditation (VV&A) of Models and Simulations. Secretary of the Navy Instruction SECNAVINST 5200.40. April 19, 1999.
8.
8. Department of Navy. Modeling and Simulation Verification Validation and Accreditation Implementation Handbook, Volume I: VV&A Framework. March 30, 2004.
9.
9. U.S. Navy. Verification, Validation and Accreditation (VV&A) of Models and Simulations. Secretary of the Navy Draft Instruction SECNAVINST 5200.40A (in coordination). January 20, 2005.
10.
10. Verification, Validation and Accreditation of Joint Models and Simulations. Joint Staff Instruction JSI 8104.01A, January 26, 2004.
11.
11. Defense Modeling and Simulation Office (DMSO). Accreditation Agent Role in the VV&A of Legacy Simulations. DMSO VV&A Recommended Practices Guide Core Document. August 4, 2004. (online at vva.dmso.mil)
12.
12. Defense Modeling and Simulation Office (DMSO). Risk and Its Impact on VV&A. DMSO VV&A Recommended Practices Guide Special Topic Paper, November 30, 2000. (online at vva.dmso.mil)
13.
13. Ropeik, David, and George Gray. Risk: A Practical Guide for Deciding What's Really Safe and What's Really Dangerous in the World Around You. Harvard Center for Risk Analysis, Harvard School of Public Health. Houghton Mifflin. 2002.
14.
14. U.S. Department of Defense. Standard Practice for Systems Safety. Military Standard MIL-STD-882D. February 10, 2000.
15.
15. U.S. Department of Defense. System Safety Program Requirements. Military Standard MIL-STD-882C. January 19, 1993.
16.
16. Kilikauskas, Michelle, and David H. Hall, et al. “Estimating V&V Resource Requirements and Schedule Impact.” In Proceedings of the Foundations for VV&A in the 21st Century Workshop (Foundations ′02). 2002.
17.
17. Joint Accreditation Support Activity. Risk Assessment Example. January 2004.
18.
18. U.S. Army. Army Materiel Systems Analysis Activity Combat Evaluation Division, Infantry Branch. AMSAA Risk Assessment Primer. Special Publication No. 71. May 1995.
19.
19. U.S. Army. Risk Management. Army Field Manual FM 100–14. April 23, 1998.
20.
20. Mugridge, Chris.Verification, Validation and Accreditation of Models and Simulations Used for Test and Evaluation: A Risk/Benefit Based Approach. Defence Evaluation and Research Agency, U.K.March 1999.
21.
21. Brade, Dirk. “A Generalized Process for the Verification and Validation of Models and Simulation Results.” Ph.D. diss., Universität der Bundeswehr, München. October 2003.
22.
22. Kilikauskas, Michelle and David H. Hall. “The Use of M&S VV&A as a Risk Mitigation Strategy in Defense Acquisition.” In Proceedings of Foundations ′04: A Workshop for VV&A in the 21st Century. 2004.
