Sage Journals: Discover world-class research

Abstract

In general, questions of model credibility introduce more problems in a generic model than they do in models developed for one specific application since a generic formulation must allow for many applications of the model. This paper addresses the issues of model testing, verification, and validation for a generic electro-optic sensor system model. A structural approach to testing, verification, and validation is proposed that builds increasing confidence through bottom-up testing, structured verification procedures, and carefully selected validation metrics. These metrics are based on a geometrical view of model outputs that may be compared with measurements using qualitative methods or quantitative approaches involving image processing, artificial neural networks, or fuzzy pattern recognition. The advantage over traditional validation methods is most marked in the case of complex models with many key quantities where it not only provides insight about the validity but also about sensitivities. These validation tools have been applied, in conjunction with more traditional metrics, to the testing, verification, and validation of the generic model configured as a thermal imager system.

Keywords

Electro-optic sensor system generic model simulation testing verification validation

Get full access to this article

View all access options for this article.

References

[1] Smith, M. I. , D. J. Murray-Smith , and D. Hickman . “Mathematical and Computer Modeling of Electro-Optic Systems Using a Generic Modeling Environment,” Journal of Defense Modeling and Simulation 4 (1, 2007).

[2] Murray-Smith, D. J.

“Methods for the External Validation of Continuous System Simulation Models: A Review,”

Mathematical and Computer Modeling of Dynamical Systems 4 (1, 1998) 5–31.

[3] Smith, M. I. “The Design, Verification and Validation of a Generic Electro-optic Sensor Model for System Performance Evaluation,” Ph.D. Thesis, Department of Electronics and Electrical Engineering, University of Glasgow, 1999.

[4] Smith, M. I. , D. Hickman , and D. J. Murray-Smith . “Test, Verification and Validation Issues in Modeling a Generic Electro-Optic System,” Proceedings of the SPIE Annual Symposium, San Diego. Washington: SPIE Press, 1998.

[5] Shakir, L. A.

“The Complementary Use of Man-in-the-Loop and Closed-Loop Air Combat Models in Weapon System Effectiveness Studies,”

Proceedings of the Second Test and Evaluation International Aerospace Forum, Royal Aeronautical Society, London, 1996.

[6] Pace, D.K. “Verifcation, Validation and Accreditation.” In Applied Modeling and Simulation: An Integrated Approach to Development and Operation, edited by D. J. Cloud and L. B. Rainey , 369–409. New York: McGraw-Hill, 1998.

[7] Kolence, K. and P. Kiviat . “Sofware Unit Profiles and Kiviat Figures, ACM SIGMETRICS,” Performance Evaluation Review 2 (3, 1973): 2–12.

[8] Tegarden, D. P.

“Business Information Visualization,”

Communications of the Association for Information Sciences 1 (Paper 4, 1999): 1–34. Available from: htp://cais.isworld.org/articles/1–4/default.asp?view=html&x=66&y=4

[9] Kamml, G. , H.-M. Voigt , and K. Neß . “Development of a Tool to Improve the Forecast Accuracy of Dynamic Simulation Models for the Paper Process.” In Cost Action E36, Modeling and Simulation in Pulp and Paper Industry, Proceedings of Model Validation Workshop, edited by J. Kappen and J. Manninen , VTT Symposium 238, October 6, 2005, VTT Research Centre of Finland, Espoo, Finland, 2005.

10.

[10] Rogers, S. K. , and M. Kabrisky . An Introduction to Biological and Artificial Neural Networks for Pattern Recognition. Washgington: SPIE Optical Engineering Press, 1991.

11.

[11] Sinha, D , and C. R. Giardina . “Discrete Black and White Object Recognition via Morphological Functions,” IEEE Trans. On Pattern Analysis and Machine Intelligence 12 (3, 1990): 275–293.

12.

[12] Ross, T. J. Fuzzy Logic with Engineering Applications. McGraw-Hill, 1995.

13.

[13] Anon. FLIR92 Thermal Imaging Systems Performance Model, US Army Night Vision and Sensors Directorate, Doc. RG009993, 1993.

Verification and Validation Issues in a Generic Model of Electro-Optic Sensor Systems

Abstract

Keywords

Get full access to this article

References