The validation stage is often neglected in a simulation project, due to the high level of knowledge which is necessary. In this paper, the expert system approach is proposed to assist the simulation user in selecting an appropriate validation method, application of this method in the appropriate way, and interpreting the results. The main objective of such a system is to regroup validation techniques, scattered in literature, into the same knowledge base, and then to complete it with knowledge in statistics, simulation, and validation techniques, coming from experts. This study is part of a more general study on an Intelligent Environment for Simulation. Due to the difficulty in designing such a validation expert system, the application domain is restricted to the validation of observable discrete systems (particularly manufacturing systems), and to methods based on statistical tests. The functions of the expert system and the chosen knowledge representation are outlined and a prototype developed using K.E.S. software, is introduced. A brief example is given which illustrates the system capabilities. Finally the conclusion states that the expert system approach is adapted, due to restrictions which were imposed.
Anguenot, Fauchon, Gay, Herbin, and Jay.1982. "Statistiques de l'Ingénieur, Tests statistiques, Régression linéaire." Technical report, INSA Computer Science Dept, Lyon, France.
2.
Bald, O. and R.G. Sargent.1981. "A Methodology for Cost-Risk Analysis in the Statistical Validation of Simulation Models". Communications of the ACM24, no 11 (April): 190-197.
3.
Balci, O. and R.G. Sargent.1984. "A Bibliography on the Credibility Assessment and Validation of Simulation and Mathematical Models", Simuletter15, no 3: 15-27.
4.
Balmer, D.W.1985. "An intelligent environment for simulation", Abstract in Seventh European Congress on O.R. EURO VII, (Bologna, Italy, June): 82.
5.
Chambers, J.M., D. Pregibon and E. Zayas.1981. "Expert software for Data Analysis: an initial experiment", In Proceedings of the 43rd Session ISI, (Buenos Aires, Argentina).
6.
Chowdhury, S.I.1987. "State of the art in Statistical Expert Systems". In Proceedings of the Seventh International Workshop on Expert Systems and their Applications, (Avignon, France, April): 1095-1113.
7.
Chowdhury, S.I.1988. "Statistical Expert Systems -A special Application area for Knowledge-based Computer Methodology." Ph.D. thesis, Linköping University, Sweden.
8.
Dambroise, E. and P. Massotte.1987. "Résolution du problème du Choix des Méthodes Statistiques: l'approche de MUSE", In Proceedings of the Seventh International Workshop on Expert Systems and their Applications, (Avignon, France, April): 1115-1131.
9.
Demonchaux, E., J. Quinqueton and H. Ralambondrainy .1985. "CLAVECIN: un système expert en Analyse de Données", Research Report, n°431, INRIA Rocquancourt , Le Chesnay, France.
10.
Findler, N.V. and N.M. Mazur.1987. "On the Automatic Verification and Validation of discrete-event Simulation Models", College of Engineering & Applied Sciences, Arizona State University, (September).
11.
Fox, M.S., N. Hussein, Mc M. Roberts, and Y.V.R. Reddy.1988. "K. B. Simulation, An Artificial Intelligence approach to System Modeling and Automating the Simulation life cycle", Technical Report N° CMU-RI-TR-88-5, Carnegie-Mellon University, The Robotics Institute, Pittsburg, Pennsylvania.
12.
Gale, W.A. and D. Pregibon.1984. "REX: an expert system for Regression Analysis", In Proceedings of COMPSTAT 84, (Prague, Czechoslovakia).
13.
Gale, W.A. and Pregibon D.1986. "STUDENT: Phase 1-A report on Work in Progress", Artificial Intelligence and Statistics, Addison-Wesley publishing company.
14.
Gonzalez, P., and G. Hatabian.1987. "ADELLE ou une Aide au Dépouillement d'Enquêtes par logiciel Expert sur Micro Calculateur", In Proceedings of the Journées Symbolique-Numérique pour l'apprentissage de Connaissances à partir de données, (Paris, France, December), Lise Ceremade Eds: 281-287.
15.
Greig, I.D.1979. "Validation, Statistical Testing and the Decision to Model ", SIMULATION, 33, no 2 (August): 55-60.
16.
Hand, D.J.1984. "Statistical Expert System: Necessary Attributes", Journal of Applied Statistics, 12, no 1.
17.
Kendall, M.G. and A. Stuart.1963,1967, 1968. The Advanced Theory of Statistics, 2th edition, Vol 1, 2,3. Charles Griffin and Co., London , United Kingdom.
Kleijnen, J.P.C.1974. Statistical Techniques in Simulation, Part I and 2, Marcel Dekker Inc., New York.
20.
Landry, M.1985. "La validation des Modèles en Recherche Operationnelle ", AFCET/INTERFACES, no 31 (May): 9-20.
21.
Law, A.M. and W.D. Kelton.1982. Simulation Modeling and Analysis, McGraw-Hill, New York.
22.
Malvache, P. and S. Reissian.1986. "ADONIA: un Système Expert d'aide à la Conduite d'Analyses de Données", In Proceedings of the Sixth International Workshop on Expert Systems and their Applications , (Avignon, France, April): 1447-1465.
23.
O'Keefe, R.M.1986. "Simulation and Expert Systems: a Taxonomy and some Examples ". SIMULATION, 46, no 1 (January): 10-16.
24.
O'Keefe, R.M. and O. Balci.1987. "Validating Expert System Performance ", IEEE Expert, IEEE Computer Society (Winter), Yorktown Heights, N.Y., 81-89.
25.
Ören, T.I.1981. "Concepts and Criteria to assess Acceptability of Simulation studies: A Frame of Reference". Communications of the ACM24, no 4 (April): 180-189.
26.
Pierreval, H. and V. Deslandres.1988. "Vers un Systeme Expert d'Aide à la Validation Statistique des Modèles de Simulation Discontinue", In Proceedings of the International Conference on Productique et Robotique, Les Apports de I'Intelligence Artificielle, (Bordeaux, France, March): 131-137.
27.
Pierreval, H., M. Rakotomalala and A. Dussauchoy.1990. "Integration of Statistical Methods in a Knowledge-based Environment for Assisting Discrete Simulation", to appear in the Proceedings of the Twelfth Triennal Conference on Operation Research, IFORS'90, (Athens, Greece, June).
28.
Reddy, R.1987. "Epistemology of knowledge based simulation", SIMULATION, 48, no 4 (April): 162-166.
29.
Reynolds, M.R. and M.L. Deaton.1982. "Comparisons of some tests for validation of stochastic simulation models", Communications of Statististical Simulation Computation11, no 6: 769-799.
30.
Sargent, R.G.1984. "A Tutorial on Verification and Validation of Simulation Models". In Proceedings of the Winter Simulation Conference (S. Sheppard, U. Pooch and D. Pegden eds.): 115-121.
31.
Sargent, R.G.1986. "An Exploration of the Possibilities for Expert Aids in Model Validation", In Modeling and Simulation Methodology in the Artificial Intelligence ERA,(M.S. Elzas , T.I. Ören, and B.P. Zeigler, eds.): 279-297.
32.
Schruben, L.W.1980. "Establishing the Credibility of Simulations", SIMULATION, 34, no 3 (March): 101-105.
33.
Scs1987. "Catalog of simulation software", SIMULATION, 49, no 4 (October): 165-181.
34.
Taylor, R.P. and Hurrion R.D.1988a. "Supports Environments for Discrete Event Simulation Experimentation", In Proceedings of the Second European Multiconference Simulation Congress, (Nice, France, June).
35.
Taylor, R.P. and R.D. Hurrion.1988b. "An expert for simulation experimental design and analysis". Artificial Intelligence and simulation: The diversity of applications (T. Henson Ed.), The Society for Computer Simulation, La Jolla, CA, USA. p 238-244.
36.
Van Horn, R.L.1971. "Validation of simulation results", Management Science, vol. 17, no °5.
37.
Wiederhold, G.1984. "RX: knowledge and Database Management, IEEE Software, (January).
Yfantis, E.A. and R. Bronson.1987. '"Tests for validating Time Series Models ", Transactions of the Society for Computer Simulation, Vol. 4, No. 1 (January): 77-96.
