Live, virtual, and constructive (LVC) simulation technologies are well-established in the areas of technology demonstration, mission rehearsal, and exercises. A promising new role for LVC simulation technology is to facilitate weapon systems testing by producing defendable results. Requirements to test new defense systems within a system-of-systems context and within joint force scenarios have placed demands on physical test ranges that are not likely to be met. The LVC testing option promises the breadth and depth of defense systems, either as real or simulated assets, to potentially meet the new test demands. However, leveraging this technology to support testing will require a shift in the approaches used by the LVC community. In this paper, we discuss the challenges facing the LVC testing initiative, both from an experimental and from an architectural and implementation standpoint.
ParkerEPMinerNEvan LeeuwenBP. Testing unmanned autonomous system communications in a live/virtual/constructive environment. ITEA J2009; 30: 513–522.
2.
US Department of Defense. Department of Defense modeling and simulation (M&S) glossary. DoD 5000.59-M, 1998.
3.
HodsonDDBaldwinRO. Characterizing, measuring, and validating the temporal consistency of live-virtual-constructive environments. Simulation2009; 85: 671–682.
MilgramPTakemuraHUtsumiA. Augmented reality: a class of displays on the reality–virtuality continuum. Proc SPIE Int Soc Opt Eng1995; 2351: 282–292.
6.
BowleyDComeauPEdwardsR. Guide for understanding and implementing defense experimentation (GUIDEx) – version 1.1. The Technical Cooperation Program (TTCP), 2006.
7.
ColemanREMontgomeryDC. A systematic approach for planning a designed industrial experiment. Technometrics1993; 35: 1–27.
8.
GohTN. A pragmatic approach to experimental design in industry. J Appl Stat2001; 3: 391–398.
9.
FoulkesJB. Realizing jointness through early testing of systems in a distributed live-virtual-constructive environment. ITEA J2009; 30: 191–192.
10.
HaaseCLHillRRHodsonD. Using statistical experimental design to realize LVC potential in T&E. ITEA J2011; 32: 288–297.
11.
SteinbergDMHunterWG. Experimental design: review and comment. Technometrics1984; 26: 71–97.
12.
CortesLADuffEBergstromD. A primer on design of experiments for US Navy T&E managers. Technical report, Naval Sea Systems Command, 2011.
13.
JohnsonRTHuttoGTSimpsonJR. Designed experiments for the defense community. Qual Eng2012; 24: 60–79.
14.
HahnGJ. Some things engineers should know about experimental design. J Qual Technol1977; 9: 13–20.
RobinsonS. Conceptual modelling for simulation. Part I: definition and requirements. J Oper Res Soc2008; 59: 278–290.
17.
IEEE 1730–2010. Recommended practice for distributed simulation engineering and execution process (DSEEP).
18.
TolkA. Engineering principles of combat modeling and distributed simulation. Addison Wesley, 2012.
19.
GeraciA. IEEE standard computer dictionary: compilation of IEEE standard computer glossaries. Piscataway, NJ: IEEE Press, 1990.
20.
HarkriderSLuncefordWH. Modeling and simulation composability. In: Interservice/industry training, simulation and education conference (I/ITSEC), 1999.
21.
TolkA. Interoperability and composability. In: SokolowskiJABanksCM (eds) Modeling and simulation fundamentals: theoretical underpinnings and practical domains. Wiley, 2010, pp.403–433.
22.
PageEHBriggsRTufaroloJA. Toward a family of maturity models for the simulation interconnection problem. In: Proceedings of the simulation interoperability workshop, Spring2004.
23.
PrattDRRagusaCvon der LippeS. Composability as an architecture driver. In: Interservice/industry training, simulation and education conference (I/ITSEC), 1999.
24.
HodsonDDGehlDPBaldwinRO. Building distributed simulations utilizing the EAAGLES framework. In Interservice/industry training, simulation and education conference (I/ITSEC), 2006.
25.
RaoDMHodsonDDStiegerJM. Design & implementation of virtual and constructive simulations using OpenEaagles. Linus Publications, 2009.
26.
SteedAFradinho OliveiraM. Networkd graphics – building networked games and virtual environments. Elsevier, 2010.
27.
IEEE 1278.1–2012. Draft standard for distributed interactive simulation (DIS) – application protocols.
28.
IEEE 1516–2000. Standard for modeling and simulation high level architecture (HLA) – framework and rules.
29.
DoD Foundation Initiative 2010. The test and training enabling architecture – architecture reference document. US Department of Defense, 2002.
30.
HenningerAECuttsDLoperM. Live virtual constructive architecture roadmap (LVCAR) final report. Technical report, Institute for Defense Analyses, September2008.
31.
SinghalSZydaM. Networked virtual environments: design and implementation. Addison Wesley, 1999.
32.
IEEE 1278.2–1995. Standard for distributed interactive simulation (DIS) – communication services and profiles.
33.
GrayF. Experimental designs for development tests in distributed joint environments. In: Proceedings of the 2007 Air Force T&E Days, 2007.
