This paper presents a massively parallel, cloud-computing framework for the ad hoc evaluation of discrete-event simulation (DES) models to enable broad exploration of the design space for model parameters. Parallel evaluation is enabled through use of a serverless computing environment allowing thousands of simultaneous experiments, on demand, without the need to explicitly provision or manages hardware. A standard Simulation Evaluation application programming interface (API) was designed for evaluating simulation functions that enables language independence between client application and simulation model, encouraging reuse of simulation models for multiple purposes (what-if analysis, ranking and selection, sensitivity analysis, or optimization). Extensions to the Java Simulation Library (JSL)27 enable rapid deployment of models built with the JSL as parameterized serverless functions implementing the Simulation Evaluation API. New Java packages facilitate the calling of any serverless functions that implement the Simulation Evaluation API.
SangJLeeCRRegoV, et al. Experiences with implementing parallel discrete-event simulation on GPU. J Supercomput2019; 75: 4132–4149.
5.
NutaroJOzmenO. Race conditions and data partitioning: risks posed by common error to reproducible parallel simulation. Simulation2023; 99: 417–427.
6.
LitzkowMLivnyM. Experience with the Condor distributed batch system. In: IEEE workshop on experimental distributed systems, Huntsville, AL, USA, 11–12 October 1990, pp. 97–101. New York: IEEE.
7.
ThainDTannenbaumTLivnyM. Distributed computing in practice: the Condor experience. Concur Comput Pract Exper2005; 17: 323–356.
8.
BockelmanBLivnyMLinB, et al. Principles, technologies, and time: the translational journey of the HTCondor-CE. J Comput Sci2021; 52: 101213.
9.
SravanthiGGraceBKamakshammaV. A review of high performance computing. IOSRJCE2014; 16: 36–43.
10.
AljamalREl-MousaAJubairF. A comparative review of high-performance computing major cloud service providers. In: 2018 9th International Conference on Information and Communication Systems (ICICS), Irbid, 3–5 April 2018, pp. 181–186. New York: IEEE.
11.
XuZChiXXiaoN. High-performance computing environment: a review of twenty years of experiments in China. National Sci Rev2016; 3: 36–48.
JonasESchleier-SmithJSreekantiV, et al. Cloud programming simplified: a Berkeley view on serverless computing. Arxiv Preprint, arXiv1902.03383, 2019.
14.
BaldiniICastroPChangK, et al. Serverless computing: current trends and open problems. New York: Springer, 2017, pp. 1–20.
15.
HendricksonSSturdevantSHarterT, et al. Serverless computation with open lambda. Elastic2016; 60: 80.
16.
WangLLiMZhangY, et al. Peeking behind the curtains of serverless platforms. Ann Tech Conf2018; 18: 133–146.
17.
McGrathGBrennerPR. Serverless computing: design, implementation, and performance. In: 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW), Atlanta, GA, 5–8 June 2017, pp. 405–410. New York: IEEE.
18.
LloydWRameshSChinthalapatiS, et al. Serverless computing: an investigation of factors influencing microservice performance. In: 2018 IEEE International Conference on Cloud Engineering (IC2E), Orlando, FL, 17–20 April 2018, pp. 159–169. New York: IEEE.
19.
MannerJEndreßMHeckelT, et al. Cold start influencing factors in function as a service. In: IEEE/ACM international conference on utility and cloud computing companion (UCC Companion), Zurich, 17–20 December 2018. New York: IEEE.
20.
KozierokCM. The TCP/IP guide: a comprehensive, illustrated Internet protocols reference. San Francisco, CA: No Starch Press, 2005.
21.
KehrerSUniversityRScheffoldJ, et al. Serverless skeletons for elastic parallel processing. In: 2019 IEEE 5th International Conference on Big Data Intelligence and Computing (DATACOM), Kaohsiung, 18–21 November 2019.
22.
JonasEPuQVenkataramanS, et al. Occupy the cloud: distributed computing for the 99%. In: Proceedings of the 2017 symposium on cloud computing, Santa Clara, CA, 24–27 September 2017, pp. 445–451. New York: ACM.
23.
XuJNelsonBLHongJ. Industrial strength COMPASS: a comprehensive algorithm and software for optimization via simulation. ACM Trans Model Comput Simul2010; 20: 3.
24.
WangHPasupathyRSchmeiserBW. Integer-ordered simulation optimization using R-SPLINE: retrospective search with piecewise-linear interpolation and neighborhood enumeration. ACM Trans Model Comput Simul2013; 23: 17.
25.
NiECCiocanDFHendersonSG, et al. Efficient ranking and selection in parallel computing environments. Operations Research2017; 2017: 1–36; ec1–ec17.
26.
PasupathyRHendersonSG. SimOpt: a library of simulation optimization problems. In: Proceedings of the 2011 Winter Simulation Conference (WSC), Phoenix, AZ, 11–14 December 2011, pp. 4075–4085. New York: IEEE.
27.
RossettiMD. Java Simulation Library (JSL): an open-source object-oriented library for discrete-event simulation in Java. Int J Simul Process Model2008; 4: 69–87.
28.
GibsonARossettiMD. Dynamic loop scheduling methods for large-scale parallel tasks in a serverless environment, 2023, Under review.
