This paper presents an approach to programming and running scientific applications on grid and cloud infrastructures based on two principles: the first one is to follow a component-based programming model, the second is to apply a flexible technology which allows for virtualization of the underlying infrastructure. The solutions described in this paper include high-level composition and deployment consisting of a scripting-based environment and a manager system based on an architecture description language (ADL), a dynamically managed pool of component containers, and interoperability with other component models such as Grid Component Model (GCM). We demonstrate how the proposed methodology can be implemented by combining the unique features of the Common Component Architecture (CCA) model together with the H2O resource sharing platform, resulting in the MOCCA component framework. Applications and tests include data mining using the Weka library, Monte Carlo simulation of the formation of clusters of gold atoms, as well as a set of synthetic benchmarks. The conclusion is that the component approach to scientific applications can be successfully applied to both grid and cloud infrastructures.
AltunayMAveryPBlackburnKBockelmanBErnstMFraserD. (2011) A science driven production cyberinfrastructure – the Open Science Grid. Journal of Grid Computing9: 201–218.
2.
ArmstrongR. (2006) The CCA component model for high-performance scientific computing. Concurrency and Computation: Practice and Experience18: 215–229.
3.
BaduelLBaudeFCaromelD (2005) Object-Oriented SPMD. In IEEE International Symposium on Cluster Computing and the Grid, Vol. 2, pp. 824–831.
4.
BaduelL. (2006) Programming, deploying, composing, for the grid. In: CunhaJCRanaOF (eds) Grid Computing: Software Environments and Tools. Heidelberg: Springer.
5.
BaudeFCaromelDDalmassoCDaneluttoMGetovVHenrio L etal. (2009) GCM: a grid extension to fractal for autonomous distributed components. Annales des Télécommunications64: 5–24.
6.
BaudeFCaromelDHenrioLMorelM (2007) Collective interfaces for distributed components. In Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2007)14–17 May 2007, Rio de Janeiro, Brazil. IEEE Computer Society, pp. 599–610.
7.
BeckmanPH (2005) Building the TeraGrid. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences363: 1715–1728.
BertrandFBramleyRSussmanABernholdtDEKohlJALarson JW etal. (2005) Data redistribution and remote method invocation in parallel component architectures. 19th International Parallel and Distributed Processing Symposium (IPDPS 2005), CD-ROM / Abstracts Proceedings, 4–8 April 2005, Denver, CO. IEEE Computer Society.
11.
BishopPWarrenN (2003) JavaSpaces in Practice. Boston, MA: Addison-Wesley.
12.
BolzeRCappelloFCaronEDaydéMDesprezFJeannot E etal. (2006) Grid'5000: A large scale and highly reconfigurable experimental grid testbed. International Journal of High Performance Computing Applications20: 481–494.
13.
BouzianeHLPérezCPriolT (2008) A software component model with spatial and temporal compositions for grid infrastructures. In: LuqueEMargalefTBenitezD (eds) Proceedings Euro-Par 2008 – Parallel Processing, 14th International Euro-Par Conference, Las Palmas de Gran Canaria, Spain, 26–29 August 2008 (Lecture Notes in Computer Science, vol. 5168). Berlin: Springer, pp. 698–708.
14.
BrunetonE. (2006) The fractal component model and its support in Java. Software: Practice and Experience36: 1257–1284.
15.
BubakMGubałaTKapałkaMMalawskiMRycerzK (2005) Workflow composer and service registry for grid applications. Future Generation Computer Systems21: 79–86.
BubakMMalawskiMZajacK (2003) Architecture of the grid for interactive applications. In: Sloot PMA etal. (eds) Proceedings of Computational Science – ICCS 2003, International Conference, Melbourne, Australia and St. Petersburg, Russia, June 2003 (Lecture Notes in Computer Science, vol. 2657). Berlin: Springer, pp. 207–213.
18.
CaromelDHenrioL (2005) A Theory of Distributed Objects. Berlin: Springer.
19.
CiepielaEHarezlakDKocotJBartynskiTKasztelnikMNowakowski P etal. (2010) Exploratory programming in the Virtual LaboratoryProceedings of the International Multiconference on Computer Science and Information Technology, Wisla, Poland. IEEE Press, pp. 621–628.
20.
CoppolaMDaneluttoMLacourSPérezCPriolTTonellotto N etal. (2005) Towards a common deployment model for grid systems. In: GorlatchSDaneluttoM (eds) Proceedings of the Integrated Research in Grid Computing Workshop. Pisa, Italy: Università di Pisa, Dipartimento di Informatica, TR-05-22: 31–40.
DeanJGhemawatS (2008) MapReduce: Simplified data processing on large clusters. Communication of the ACM51: 107–113.
23.
DeelmanE (2010) Grids and clouds: Making workflow applications work in heterogeneous distributed environments. International Journal of High Performance Computing Applications24: 284–298.
24.
DünnweberJGorlatchS (2009) Higher-Order Components for Grid Programming – Making Grids More Usable. Berlin: Springer.
25.
DyrdaMMalawskiMBubakMNaqviS (2009) Providing security for MOCCA component environment. In 23rd IEEE International Symposium on Parallel and Distributed Processing, IPDPS 2009, Rome, Italy, 23–29 May 2009. IEEE Press, pp. 1–7.
26.
FalconeJLChopardBHoekstraAG (2010) MML: Towards a Multiscale Modeling Language. Procedia CS1: 819–826.
27.
FosterIKesselmanC (2006) Scaling System-Level Science: Scientific exploration and IT implications. Computer39: 31–39.
28.
FosterIT (2006) Globus Toolkit Version 4: Software for service-oriented systems. Journal of Computer Science Technology21: 513–520.
29.
FosterITKesselmanCTsudikGTueckeS (1998) A security architecture for computational grids. In ACM Conference on Computer and Communications Security, pp. 83–92.
30.
GabrielEFaggGEBosilcaGAngskunTDongarraJJSquyres JM etal. (2004) Open MPI: Goals, concept, and design of a next generation MPI implementation. In Proceedings 11th European PVM/MPI Users' Group Meeting. Budapest, Hungary, pp. 97–104.
31.
GentzschWGirouDKennedyALedererHReetzJRiedel M etal. (2011) DEISA – Distributed European Infrastructure for Supercomputing Applications. Journal of Grid Computing9: 259–277.
32.
GilYDeelmanEEllismanMFahringerTFoxGGannon D etal. (2007) Examining the challenges of scientific workflows. Computer40: 24–32.
33.
GorissenDWendykierPKurzyniecDSunderamV (2005) Integrating grid information services using JNDI. 6th IEEE/ACM International Workshop on Grid Computing (Grid 2005). Seattle, Washington, USA.
34.
GovindarajuM. (2003) Merging the CCA component model with the OGSI framework. In CCGRID ‘03: Proceedings of the 3rd International Symposium on Cluster Computing and the Grid. Washington, DC: IEEE Computer Society, p. 182.
35.
GubałaTHerezlakDBubakMMalawskiM (2006) Semantic composition of scientific workflows based on the Petri nets formalism. In Second IEEE International Conference on e-Science and Grid Computing (e-Science'06), Amsterdam, The Netherlands. IEEE Computer Society, p. 12.
36.
HendersonR (1995) Job scheduling under the portable batch system. In FeitelsonDRudolphL (eds), Job Scheduling Strategies for Parallel Processing(Lecture Notes in Computer Science, vol. 949). Berlin:Springer, pp. 279–294.
37.
HenningM (2008) The rise and fall of CORBA. Communications of the ACM51: 52–57.
38.
HerráezA (2006) Biomolecules in the computer: Jmol to the rescue. Biochemistry and Molecular Biology Education34: 255–261.
39.
HLA (2010) IEEE standard for modeling and simulation (M and S) high level architecture (HLA) – framework and rules. Technical report IEEE Standard 1516-2010 (Revision of IEEE Std 1516-2000).
40.
JurczykPGoleniaMMalawskiMKurzyniecDBubakMSunderamVS (2006) Enabling remote method invocations in peer-to-peer environments: RMIX over JXTA. In WyrzykowskiRDongarraJMeyerNWasniewskiJ (eds), Parallel Processing and Applied Mathematics, 6th International Conference, PPAM 2005, Poznan, Poland, September 11–14, 2005, Revised Selected Papers (Lecture Notes in Computer Science, vol. 3911). Berlin: Springer, pp. 667–674.
41.
KaronisNTToonenBRFosterIT (2003) MPICH-G2: A grid-enabled implementation of the message passing interface. Journal of Parallel and Distributed Computing63: 551–563.
42.
KohnSR et al. (2001) Divorcing language dependencies from a scientific software library. In Proceedings of the 10th SIAM Conference on Parallel Processing for Scientific Computation. Portsmouth, VA: SIAM.
43.
KranzlmüllerDLucasJMÖsterP (2010) The European Grid Initiative (EGI). In DavoliFMeyerNPuglieseRZappatoreS (eds), Remote Instrumentation and Virtual Laboratories. Boston, MA: Springer US, Chapter6, 61–66.
44.
KrishnanSGannonD (2004) XCAT3: A framework for CCA components as OGSA services. In Proceedings of the International Workshop on High-Level Parallel Programming Models and Supportive Environments (HIPS), Santa Fe, NM, pp. 90–97.
45.
KumfertGLeekJEpperlyT (2007) Babel remote method invocation. In: 21st International Parallel and Distributed Processing Symposium (IPDPS 2007), Proceedings, 26–30 March 2007, Long Beach, CA. IEEE, pp. 1–10.
46.
KurzyniecDWrzosekTDrzewieckiDSunderamVS (2003a) Towards self-organizing distributed computing frameworks: The H2O approach. Parallel Processing Letters13: 273–290.
47.
KurzyniecDWrzosekTSunderamVSlomińskiA (2003b) RMIX: A multiprotocol RMI framework for Java. In Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS'03), Nice, France. IEEE Computer Society, pp. 140—146.
48.
MalawskiMBartyńskiTBubakM (2010) Invocation of operations from script-based grid applications. Future Generation Computer Systems26: 138–146.
49.
MalawskiMBartynskiTCiepielaEKocotJPelczarPBubakM (2006a) An ADL-based support for CCA components on the Grid. In CoreGRID Workshop on Grid Systems, Tools and Environments, Sophia-Antipolis, France.
50.
MalawskiMBartynskiTCiepielaEKocotJPelczarPBubakM (2007a) A new approach to supporting component applications on grid. In BubakMTuralaMWiatrK (eds), Proceedings of Cracow Grid Workshop – CGW'06, 15–18 October2006. Krakow, Poland: ACC-Cyfronet AGH, 328–336.
51.
MalawskiMBubakMBaudeFCaromelDHenrioLMorelM (2007b) Interoperability of grid component models: GCM and CCA case study. In CoreGRID Symposium(CoreGRID Series). Berlin: Springer, pp. 95–106.
52.
MalawskiMBubakMPlacekMKurzyniecDSunderamV (2006b) Experiments with distributed component computing across grid boundaries. In: Proceedings of the HPC-GECO/CompFrame workshop in conjunction with HPDC 2006, Paris, France.
53.
MalawskiMGubalaTKasztelnikMBartynskiTBubakMBaude F etal. (2008a) High-level scripting approach for building component-based applications on the grid. In DaneluttoMFragopoulouPGetovV (eds) Making Grids Work: CoreGRID Workshop, Heraklion, Crete. Berlin: Springer, pp. 307–320.
54.
MalawskiMHarezlakDBubakM (2006c) Towards multiprotocol and multilanguage interoperability: Experiments with Babel and RMIX. In BubakMTuralaMWiatrK (eds), Proceedings of Cracow Grid Workshop – CGW'05, 20–23 November2005. Krakow, Poland: ACC-Cyfronet AGH, 266–278.
55.
MalawskiMKocotJRyszkaIBubakMWieczorekMFahringerT (2008b) Optimization of application execution in the GridSpace environment. In GorlatchSFragopoulouPPriolT (eds), CoreGRID Integration Workshop 2008 – Integrated Research in Grid Computing, pp. 395–405.
56.
MalawskiMKurzyniecDSunderamV (2005) MOCCA – towards a distributed CCA framework for metacomputing. In Proceedings of the 10th International Workshop on High-Level Parallel Programming Models and Supportive Environments (HIPS2005) in conjunction with International Parallel and Distributed Processing Symposium (IPDPS 2005). IEEE Computer Society.
57.
MalawskiMMeiznerJBubakMGepnerP (2011) Component approach to computational applications on clouds. Procedia Computer Science4: 432–441.
58.
MayerAMcGoughSFurmentoNLeeDNewhouseSDarlingtonJ (2003) ICENI dataflow and workflow: Composition and scheduling in space and time. In UK e-Science All Hands Meeting, Nottingham, UK, pp. 627–634.
59.
MeiznerJMalawskiMCiepielaEKasztelnikMHarezlakDNowakowski P etal. (2009) Virolab security and virtual organization infrastructure. In DouYGruberRJollerJM (eds), Proceedings Advanced Parallel Processing Technologies, 8th International Symposium, APPT 2009, Rapperswil, Switzerland, 24–25August 2009 (Lecture Notes in Computer Science, vol. 5737). Berlin: Springer, pp. 230–245.
60.
MorganRLCantorSCarmodySHoehnWKlingensteinK (2004) Federated security: The Shibboleth approach. EDUCAUSE Quarterly27: 12–17.
61.
MouginPBarrioladeC (2001) Web Services, Business Objects and Component Models. Technical Report, Orchestra Networks.
62.
MurtyJ (2008) Programming Amazon Web Services – S3, EC2, SQS, FPS, and SimpleDB. Sebastopol, CA: O'Reilly.
63.
NGG Group (2004) Next Generation Grids 2 requirements and options for European Grids research 2005–2010 and beyond. Technical report.
Object Management Group, Inc (2006b) Deployment and configuration of component-based distributed applications specification, version 4.0. http://www.omg.org/docs/formal/06-04-02.pdf.
67.
OstermannSIosupAYigitbasiNProdanRFahringerTEpemaD (2010) A performance analysis of EC2 cloud computing services for scientific computing. In AkanOBellavistaPCaoJDresslerFFerrariDGerla M etal. (eds), Cloud Computing (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 34(9)). Berlin: Springer, pp. 115–131.
68.
OusterhoutJK (1998) Scripting: Higher-level programming for the 21st century. Computer31: 23–30.
69.
ParlavantzasNMorelMGetovVBaudeFCaromelD (2007) Performance and scalability of a Component-Based grid application. In Proceedings of IPDPS2007, pp. 1–8.
70.
PerezCPriolTRibesA (2003) A parallel CORBA component model for numerical code coupling. The International Journal of High Performance Computing Applications (IJHPCA)17: 417–429.
71.
RellermeyerJSAlonsoGRoscoeT (2007) R-OSGi: distributed applications through software modularization. In Proceedings of the ACM/IFIP/USENIX 2007 International Conference on Middleware, New York, NY. Berlin: Springer, pp. 1–20.
SchwiegelshohnUBadiaRMBubakMDaneluttoMDustdarSGagliardi F etal. (2010) Perspectives on grid computing. Future Generation Computer Systems26: 1104–1115.
74.
SlootPMTirado-RamosAAltintasIBubakMBoucherC (2006) From molecule to man: Decision support in individualized e-Health. Computer39: 40–46.
75.
SotomayorBKeaheyKFosterIT (2008) Combining batch execution and leasing using virtual machines. In ParasharMSchwanKWeissmanJBLaforenzaD (eds) HPDC ‘08: Proceedings of the 17th International Symposium on High Performance Distributed Computing. New York: ACM Press, pp. 87–96.
76.
StreitAErwinDLippertTMallmannDMendayRRambadt M etal. (2005) Unicore – From project results to production grids. Advances in Parallel Computing14: 357–376.
77.
ThainDTannenbaumTLivnyM (2005) Distributed computing in practice: the Condor experience. Concurrency and Computation – Practice and Experience17: 323–356.
78.
van NieuwpoortRMaassenJWrzesinskaGHofmanRFHJacobsCJHKielmann T etal. (2005) Ibis: a flexible and efficient Java-based grid programming environment. Concurrency – Practice and Experience17: 1079–1107.
79.
Van NieuwpoortRVWrzesińskaGJacobsCJHBalHE (2010) Satin: A high-level and efficient grid programming model. ACM Transactions on Programming Languages and Systems32: 3.
80.
VecchiolaCPandeySBuyyaR (2009) High-performance cloud computing: A view of scientific applications. In 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks (ISPAN), pp. 4–16.
81.
VogelsW (2003) Web services are not distributed objects. IEEE Internet Computing7: 59–66.
82.
WildeMFosterIIskraKBeckmanPZhangZEspinosa A etal. (2009) Parallel scripting for applications at the petascale and beyond. Computer42: 50–60.
83.
WilsonNJohnstonR (2000) Modelling gold clusters with an empirical many-body potential. European Physical Journal D12: 161–169.
84.
WittenIHFrankE (2005) Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems). Waltham, MA: Morgan Kaufmann.
85.
ZhaoZBelloumABubakM (2009) Special section on workflow systems and applications in e-Science. Future Generation Computer Systems25: 525–527.
