Towards Dynamic Integration,Scheduling and Rescheduling of Scientific Applications

Abstract

The evolution of grid computing generates new requirements for distributed application development and deployment. There is no standard way of registering these applications, describing their input parameters and output results and monitoring their progress in the Grid environment. The Web Services Architecture (WSA) is an ideal technology to integrate legacy applications into the Grid. Adopting this service-oriented architecture, a model is implemented to achieve the dynamic deployment, scheduling and rescheduling of scientific applications. The model treats all components (Resource Service and Service Scheduler) as WSRF-compliant services which support the applications integration with underlying native platform facilities and facilitate the construction of the hierarchical scheduling system.

Keywords

Web services WSRF dynamic deployment application integration meta-scheduler Rescheduling

References

Foster

Kesselman

Nick

J.M.

Tuecke

: Grid services for distributed system integration. Computer 35(6) (2002) 37–46

Kandaswamy

Fang

Huang

Shirasuna

Gannon

: A generic framework for building services and scientific workflows for the grid. In: The 2005 ACM/IEEE Conference on SuperComputing. (2005)

Foster

Czajkowski

Ferguson

Frey

Graham

Maguire

Snelling

Tuecke

: Modeling and managing state in distributed systems: The role of ogsi and wsrf. In: Proceedings of the IEEE. Volume 93. (March 2005) 604–612

Feller

Foster

Martin

: Gt4 gram: A functionality and performance study. In: TeraGrid 2007 conference, Madison, WI (2007)

Foster

Kesselman

Tuecke

: The anatomy of the grid: Enabling scalable virtual organizations. International Journal of High Performance Computing Applications 15(3) (2001) 200–222

Kuebler

Eibach

: Adapting legacy applications as web services. IBM DeveloperWorks (2002) http://www-128.ibm.com/developerworks/library/ws-legacy/.

Christensen

Curbera

Meredith

Weerawarana

: (2001) http://www.w3.org/TR/wsdl.

Fallside

D.C.

: (2001) http://www.w3.org/TR/xmlschema-0.

Foster

: Globus toolkit version 4: Software for service-oriented systems. In: IFIP International Conference on Network and Parallel Computing. LNCS 3779, Springer-Verlag 2–13

10.

Sotomayor

: The globus toolkit 4 programmer's tutorial

11.

Schopf

J.M.

Raicu

Pearlman

Miller

Kesselman

Foster

D'Arcy

: Monitoring and discovery in a web services framework: Functionality and performance of globus toolkit mds4. Technical Report ANL/MCS-P1248–0405, Argonne National Laboratory, Argonne, IL (2005)

12.

Foster

Kesselman

Nick

J.M.

Tuecke

: Grid services for distributed system integration. Computer 35(6) (2002) 37–46

13.

Team

Globus

: Gt 4.0 ws gram: Job description schema doc, http://www.globus.org-/toolkit/docs/4.0/execution/wsgram/schemas/gram_job_description.html.

14.

Mausolf

: Grid in action: Monitor and discover grid services in an soa/web services environment (2005) http://www-128.ibm.com/developerworks/grid/library/grgt4mds/index.html.

15.

Cooper

Dasgupta

Kennedy

Koelbel

Mandal

Marin

Mazina

Mellor-Crummey

Berman

Casanova

Chien

Dail

Liu

Olugbile

Sievert

Xia

Johnsson

Liu

Patel

Reed

Deng

Mendes

Shi

YarKhan

Dongarra

: New grid scheduling and rescheduling methods in the grads project. ipdps 11(2004) 199a

16.

W3C: Web services description language (wsdl) 1.1 http://www.w3.org/TR/wsdl.

17.

Sundaram

: Introducing gt4 security (2005) http://www-128.ibm.com/developerworks/grid/library/gr-gsi4intro/.

18.

Globus Team: globusrun-ws-Official job submission client for WS GRAM http://www.globus.org/toolkit/docs/4.0/execution/wsgram/rn01re01.html.

19.

Condor Team: Condor user's manual http://www.cs.wisc.edu/condor/manual/v6.8/-2-4Road-map_Running.html.

20.

Frey

Tannenbaum

Livny

Foster

Tuecke

: Condor-G: A computation management agent for multi-institutional Grids. Cluster Computing 5(3) (2002) 237–246

21.

Buyya

Abramson

Giddy

: A computational economy for Grid computing and its implementation in the Nimrod-G Resource broker. Future Generation Computer Systems 18(2002) 1061–1074

22.

Seidel

Allen

Merzky

Nabrzyski

: GridLab–A Grid application toolkit and testbed. Future Generation Computer Systems 18(8) (2002) 1143–1153

23.

Platform Computing team: Open source metascheduling for virtual organizations with the community scheduler framework (CSF). Technical report, Platform Computing (2003)

24.

EGEE Team: EGEE middleware architecture and planning (Release 2). Technical report, DJRA1.4, EGEE (2005)

25.

Huedo

Montero

R.S.

Llorente

I.M.

: A modular meta-scheduling architecture for interfacing with pre-WS and WS Grid resource management services. Future Generation Computer Systems 23 (2007)252–261

26.

Huang

Taylor

Walker

Davies

: Wrapping legacy codes for grid-based applications. In: Parallel and Distributed Processing Symposium, 2003. Proceedings. International. (22–26 April)

27.

Kacsuk

Goyeneche

Delaitre

Kiss

Farkas

Boczko

: High-level grid application environment to use legacy codes as ogsa grid services. In: Grid Computing, 2004. Proceedings. Fifth IEEE/ACM International Workshop. 428–435

28.

Gannon

Ananthakrishnan

Krishnan

Govindaraju

Ramakrishnan

Slominski

: Grid web services and application factories. Computing: Making the Global Infrastructure a Reality. Fox

Berman

and Hey , eds. Wiley (2003)

29.

Foster

Kesselman

Nick

Tuecke

: The physiology of the grid: An open grid services architecture for distributed systems integration (2002)

30.

Lodygensky

Fedak

Cappello

Neri

Livny

Thain

: Xtremweb & condor: Sharing resources between internet connected condor pool. In: Cluster Computing and the Grid, 2003. Proceedings. CCGrid 2003. 3rd IEEE/ACM International Symposium. (12–15 May 2003) 382–389