wp4status russia2

Information about wp4status russia2

Published on October 26, 2007

Author: Javier

Source: authorstream.com

Content

DataGrid WP4: Fabric Management :  DataGrid WP4: Fabric Management German Cancio [email protected] 30/7/2001 CERN-Russia JWG on LHC Computing Outline:  Outline Background information Functionality and Architecture M9 prototype deliverables Background information:  Background information WP4’s objective: deliver the necessary tools to manage a computing fabric providing grid services on clusters scaling up to thousands of nodes. Main scope: User job management (Grid and local) Fabric (system administration) management Official participants: CERN (leading partner), INFN, NIKHEF, University of Heidelberg, ZIB (Berlin) and University of Edinburgh/PPARC Functionality:  Functionality Provision for running Grid jobs Authorization according to local policies Mapping Grid credential to local ones Publication of fabric resources and job information Provision for running local jobs Sharing of resources according to local policies Enterprise system administration - scalable to O(10K) nodes Automated installation and maintenance of nodes Resource management (batch, interactive) Monitoring of events and performance Fault tolerance & recovery actions Fabric Configuration Management Slide6:  WP4 tasks Grid Fabric Architecture (1/3):  Architecture (1/3) Subsystems in WP4: 1 - (Grid) job submission, control and management subsystems: Grid interface subsystem receives job submission/control requests from the Grid, provides mechanisms for policy based authentication and authorization. Globus/GRAM layer. Publication of static and dynamic resource information to the Grid. Globus/GRIS layer. Resource Management subsystem manage execution, workload distribution and resource sharing of user jobs on the fabric’s batch and interactive services. Architecture (2/3):  Architecture (2/3) 2 - Subsystems for fabric management: Configuration management Store fabric configuration information (node config, farm profiles, fabric policies) Node installation and management Installing, configuring, updating system components and application on all fabric nodes (eg. Farm CPU nodes, file servers,…) Monitoring and fault tolerance job, node and service based monitoring and alarm generation. Fault tolerance components will correlate monitoring with configuration information and initiate automated recovery actions if appropriate, both at individual node and at fabric scale. Architecture (3/3):  Architecture (3/3) All the subsystems are glued together by a common fabric administration scripting layer. Automate complex and inter-dependent fabric wide management operations API’s to the subsystems Base libraries for common operations Scripts are written by experienced fabric administrators Scripts are executed either manually (eg. using web forms) … … or automatically (periodic actions, recovery procedures) Slide10:  Grid Info Services (WP3) Farm A (LSF) Farm B (PBS) Grid User Mass storage, Disk pools Replica Mgr Month 9 deliverables (1/2):  Month 9 deliverables (1/2) Main WP4 deliverables in Release 1 (end September): 1) Interim Installation System (IIS) for the installation and maintenance of the M9 testbeds Linux clusters are prime target, but implemented in portable way. Components: Initial installation tool using system image cloning LCFG (Edinburgh University) for software updates and maintenance Month 9 deliverables (2/2):  Month 9 deliverables (2/2) 2) First configuration management prototype: Low level language and API for fabric components to reliably retrieve their configuration information. Design: Node profiles stored in XML format central HTTP(S) servers host configurations Node access API for tree-like navigation Used by the PM9 Interim Installation System (IIS) to get all configuration information. Configuration information is entered per node High-level definition language allowing for inheritance configuration trees (for whole services, clusters…) to be added in later releases Contacts and more information:  Contacts and more information DataGRID WP4 : http://cern.ch/hep-proj-grid-fabric Documentation and meeting minutes Members Mailing list archives Overall project architecture group: DataGRID ATF http://cern.ch/grid-atf

Related presentations


Other presentations created by Javier

wap
26. 11. 2007
0 views

wap

PairashThajchayapong1
02. 01. 2008
0 views

PairashThajchayapong1

Lecture13 1
09. 10. 2007
0 views

Lecture13 1

Physical Features of Arab World
24. 10. 2007
0 views

Physical Features of Arab World

arbovirus
24. 10. 2007
0 views

arbovirus

Ch14 Lecture
29. 11. 2007
0 views

Ch14 Lecture

going in 13may02
01. 12. 2007
0 views

going in 13may02

cap3
14. 11. 2007
0 views

cap3

enfoques 4 ppt
15. 11. 2007
0 views

enfoques 4 ppt

DeafTalk
16. 11. 2007
0 views

DeafTalk

db2
19. 11. 2007
0 views

db2

REACH Overview
05. 12. 2007
0 views

REACH Overview

Romantic English Literature
14. 12. 2007
0 views

Romantic English Literature

Treaty of Versailles
23. 12. 2007
0 views

Treaty of Versailles

conman15
28. 12. 2007
0 views

conman15

intro CS 1
04. 01. 2008
0 views

intro CS 1

Radiation Concepts
04. 01. 2008
0 views

Radiation Concepts

Kryptologie Folien Web
05. 01. 2008
0 views

Kryptologie Folien Web

meld ldp iros07 talk3
07. 01. 2008
0 views

meld ldp iros07 talk3

bird
29. 10. 2007
0 views

bird

Ideal Year 2006
02. 11. 2007
0 views

Ideal Year 2006

Saggia Ecologia Presentazione
01. 10. 2007
0 views

Saggia Ecologia Presentazione

Royal Europe consumer
30. 10. 2007
0 views

Royal Europe consumer

Undergrat Presentation 2004
24. 10. 2007
0 views

Undergrat Presentation 2004

report pixel2000
01. 11. 2007
0 views

report pixel2000

Johnson 1
06. 11. 2007
0 views

Johnson 1

USA Presentation Rev 4
08. 11. 2007
0 views

USA Presentation Rev 4

Divisenko
20. 11. 2007
0 views

Divisenko

Civil Society Index Project
23. 11. 2007
0 views

Civil Society Index Project

Unit07Log
01. 11. 2007
0 views

Unit07Log

presentaz roma trieste 4
29. 10. 2007
0 views

presentaz roma trieste 4

Montana Meth Presentation
27. 12. 2007
0 views

Montana Meth Presentation

careerbuilder
20. 02. 2008
0 views

careerbuilder

Brussels 11May06
25. 10. 2007
0 views

Brussels 11May06

EDMT14
27. 02. 2008
0 views

EDMT14

pisanelli
30. 10. 2007
0 views

pisanelli

Newch6www
29. 02. 2008
0 views

Newch6www

tunnista kulutustyyppisi
05. 11. 2007
0 views

tunnista kulutustyyppisi

StratTac06 Leggett
05. 03. 2008
0 views

StratTac06 Leggett

Teela powerpoint 6
14. 03. 2008
0 views

Teela powerpoint 6

67436
27. 03. 2008
0 views

67436

dli20071
30. 03. 2008
0 views

dli20071

GEP2007
25. 10. 2007
0 views

GEP2007

hort2 floraldesign
11. 12. 2007
0 views

hort2 floraldesign

Kodal MALTA
04. 10. 2007
0 views

Kodal MALTA

bcs 03 nottingham
26. 11. 2007
0 views

bcs 03 nottingham

17 Sussex
17. 12. 2007
0 views

17 Sussex

asdc ncss for website ihc
06. 11. 2007
0 views

asdc ncss for website ihc

frieman
15. 11. 2007
0 views

frieman

Sem Grd Ontology
19. 11. 2007
0 views

Sem Grd Ontology

Underground1
06. 12. 2007
0 views

Underground1

Avape Port
16. 11. 2007
0 views

Avape Port

ceciliat2
28. 12. 2007
0 views

ceciliat2

diane guatelli
31. 10. 2007
0 views

diane guatelli

cacti
12. 12. 2007
0 views

cacti

Attila Vitai Vodafone
26. 11. 2007
0 views

Attila Vitai Vodafone

kevin dustin
13. 11. 2007
0 views

kevin dustin

02 Italy Gorgucci
31. 10. 2007
0 views

02 Italy Gorgucci