ESI toolkit

Information about ESI toolkit

Published on November 7, 2007

Author: VolteMort

Source: authorstream.com

Content

Experiment Software Installation toolkit on LCG-2 :  EGEE is a project funded by the European Union under contract IST-2003-508833 Experiment Software Installation toolkit on LCG-2 www.eu-egee.org Slide2:  The current implementation of the general schema discussed elsewhere (http://grid-deployment.web.cern.ch/grid-deployment/eis/docs/SoftwareInstallation/index.html foresees a three layer structured software. Tank & Spark represents a component of the lower level layer and it is mainly used for propagate software to the rest of a farm whenever no file system is provided. -:  - Structure of the Experiment Software Installation toolkit UI WN CE lcg-asis: is a friendly user interface It hides the difficulties that lcg-ManageSoftware invocation implies (see previous slides) It uploads (if specified) the sources of the software on the grid (tarball(s)). It loops over all available sites to the VO (complying with some requirements provided by the user in terms of CPU, memory, disk space and CPU-time) and for each site: Checks if another software management process is running on the site through the Information System (see later) Creates automatically the JDL for that site Submits the jobs and stores job information lcg-ManageSofwtare: represents the “middle layer” on the current implementation It is the steering script to be invoked for installing/removing/validating application software. It checks for the local (WN) environment and decides the workflow to be performed. Is there running some other process for the same software Is it a shared file system or not ? Is it a AFS file system or not (conversion of GSI credential to AFS Tokens)? Is there installed Tank&Spark (invocation of the propagation)? It allows for a reliable download of the tarball(s) (if specified) through the lcg-* commands to the local WN by-passing the outbound connectivity requirement. Eventual un packaging of these tarball(s) It invokes the experiment specific script (provided in somehow by the ESM) and checks the result of the script It creates a temporary directory used for install/validate/remove software and later on it cleans up such temporary directory. It publishes TAGs on the Information System with a flavor that depends on the action that it’s going to be performed and the result of a such action (do a man of the command for more information) Lcg-ManageVOTag: is a component of the lower level layer It is the command used by lcg-ManageSoftware in order to add/list/remove tags published on the Information System using the Gris running on a given CE. (It just adds/removes entries to the GlueHostApplicationSoftwareRunTimeEnvironment attribute of the IS .) It could be also used as a standalone application. It only requires the following format for the TAG: VO-<voname>-<whatever_string> Tank&Spark: a component of the lower level layer running either on the WN and on the CE It is here mainly used to propagate software to other WNs. BUT: It can be used as a standalone mechanism grid-independent It can allow for installation by-passing the grid-job-submission (high prioritization of software management) It keeps track about the installer which is strongly authenticated and univocally identified. It complies with external policy set by the site administrators It can manage all possible topologies of file system (shared, no-shared, AFS, a mix of them!) It allows for a-synchronous (currently) and synchronous installation. It allows for failure recovery. (re-try of the installation on the node) It can allow for roll-back of a given installation (not in place) It allows for an exhaustive notification (with success and problems node by node) to the ESM and (automatically) to the site admin. It allows for storing many information about a given software -internally identified through GUIDs - (ex. date, size, owner, path, status and so on). Automatic farm management: (It a node out? Is a new node there?) It adds/removes nodes into its central DB (MySQL) It modifies the Information System by changing the “flavour” of the tag gssklog: is another component of the lower level layer and it’s part of another mechanism externally developed: gssklog-gssklogd It represents the client of this mechanism allowing for the conversion of GSI credential into valid KRB5 AFS tokens, Tank & Spark:  Tank & Spark It consists of three different components: Tank : =multithread (gSOAP based) service (running on the CE) listening for GSI-authenticated (and non) connections Spark :=client application running on each WN (through a cronjob and/or through a normal “grid-job” from lcg-ManageSoftware) and contacting tank for retrieve/insert/delete software informations. R-sync server running on another machine (a SE for instance) and acting as central repository of the software. Slide5:  CE The software (here labeled as “c”) is installed locally through the middle layer lcg-ManageSoftware. A pre-validation is highly recommended before triggering the propagation. The Information System is upgraded Site Firewall ab ab abc abc “c” “c” Slide6:  Flag flavors: VO-dteam-orca-8.3-processing-install Installation on going VO-dteam-orca-8.3-processing-remove Removal on going VO-dteam-orca-8.3-processing-validate Validation on going VO-dteam-orca-8.3-aborted-install Installation failure VO-dteam-orca-8.3-aborted-remove Removal failure VO-dteam-orca-8.3-aborted-validate Validation failure VO-dteam-orca-8.3-to-be-validated Installation OK Removal OK VO-dteam-orca-8.3 Validation OK Advantages: Normal users continue to use the same mechanism to know about the software on a site The ESMs know about the status of his management experiment software jobs. There is not possibility to have concurrent management software jobs for the same software version on the same site.

Related presentations


Other presentations created by VolteMort

Global Supply Chain
13. 04. 2008
0 views

Global Supply Chain

Green Accounting CT 2006
18. 04. 2008
0 views

Green Accounting CT 2006

Chapter 01
10. 04. 2008
0 views

Chapter 01

jmkfah
09. 04. 2008
0 views

jmkfah

climate and science 07
07. 04. 2008
0 views

climate and science 07

2006080708
26. 03. 2008
0 views

2006080708

wcor06
21. 03. 2008
0 views

wcor06

FP7 MTAPU
18. 03. 2008
0 views

FP7 MTAPU

apostles symbols
16. 08. 2007
0 views

apostles symbols

Your First Flex Application
28. 11. 2007
0 views

Your First Flex Application

G070221 00
28. 11. 2007
0 views

G070221 00

how we help you become pregnant
03. 12. 2007
0 views

how we help you become pregnant

greenfieldlrp
03. 10. 2007
0 views

greenfieldlrp

ch4
16. 11. 2007
0 views

ch4

Habitat El Bosque Tropical
20. 11. 2007
0 views

Habitat El Bosque Tropical

ghostgirl
21. 11. 2007
0 views

ghostgirl

serious blow
16. 08. 2007
0 views

serious blow

Gospel
16. 08. 2007
0 views

Gospel

Jesus Feeds 5000
16. 08. 2007
0 views

Jesus Feeds 5000

Exegeting Jesus Parables
16. 08. 2007
0 views

Exegeting Jesus Parables

KNEZEVIC Desimir
04. 10. 2007
0 views

KNEZEVIC Desimir

week9
14. 12. 2007
0 views

week9

coldwar
19. 12. 2007
0 views

coldwar

icde07 hagonzal
23. 11. 2007
0 views

icde07 hagonzal

organic solvents
30. 12. 2007
0 views

organic solvents

ID172 LOGANALY
31. 12. 2007
0 views

ID172 LOGANALY

Meconium
04. 01. 2008
0 views

Meconium

dutch history fo rdummies
11. 12. 2007
0 views

dutch history fo rdummies

life cycle
09. 08. 2007
0 views

life cycle

2006Stats RRT C 5 3
09. 08. 2007
0 views

2006Stats RRT C 5 3

Ethical Issues at End of Life
09. 08. 2007
0 views

Ethical Issues at End of Life

Lecturx7
09. 08. 2007
0 views

Lecturx7

Sure of faith
16. 08. 2007
0 views

Sure of faith

HARTLEY WSOWS 20040204
05. 09. 2007
0 views

HARTLEY WSOWS 20040204

Biodiesel web
09. 11. 2007
0 views

Biodiesel web

csce520 lect2
16. 11. 2007
0 views

csce520 lect2

SM Aula 8 v3
28. 12. 2007
0 views

SM Aula 8 v3

33Chris
04. 01. 2008
0 views

33Chris

Celebration of life martha
09. 08. 2007
0 views

Celebration of life martha

life as an astronomer
09. 08. 2007
0 views

life as an astronomer

Ilene Lewis
09. 08. 2007
0 views

Ilene Lewis

Deep Drill Active HT2
09. 08. 2007
0 views

Deep Drill Active HT2

issues
28. 12. 2007
0 views

issues

families
24. 02. 2008
0 views

families

2005 OSD CAIG Presentation
04. 03. 2008
0 views

2005 OSD CAIG Presentation

sears techmission values2005
16. 08. 2007
0 views

sears techmission values2005

GSutter ppts
24. 06. 2007
0 views

GSutter ppts

griffiths LD summit 08nov06 post
24. 06. 2007
0 views

griffiths LD summit 08nov06 post

Griffiths D4L 26apr07 v2
24. 06. 2007
0 views

Griffiths D4L 26apr07 v2

Charlotte English FINAL
12. 03. 2008
0 views

Charlotte English FINAL

FOREIGN POLICY 1920s 1930s
14. 03. 2008
0 views

FOREIGN POLICY 1920s 1930s

Florence Labord Moodle
24. 06. 2007
0 views

Florence Labord Moodle

Einführung MKT Übungen
24. 06. 2007
0 views

Einführung MKT Übungen

kt cohort seminars sep20 2006
24. 06. 2007
0 views

kt cohort seminars sep20 2006

Karpati EPICT Final Review
24. 06. 2007
0 views

Karpati EPICT Final Review

JCampbell ppt
24. 06. 2007
0 views

JCampbell ppt

Boise Police 2 1 05
06. 11. 2007
0 views

Boise Police 2 1 05

Cheryl Keenan COABE 050505
09. 08. 2007
0 views

Cheryl Keenan COABE 050505

Lum db v1
16. 08. 2007
0 views

Lum db v1

2007 April Poll Powerpoint
05. 09. 2007
0 views

2007 April Poll Powerpoint

Viennot
02. 10. 2007
0 views

Viennot

EUROPEAN E INVESTOR 20040921
03. 10. 2007
0 views

EUROPEAN E INVESTOR 20040921

PulmonaryThromboembo lism
19. 11. 2007
0 views

PulmonaryThromboembo lism

Raffle Pandemic Flu Planning
05. 09. 2007
0 views

Raffle Pandemic Flu Planning

Face
11. 10. 2007
0 views

Face

navypowerpt
30. 11. 2007
0 views

navypowerpt

IHSLG CPD ERes RCSI 07
24. 06. 2007
0 views

IHSLG CPD ERes RCSI 07

retreat petery
16. 08. 2007
0 views

retreat petery

Open Day talk StudentLife
05. 12. 2007
0 views

Open Day talk StudentLife

LSIDs
09. 08. 2007
0 views

LSIDs

HF diff
16. 08. 2007
0 views

HF diff

IKT taikymas pradiniame ugdyme
24. 06. 2007
0 views

IKT taikymas pradiniame ugdyme

Dylan Symposium Presentation
09. 08. 2007
0 views

Dylan Symposium Presentation

Are We There Yet
16. 08. 2007
0 views

Are We There Yet

h0ykom ren
24. 06. 2007
0 views

h0ykom ren

hAykom ren
24. 06. 2007
0 views

hAykom ren

Halton Data Fair Winner MsNeilly
09. 08. 2007
0 views

Halton Data Fair Winner MsNeilly

careers 07
09. 08. 2007
0 views

careers 07

IBC05B
02. 01. 2008
0 views

IBC05B

Eating the Elephant
26. 11. 2007
0 views

Eating the Elephant

LSLR pt2
09. 08. 2007
0 views

LSLR pt2

pgeog251 ch18 af
27. 11. 2007
0 views

pgeog251 ch18 af

henny eyova
24. 06. 2007
0 views

henny eyova

ksypolitos SCH TelematicServices
24. 06. 2007
0 views

ksypolitos SCH TelematicServices

Morgan town 2007
09. 08. 2007
0 views

Morgan town 2007

IMS State of Open Source 0606
24. 06. 2007
0 views

IMS State of Open Source 0606

h dillon training shoestring
24. 06. 2007
0 views

h dillon training shoestring

Click on SUNY for internetII
05. 09. 2007
0 views

Click on SUNY for internetII

kruul
24. 06. 2007
0 views

kruul

228 210 RSCEast PowerPressed
24. 06. 2007
0 views

228 210 RSCEast PowerPressed

kanayama
24. 06. 2007
0 views

kanayama

Businessplan NYSERnet
05. 09. 2007
0 views

Businessplan NYSERnet

gse program
24. 06. 2007
0 views

gse program

ica 20105 cert 2 it 2007
24. 06. 2007
0 views

ica 20105 cert 2 it 2007

Mukherjee sbatransition
09. 08. 2007
0 views

Mukherjee sbatransition

Kinsinger VA
09. 08. 2007
0 views

Kinsinger VA

ALA05O lszewski
29. 11. 2007
0 views

ALA05O lszewski

lec12 04 lcca
09. 08. 2007
0 views

lec12 04 lcca

I GIG2
16. 08. 2007
0 views

I GIG2