servicechallenges

Information about servicechallenges

Published on October 24, 2007

Author: Reva

Source: authorstream.com

Content

LHC Computing Grid Project - LCG:  LHC Computing Grid Project - LCG Service Challenges Why, What, How 27 May 04 Les Robertson – LCG Project Leader CERN – European Organization for Nuclear Research Geneva, Switzerland [email protected] Adapted from presentation by Ian Bird Service Challenges:  Service Challenges Purpose Understand what it takes to operate a real grid service – run for days/weeks at a time (outside of experiment Data Challenges) Trigger/encourage the Tier1 & large Tier-2 planning – move towards real resource planning – based on realistic usage patterns Get the essential grid services ramped up to target levels of reliability, availability, scalability, end-to-end performance Set out milestones needed to achieve goals during the service challenges NB: This is focussed on Tier 0 – Tier 1/large Tier 2 Data management, batch production and analysis Short term goal – by end 2004 – have in place a robust and reliable data management service and support infrastructure and robust batch job submission Ian Bird – [email protected] Service challenges – examples :  Service challenges – examples Data Management Networking, file transfer, data management Storage management and interoperability Fully functional storage element (SE) Continuous job probes Understand limits Operations centres Accounting, assume levels of service responsibility, etc Hand-off of responsibility (RAL-Taipei-US/Canada) "Security incident" Detection, incident response, dissemination and resolution User support Assumption of responsibility, demonstrate staff in place, etc VO management Robust and flexible registration, management interfaces, etc Etc. Ian Bird – [email protected] Data Management – example :  Data Management – example Data management builds on a stack of underlying services: Network Robust file transfer Storage interfaces and functionality Replica location service Data management tools Ian Bird – [email protected] Data management – 2 :  Data management – 2 Network layer: Proposed set of network milestones already in draft Peter Clark, David Foster, Harvey Newman File transfer service layer: Move a file from A to B, with high reliability and target performance This service would normally only be visible via the data movement service Only app that can access/schedule/control this network E.g. of this is gridftp, bbftp, etc. Reliability – the service must detect failure, retry, etc. Interfaces to storage systems (SRM) The US-CMS/CERN “Edge Computing” project might be an instance of this layer (network + file transfer) Ian Bird – [email protected] Data management – 3 :  Data management – 3 Data movement service layer: Builds on top of file transfer and network layers To provide an absolutely reliable and dependable service with good performance Implement queuing, priorities, etc. Initiates file transfers using file transfer service Acts on application’s behalf – a file handed to the service will be guaranteed to arrive Replica Management Service: Makes use of data movement Maintains distributed grid catalogue Ian Bird – [email protected] Job probes – example :  Job probes – example Continuous flood of jobs Fill all resources Use as probes – test if they can use the resources Data access, cpu, etc Understand limitations, bottlenecks of the system Baseline measurement, find limits, build and improve This might be a function of the GOC Overseen by RAL-Taipei-+ collaboration ? A challenge might run for a week Outside of experiment data challenges In parallel (or part of) data management or other challenges Ian Bird – [email protected] Summary:  Summary Service challenges: Understand what it really takes to operate reliable and performant services Put in place underpinnings of a reliable infrastructure by the end of the year Requires: Agreed milestones Commitment of resources and people Ian Bird – [email protected]

Related presentations


Other presentations created by Reva

GIS Forest
03. 01. 2008
0 views

GIS Forest

U1introduction
20. 02. 2008
0 views

U1introduction

JENESYS introduction India
09. 10. 2007
0 views

JENESYS introduction India

Ibragimova Nikol CIRET2006 Rome
11. 10. 2007
0 views

Ibragimova Nikol CIRET2006 Rome

sudarshan cargo
15. 10. 2007
0 views

sudarshan cargo

InzhechikBaksan07 1
16. 10. 2007
0 views

InzhechikBaksan07 1

Presentacion retos CAFTA
22. 10. 2007
0 views

Presentacion retos CAFTA

Harth pobreza1aversion
22. 10. 2007
0 views

Harth pobreza1aversion

Wave Erosion and Marine Geology
23. 10. 2007
0 views

Wave Erosion and Marine Geology

7 Meslin
23. 10. 2007
0 views

7 Meslin

polibristol
24. 10. 2007
0 views

polibristol

genetically modified wheat
04. 10. 2007
0 views

genetically modified wheat

NELIGdec2005
02. 11. 2007
0 views

NELIGdec2005

CapitalesCA
25. 10. 2007
0 views

CapitalesCA

lezione 5
15. 10. 2007
0 views

lezione 5

PH10
15. 10. 2007
0 views

PH10

6 oct
23. 10. 2007
0 views

6 oct

A C 10 US CHAPTER
25. 10. 2007
0 views

A C 10 US CHAPTER

1450west
29. 10. 2007
0 views

1450west

chasing responsibly
05. 10. 2007
0 views

chasing responsibly

POCKETConsultTrainin gPowerPoint
08. 10. 2007
0 views

POCKETConsultTrainin gPowerPoint

West Nile Virus Overview CY 03
21. 10. 2007
0 views

West Nile Virus Overview CY 03

THALASSA
22. 10. 2007
0 views

THALASSA

summer seminar
07. 10. 2007
0 views

summer seminar

MTCRbrief19May03 Isby
15. 10. 2007
0 views

MTCRbrief19May03 Isby

THE LINDEN SHOW
23. 11. 2007
0 views

THE LINDEN SHOW

60years EIUDF presentation
28. 12. 2007
0 views

60years EIUDF presentation

NORM What
04. 01. 2008
0 views

NORM What

Booster Basics Presentation
07. 11. 2007
0 views

Booster Basics Presentation

trois conventions
24. 10. 2007
0 views

trois conventions

DNSA overview 11 2005
23. 12. 2007
0 views

DNSA overview 11 2005

Historia projektu EGEE
17. 10. 2007
0 views

Historia projektu EGEE

B822summary
24. 02. 2008
0 views

B822summary

cetraining1
16. 10. 2007
0 views

cetraining1

reference
28. 02. 2008
0 views

reference

potato nutrition presentation
07. 03. 2008
0 views

potato nutrition presentation

Isaac Talk UDC2007 Final
10. 12. 2007
0 views

Isaac Talk UDC2007 Final

IEEE 010417
26. 03. 2008
0 views

IEEE 010417

6b Bedritsky
27. 09. 2007
0 views

6b Bedritsky

3 introduction
27. 03. 2008
0 views

3 introduction

korean db overview
30. 03. 2008
0 views

korean db overview

Clouqueur Grover
16. 04. 2008
0 views

Clouqueur Grover

naturalresourceds
17. 04. 2008
0 views

naturalresourceds

VortragJaneliunas
12. 10. 2007
0 views

VortragJaneliunas

ekaw2006 tutorial
21. 10. 2007
0 views

ekaw2006 tutorial

Five Act Play
18. 04. 2008
0 views

Five Act Play

ts erms
22. 04. 2008
0 views

ts erms

Invest in Belgium
16. 03. 2008
0 views

Invest in Belgium

LoagueAETC06
15. 11. 2007
0 views

LoagueAETC06

6Dilut Sec OptionsSu2006
24. 02. 2008
0 views

6Dilut Sec OptionsSu2006

Interconnection Talk for Nigeria
28. 04. 2008
0 views

Interconnection Talk for Nigeria

SC190 Final Project
07. 05. 2008
0 views

SC190 Final Project

Local rad inj HGy
30. 04. 2008
0 views

Local rad inj HGy

esug2006georgheeg
02. 05. 2008
0 views

esug2006georgheeg

Ramirez
02. 05. 2008
0 views

Ramirez

CSRCS
02. 05. 2008
0 views

CSRCS

PES lecture1 history
15. 10. 2007
0 views

PES lecture1 history

Marx slides
19. 02. 2008
0 views

Marx slides

smith slides1
19. 10. 2007
0 views

smith slides1

metzner1
19. 10. 2007
0 views

metzner1

ismd01
11. 10. 2007
0 views

ismd01

sj1
07. 10. 2007
0 views

sj1

DarienResource06
07. 11. 2007
0 views

DarienResource06

IRC Calendarioautunno 2007
12. 03. 2008
0 views

IRC Calendarioautunno 2007

Conferencia Sima06
23. 10. 2007
0 views

Conferencia Sima06

WorldWarI TheGreatWar 000
26. 02. 2008
0 views

WorldWarI TheGreatWar 000

gb aging all
10. 10. 2007
0 views

gb aging all

TurkeyConf pres 905
21. 11. 2007
0 views

TurkeyConf pres 905