diane guatelli

Information about diane guatelli

Published on October 31, 2007

Author: Javier

Source: authorstream.com

Content

Geant4 in a Distributed Computing Environment:  Geant4 in a Distributed Computing Environment S. Guatelli1, P. Mendez Lorenzo2, J. Moscicki2, M.G. Pia1 1. INFN Genova, Italy, 2. CERN, Geneva, Switzerland Geant4 2005 10th user conference and collaboration workshop November 3-10, 2005, Bordeaux, France                                                                                          Vision:  Vision Problem How to obtain a quick response from a Geant4 simulation Case 1: quick response in few minutes i.e. dosimetry, study the efficiency of detectors Case 2: reasonable time for response from G4 simulations requiring high statistics i.e. medical, space science, high energy physics applications, tests of Geant4 physics models Solution Parallelisation On dedicated pc clusters On the GRID Study a general approach, independent from the specific Geant4 application Slide3:  Quick response Transparent configuration in sequential or parallel mode Transparent access to the GRID through an intermediate software layer Parallelisation Access to distributed computing resources Strategy:  G4 IMRT application Execution time of 109 events ~ 9 days and half Goal: quick response ~ few hours Strategy Study the performance of two Geant4 applications as typical examples: Geant4 Brachytherapy application Geant4 IMRT application Parallelisation through DIANE Performance tests On a single CPU On clusters On the GRID Quantitative analysis of the results G4 Brachytherapy application Execution time of 20 M events ~ 5 hours Goal: quick response ~ few minutes Sequential mode on a Pentium IV, 3 GHz Outline:  Outline Diane overview How to dianize a G4 application Results of performance tests Conclusions DIANE Overview:  DIANE Overview DIANE R&D Project started in 2001 in CERN/IT with very limited resources collaboration with Geant 4 groups at CERN, INFN, ESA succesful prototypes running on LSF and EDG Parallel cluster processing make fine tuning and customisation easy transparently using GRID technology application independent Developed by J. Moscicki, CERN http://cern.ch/DIANE Practical Example:  Practical Example Example: simulation with analysis The job is divided into tasks The tasks are executed on worker components Each task produces a file with histograms Job result = sum of histograms produced by tasks Master-worker model Client starts a job Workers perform tasks and produce histograms Master integrates the results Running in a distributed environment:  Running in a distributed environment Not affecting the original code of the application standalone and distributed case is the same code Good separation of the subsystems the application does not need to know that it runs in a distributed environment the distributed framework (DIANE) does not need to care about what actions an application performs internally The application developer is shielded from the complexity of underlying technology via DIANE How to dianize a G4 application:  How to dianize a G4 application Look at the Geant4 extended example: ExDIANE in the parallel directory Completely transparent to the user: same G4 code Documentation at http://www.cern.ch/diane specific for Geant4 applications Installing and compiling DIANE Compiling and running a Geant4 application through DIANE Test results:  Test results Study the performance of the execution of the dianized G4Brachy: Test on a single CPU Test on a dedicated farm (60 CPUs) Test on a farm, shared with other users (LSF, CERN) Test on the GRID Tools and libraries: Simulation toolkit: Geant4 7.0.p01 Analysis tools: AIDA 3.2.1 and PI 1.3.3 DIANE: DIANE 1.4.2 CLHEP: 1.9.1.2 G4EMLOW2.3 Results – G4Brachy: 1 CPU:  Results – G4Brachy: 1 CPU with respect to the number of events Test on a single dedicated CPU (Intel ®, Pentium IV, 3.00 GHz) Execution time with respect to the number of events of the job The overhead of DIANE is negligible in high statistics jobs Slide12:  Dedicated farm : 30 identical biprocessors (Pentium IV, 3 GHz) Thanks to Hurng-Chun Lee (Academia Sinica Grid Computing Center, Taiwan) Thanks to Regional Operation Centre (ROC) Team, Taiwan Results – G4Brachy: farm Comment:  Comment The job ends when all the tasks are executed on the workers If the job is split into a higher number of tasks, there is a higher chance that the workers finish the tasks at the same moment Example of a good job balancing Example of a job that can be improved from a performance point of view Worker number Time (seconds) Results – G4Brachy: farm (3):  Comparison Preliminary! Results – G4Brachy: farm (3) Test on LSF cluster of CERN: case of farm shared with other users The load of the cluster changes quickly in time The conditions of the test are not reproducible Results – G4Brachy: GRID (1):  Results – G4Brachy: GRID (1) The load of the GRID changes quickly in time The conditions of the test are not reproducible G4Brachy executed on the GRID on nodes located in Spain, Russia, Italy, Germany, Switzerland Execution on the GRID through DIANE, 20 M events,180 tasks, 30 workers Execution on the GRID, without DIANE Without DIANE: - 2 jobs not successfully executed due to set-up problems of the workers Through DIANE: - All the tasks are executed successfully on 22 workers - Not all the workers are initialized and used: on-going investigation Worker number Time (seconds) Worker number Time (seconds) How the GRID load changes:  How the GRID load changes Execution time of G4Brachy in two different conditions of the GRID DIANE used as intermediate layer Worker number Time (seconds) Worker number Time (seconds) 20 M events, 60 workers initialized, 360 tasks Conclusions:  Conclusions General approach to obtain quick response from Geant4 simulations Advantage of using DIANE as intermediate layer in a dedicated farm or GRID Transparency Good separation of the subsystems Good management of the CPU resources DIANE is very advantageous as an intermediate layer to the GRID from a performance point of view A quantitative analysis of the performance results is in progress Submission of this work for publication in IEEE Trans. Nucl. Sci. Acknowledgments to: M. Lamanna (CERN), Hurng-Chun Lee (ASGC, Taiwan), L. Moneta (CERN), A. Pfeiffer (CERN) Thanks to the GRID team of CERN and the Regional Operation Centre Team of Taiwan

Related presentations


Other presentations created by Javier

wap
26. 11. 2007
0 views

wap

PairashThajchayapong1
02. 01. 2008
0 views

PairashThajchayapong1

Lecture13 1
09. 10. 2007
0 views

Lecture13 1

Physical Features of Arab World
24. 10. 2007
0 views

Physical Features of Arab World

arbovirus
24. 10. 2007
0 views

arbovirus

Ch14 Lecture
29. 11. 2007
0 views

Ch14 Lecture

going in 13may02
01. 12. 2007
0 views

going in 13may02

cap3
14. 11. 2007
0 views

cap3

enfoques 4 ppt
15. 11. 2007
0 views

enfoques 4 ppt

DeafTalk
16. 11. 2007
0 views

DeafTalk

db2
19. 11. 2007
0 views

db2

REACH Overview
05. 12. 2007
0 views

REACH Overview

Romantic English Literature
14. 12. 2007
0 views

Romantic English Literature

Treaty of Versailles
23. 12. 2007
0 views

Treaty of Versailles

conman15
28. 12. 2007
0 views

conman15

intro CS 1
04. 01. 2008
0 views

intro CS 1

Radiation Concepts
04. 01. 2008
0 views

Radiation Concepts

Kryptologie Folien Web
05. 01. 2008
0 views

Kryptologie Folien Web

meld ldp iros07 talk3
07. 01. 2008
0 views

meld ldp iros07 talk3

bird
29. 10. 2007
0 views

bird

Ideal Year 2006
02. 11. 2007
0 views

Ideal Year 2006

Saggia Ecologia Presentazione
01. 10. 2007
0 views

Saggia Ecologia Presentazione

Royal Europe consumer
30. 10. 2007
0 views

Royal Europe consumer

Undergrat Presentation 2004
24. 10. 2007
0 views

Undergrat Presentation 2004

report pixel2000
01. 11. 2007
0 views

report pixel2000

Johnson 1
06. 11. 2007
0 views

Johnson 1

USA Presentation Rev 4
08. 11. 2007
0 views

USA Presentation Rev 4

Divisenko
20. 11. 2007
0 views

Divisenko

Civil Society Index Project
23. 11. 2007
0 views

Civil Society Index Project

Unit07Log
01. 11. 2007
0 views

Unit07Log

presentaz roma trieste 4
29. 10. 2007
0 views

presentaz roma trieste 4

Montana Meth Presentation
27. 12. 2007
0 views

Montana Meth Presentation

careerbuilder
20. 02. 2008
0 views

careerbuilder

Brussels 11May06
25. 10. 2007
0 views

Brussels 11May06

EDMT14
27. 02. 2008
0 views

EDMT14

pisanelli
30. 10. 2007
0 views

pisanelli

Newch6www
29. 02. 2008
0 views

Newch6www

tunnista kulutustyyppisi
05. 11. 2007
0 views

tunnista kulutustyyppisi

StratTac06 Leggett
05. 03. 2008
0 views

StratTac06 Leggett

Teela powerpoint 6
14. 03. 2008
0 views

Teela powerpoint 6

67436
27. 03. 2008
0 views

67436

dli20071
30. 03. 2008
0 views

dli20071

GEP2007
25. 10. 2007
0 views

GEP2007

hort2 floraldesign
11. 12. 2007
0 views

hort2 floraldesign

Kodal MALTA
04. 10. 2007
0 views

Kodal MALTA

bcs 03 nottingham
26. 11. 2007
0 views

bcs 03 nottingham

17 Sussex
17. 12. 2007
0 views

17 Sussex

asdc ncss for website ihc
06. 11. 2007
0 views

asdc ncss for website ihc

frieman
15. 11. 2007
0 views

frieman

Sem Grd Ontology
19. 11. 2007
0 views

Sem Grd Ontology

Underground1
06. 12. 2007
0 views

Underground1

Avape Port
16. 11. 2007
0 views

Avape Port

ceciliat2
28. 12. 2007
0 views

ceciliat2

cacti
12. 12. 2007
0 views

cacti

Attila Vitai Vodafone
26. 11. 2007
0 views

Attila Vitai Vodafone

kevin dustin
13. 11. 2007
0 views

kevin dustin

02 Italy Gorgucci
31. 10. 2007
0 views

02 Italy Gorgucci

wp4status russia2
26. 10. 2007
0 views

wp4status russia2