brown ligo

Information about brown ligo

Published on November 29, 2007

Author: Rafael

Source: authorstream.com

Content

Using Condor for Large Scale Data Analysis within the LIGO Scientific Collaboration:  Using Condor for Large Scale Data Analysis within the LIGO Scientific Collaboration Duncan Brown California Institute of Technology LSC Condor Usage:  LSC Condor Usage The LIGO Scientific Collaboration is an international effort to detect gravitational waves Condor is heavily used by the LSC for data analysis 8 LSC Condor Pools with 2000 CPUs California Institute of Technology, LIGO Hanford Observatory, LIGO Livingston Observatory, UW-Milwaukee, University of Birmingham (UK), University of Cardiff (UK), Massachusetts Institute of Technology, AEI Over 100 users from various LSC institutions Scientific Results Produced with Condor:  Scientific Results Produced with Condor Four LSC working groups analyze data for different sources Pulsar Analysis Group Setting upper limits on the strength of periodic gravitational waves using the first science data from the GEO600 and LIGO detectors (Phys. Rev. D69 (2004) 082004) Limits on gravitational wave emission from selected pulsars using LIGO data (Submitted to Phys. Rev. Lett.) Inspiral Analysis Group Search for binary neutron star coalescences in the Local Group of galaxies (in preparation) Search for Gravitational Waves from Primordial Black Hole Binary Coalescence in the Galactic Halo (in preparation) Burst Analysis Group Upper Limits on Gravitational Wave Bursts in LIGO’s Second Science Run (in preparation) Stochastic Analysis Group Upper Limits on a Stochastic Background of Gravitational Waves (in preparation) How do we use Condor?:  How do we use Condor? Using clusters of jobs to perform parameter sweeps Use Condor DAGMan to manage complex workflows LIGO data comes from three detectors Construct DAGs to describe “coincident” and “coherent” workflows Written a set of Python classes to allow simple construction of complex DAGs Working with Pegasus group (ISI) to use Condor-G to access GRID computing resources LSC Software Stack is built on top of VDT Example of a LIGO Inspiral DAG:  Example of a LIGO Inspiral DAG Things we like…:  Things we like… Standard Universe job checkpointing DAGMan workflow management Robustness for long running jobs and DAGs User priority load balancing Level of support from Condor Team Things we would like…:  Things we would like… Reduce the load on our negotiators Many short jobs (~ 1 hour) on large clusters can stress the negotiation cycle Scheduling jobs submitted by DAGMan is intensive Expansion of Standard Universe support Separation of standard universe file I/O from checkpointing Ability to run compiled Matlab code in standard universe Database back end to Condor Quill sounds very interesting!

Related presentations


Other presentations created by Rafael

specsavers
07. 11. 2007
0 views

specsavers

The Great Years 1945 1965
28. 12. 2007
0 views

The Great Years 1945 1965

20 best practices
01. 10. 2007
0 views

20 best practices

ArcSpiral
24. 10. 2007
0 views

ArcSpiral

fg04
28. 11. 2007
0 views

fg04

TD10 WS item6 IssuesNGN IMS
28. 11. 2007
0 views

TD10 WS item6 IssuesNGN IMS

independence
07. 12. 2007
0 views

independence

plant types
11. 12. 2007
0 views

plant types

inf emerg arih 29092005
25. 10. 2007
0 views

inf emerg arih 29092005

BowcockNewZealand
30. 10. 2007
0 views

BowcockNewZealand

8thICSR 286 Gurrieri310806
31. 10. 2007
0 views

8thICSR 286 Gurrieri310806

westnilevirus 071205
24. 10. 2007
0 views

westnilevirus 071205

lecture8
14. 11. 2007
0 views

lecture8

16 ProductBrandMgmt1
16. 11. 2007
0 views

16 ProductBrandMgmt1

dorian
19. 11. 2007
0 views

dorian

1TTplan2
17. 12. 2007
0 views

1TTplan2

ShipOrg
05. 11. 2007
0 views

ShipOrg

Word 2002 tut05 edited
06. 12. 2007
0 views

Word 2002 tut05 edited

Vegetation Presentation
07. 01. 2008
0 views

Vegetation Presentation

the punic wars
31. 10. 2007
0 views

the punic wars

s433 bu
29. 10. 2007
0 views

s433 bu

Egypt3 25 05
22. 11. 2007
0 views

Egypt3 25 05

abc5lc
27. 12. 2007
0 views

abc5lc

Hurault PlantetPresentation
01. 11. 2007
0 views

Hurault PlantetPresentation

CHI2006 sgaw
04. 01. 2008
0 views

CHI2006 sgaw

Lindroos beta beam MWATT
25. 10. 2007
0 views

Lindroos beta beam MWATT

trill 4
28. 12. 2007
0 views

trill 4

Arvind Singhal1
20. 02. 2008
0 views

Arvind Singhal1

L4 Community
24. 02. 2008
0 views

L4 Community

CSULB SCAG Forecast
27. 02. 2008
0 views

CSULB SCAG Forecast

Developing a Healthy Lifestyle
05. 03. 2008
0 views

Developing a Healthy Lifestyle

Pierre Rolin
14. 03. 2008
0 views

Pierre Rolin

Paradox
03. 10. 2007
0 views

Paradox

Lerch
30. 03. 2008
0 views

Lerch

2007 GameOn
06. 11. 2007
0 views

2007 GameOn

Kubalkeynote507LasVe gas
13. 04. 2008
0 views

Kubalkeynote507LasVe gas

celadrin
19. 11. 2007
0 views

celadrin

Vegetation of Little Cayman
02. 01. 2008
0 views

Vegetation of Little Cayman

NFerrari
03. 12. 2007
0 views

NFerrari

LeeSchoolPowerPoint01
14. 11. 2007
0 views

LeeSchoolPowerPoint01

PhenixDanceDemo
28. 11. 2007
0 views

PhenixDanceDemo

510863 CrossCheck
28. 11. 2007
0 views

510863 CrossCheck

LYMAN
31. 10. 2007
0 views

LYMAN

13 genetica di popolazione
03. 01. 2008
0 views

13 genetica di popolazione

2001 10 31 Finger Search
02. 11. 2007
0 views

2001 10 31 Finger Search

menten
15. 11. 2007
0 views

menten

bhattacharyya
29. 11. 2007
0 views

bhattacharyya

ovdza5bxdivpc7y
25. 10. 2007
0 views

ovdza5bxdivpc7y

LMallon05022007
06. 11. 2007
0 views

LMallon05022007

vylkan1
09. 10. 2007
0 views

vylkan1

Present Paola
18. 12. 2007
0 views

Present Paola

XLM H
13. 12. 2007
0 views

XLM H

potapova etal iafpa2006
27. 09. 2007
0 views

potapova etal iafpa2006

ParentsandPeersTPP
28. 12. 2007
0 views

ParentsandPeersTPP

57011 Week1 Slides
26. 11. 2007
0 views

57011 Week1 Slides