TG Cobb

Information about TG Cobb

Published on November 26, 2007

Author: Tatlises

Source: authorstream.com

Content

TeraGrid Overview: National Scale Cyberinfrastructure for Science:  TeraGrid Overview: National Scale Cyberinfrastructure for Science John W. Cobb TeraGrid Project (ORNL Resource Provider PI) Oak Ridge National Laboratory May, 11 2006 Opinions are Cobb’s Alone However, many slides stolen from collaborators However, many slides borrowed from collaborators Discussion concerns TeraGrid at large. What is an Elephant?:  What is an Elephant? “The Blind Men and the Elephant” - Indian folktale retold in poetic form by Godfrey Saxe What is the TeraGrid? (And what is CI?):  What is the TeraGrid? (And what is CI?) And More!: - Viz - Facilities - Data collections … It’s a Grid! It’s Storage! It’s a Common Software Environ! It’s a Network! They are HPC Centers! It’s Apps and Support! It was six men of Indostan, To learning much inclined, Who went to see the elephant, (Though all of them were blind), That each by observation Might satisfy his mind. WWW.TERAGRID.ORG TeraGrid Resources:  TeraGrid Resources The first approached the elephant, And happening to fall Against his broad and sturdy side, At once began to bawl: "God bless me! But the elephant Is very like a wall!" PetaFlops coming soon! TeraGrid Network (10-30 Gbps):  TeraGrid Network (10-30 Gbps) The second, feeling of the tusk, Cried: "Ho! What have we here, So very round and smooth and sharp? To me 'tis very clear, This wonder of an elephant Is very like a spear!" TeraGrid Support and Apps:  TeraGrid Support and Apps Common Support Model Allocations proposal and review – POPS (PACI legacy) Common Ticketing systems (Repurposed from Center’s program) Common account creation system. Common usage reporting “TeraGrid roaming” ability to run on any TeraGrid resource Coordinated security and incident playbook Advanced support via ASTA program Outreach to new communities via Science Gateways Program Outreach to new communities via EOT program. LORA – Learn Once Run Anywhere The third approached the animal, And happening to take The squirming trunk within his hands, Thus boldly up and spake: "I see," quoth he, "the elephant Is very like a snake! TeraGrid Support and Apps:  TeraGrid Support and Apps Common Support Model Allocations proposal and review – POPS (PACI legacy) Common Ticketing systems (Repurposed from Center’s program) Common account creation system. Common usage reporting “TeraGrid roaming” ability to run on any TeraGrid resource Coordinated security and incident playbook Advanced support via ASTA program Outreach to new communities via Science Gateways Program Outreach to new communities via EOT program. LORA – Learn Once Run Anywhere The third approached the animal, And happening to take The squirming trunk within his hands, Thus boldly up and spake: "I see," quoth he, "the elephant Is very like a snake! See Scott @ 11:00 User Needs Analysis Drives Staff Effort:  User Needs Analysis Drives Staff Effort Remote File Read/Write High-Performance File Transfer Coupled Applications, Co-scheduling Advanced Reservations Grid Portal Toolkits Grid Workflow Tools Batch Metascheduling Global File System Client-Side Computing Tools Batch Scheduled Parameter Sweep Tools Partners in Need (breadth of need) Overall Score (depth of need) Data Grid Computing Science Gateways In-depth discussions result with 16 TeraGrid user teams (August 2004). GPFS pilot at SDSC. NCSA, ANL TGCP GridFTP in production Manual co-scheduler in production; GUR pilot Evaluating portal toolkits from SGW partners Evaluating workflow toolkits in SGW projects Moab pilot; evaluating other approaches (e.g. GRMS); implementing information services to support schedulers GPFS pilot GridShell pilot Manual advanced reservations in production See Pancake @ 10:30 Separate TeraGrid wide audience user survey in 2005 Storage:  Storage Globus Toolkit GridFTP deployed at all sites. Transfer files from site to site for stage in, stage out , and multi-site runs. Performance varies site to site. Sustained 22 Gb/s transfer rates demonstrated at SCxy to win Bandwidth challenges. ~100 of MB/s not unrealistic for novice use of TeraGrid provided tuned transfer tool (TGCP) GPFS WAN service (at SDSC) in Production. > 500TB of spinning storage available to Wide area. Seeing 7 GB/s across machine room, 2-3 GB/s SDSC-NCSA. Demonstrating in many cases, “access to global file systems faster than access to local storage.” Lustre WAN Pilot The fourth reached out an eager hand, And felt about the knee. "What most this wondrous beast is like Is might plain," quoth he; "Tis clear enough the elephant Is very like a tree." It’s a Common Software Environment:  It’s a Common Software Environment Common TeraGrid Software and Services (CTSS) installed on all RP resources. Uses can reasonable expect certain advanced infrastructure services to be present at any TeraGrid resource CTSS V2 in production now. (http://www.teragrid.org/userinfo/guide_software_exp.html) CTSS V.3 in production in Summer of 2006 CTSS V.3 includes Globus Toolkit 4.0 CTSS evolves to support inter-grid collaboration (VDT for OSG) The fifth, who chanced to touch the ear, Said: "E'en the blindest man Can tell what this resembles most: Deny the fact who can, This marvel of an elephant Is very like a fan." It’s a Grid:  It’s a Grid Traditional Grid tools deployed Support Roaming (pick your CPU after you develop your code) Pick best platform from architecture portfolio for your code (or parts of your code – EX: SCEC ) http://www.teragrid.org/news/news05/terashake.html In some instances (algorithms with high latency tolerance) conduct cross-site runs – EX: NEKTAR Remote resource utilization Inter-grid VO operation The sixth no sooner had begun About the beast to grope, Than seizing on the swinging tail That fell within his scope, "I see," quoth he, "the elephant Is very like a rope." How Useful is it?:  How Useful is it? And so these men of Indostan Disputed loud and long, Each in his own opinion Exceeding stiff and strong. Though each was partly right, All were in the wrong. Results of 2005 User Survey- High We are useful CI – Not a Platypus Facility Integration: Spallation Neutron Source:  Facility Integration: Spallation Neutron Source Large science facility Large Cost: $1.4 Billion Large user base: expected ~2000 users at steady state Large Science impact: Materials Nano-Technology Biology Earth Science Chemistry Polymer Science Challenge: How-to apply CI to leverage science output: Value proposition. SNS Construction Site:  SNS Construction Site SNS Construction Complete: :  SNS Construction Complete: SNS Construction Complete: 2:05:  SNS Construction Complete: 2:05 SNS Construction Complete: 4/28 2:04:  SNS Construction Complete: 4/28 2:04 SNS Construction Complete: 3:29:  SNS Construction Complete: 3:29 SNS Construction Complete: 3:49 :  SNS Construction Complete: 3:49  SNS CD4 Results:  SNS CD4 Results DOE level 1 Milestones met Protons on target neutron production efficiency facility readiness Due June -2006, achieved 4/28/2006 Project completed on schedule and on budget! 4/28 morning full off Gremlins. First beam on target shifted from 8:00 AM to 2:06 PM Planned shakedown run of 4 days completed in 2 hours Champagne Celebration at 5:00 PM – It was a good day! Portal Data Browser Showing CD-4 Data:  Portal Data Browser Showing CD-4 Data ISAW Plot metadata NeXus Files NeXus tags MCA Data SNS Operational Ramp-up:  SNS Operational Ramp-up SNS Instrument Profile:  SNS Instrument Profile Models for CI development:  Models for CI development Question: How to initiate CI Build out? Answers should address: How these arrangements scale? Ignition Level of investment before reaching self-sustaining stage Where to book investment costs Possible Answers: NSF pays all freight (never self-sustaining) Pure Grassroots (no ignition) Federated cost sharing (who are the partners? What is the split?) Combinations of above and others Role of Networking for CI (opinion):  Role of Networking for CI (opinion) Use case requirements should drive network deployment plans, but this often unavoidably inverted. Context: National glass infrastructure access now possible in Research and Education via “buying clubs” Many RON efforts exist. Future may see RON’s linked with national scale integration (for R&E) Rich networks will need to show useful applications. (Technology push Scenario, not demand pull) Tipping Point: anticipating what is possible and needed before it is know all for sure. Next steps: my guess: Storage at the ends of the pipes Questions?:  Questions? [email protected] http://www.teragrid.org http://www.sns.gov

Related presentations


Other presentations created by Tatlises

Terms
20. 11. 2007
0 views

Terms

healthy eating
04. 12. 2007
0 views

healthy eating

indiafiscal
13. 04. 2008
0 views

indiafiscal

Chp4  Agg  Demand  Powerpoint
10. 04. 2008
0 views

Chp4 Agg Demand Powerpoint

CJUExpansion
09. 04. 2008
0 views

CJUExpansion

wk10 3351 sp04
07. 04. 2008
0 views

wk10 3351 sp04

proWellnessJapan
30. 03. 2008
0 views

proWellnessJapan

07 orient fap
27. 03. 2008
0 views

07 orient fap

0711032
26. 03. 2008
0 views

0711032

tobiet
21. 03. 2008
0 views

tobiet

Dotlacil INTREG COOP NET
18. 03. 2008
0 views

Dotlacil INTREG COOP NET

Petri Ruutu
14. 03. 2008
0 views

Petri Ruutu

cdeday2 jfcom jie
01. 10. 2007
0 views

cdeday2 jfcom jie

Obuasi Presentation 16to28
06. 12. 2007
0 views

Obuasi Presentation 16to28

oto uretim
16. 11. 2007
0 views

oto uretim

The Thirteen Colonies
23. 11. 2007
0 views

The Thirteen Colonies

selfTraining
17. 12. 2007
0 views

selfTraining

myspace
19. 12. 2007
0 views

myspace

Introduction to Flex 2
28. 11. 2007
0 views

Introduction to Flex 2

Session3A Kiell
25. 12. 2007
0 views

Session3A Kiell

GMP water system
02. 01. 2008
0 views

GMP water system

roots innursery
04. 01. 2008
0 views

roots innursery

Intervention case
04. 01. 2008
0 views

Intervention case

Lec 4
16. 11. 2007
0 views

Lec 4

RP 060xxx RAN 4 report
29. 12. 2007
0 views

RP 060xxx RAN 4 report

SPATIAL PLANNING ENERGY
02. 11. 2007
0 views

SPATIAL PLANNING ENERGY

Henry V
24. 02. 2008
0 views

Henry V

PRESENT robot
04. 01. 2008
0 views

PRESENT robot

ParousCAA 4
03. 12. 2007
0 views

ParousCAA 4

Jains
12. 03. 2008
0 views

Jains

MCCLecture21
21. 11. 2007
0 views

MCCLecture21

marlatt mbrpoverview2
10. 12. 2007
0 views

marlatt mbrpoverview2

PP Dovvens
28. 12. 2007
0 views

PP Dovvens

LPN9
28. 12. 2007
0 views

LPN9

MonaHoral
28. 11. 2007
0 views

MonaHoral

2005 RASCAL POSTERS
14. 11. 2007
0 views

2005 RASCAL POSTERS

CORNELL Status of Latinos
06. 11. 2007
0 views

CORNELL Status of Latinos

CornerstonesPpoint
03. 10. 2007
0 views

CornerstonesPpoint

brian roughan rcs surveillance
07. 01. 2008
0 views

brian roughan rcs surveillance

konno qm2006 final version
10. 10. 2007
0 views

konno qm2006 final version

georgi MIT sm
01. 11. 2007
0 views

georgi MIT sm