Grid Colombia Workshop Rob Gardner Grid Colombia Workshop Preview October 14, 2009 Outline • The Open Science Grid (OSG) • Plans for the Grid Colombia.
Download ReportTranscript Grid Colombia Workshop Rob Gardner Grid Colombia Workshop Preview October 14, 2009 Outline • The Open Science Grid (OSG) • Plans for the Grid Colombia.
Grid Colombia Workshop Rob Gardner Grid Colombia Workshop Preview October 14, 2009 Outline • The Open Science Grid (OSG) • Plans for the Grid Colombia workshop • Questions and input from you 2009 Grid Colombia Workshop Preview 2 OSG: The Open Science Grid provides a cross-domain self-managed national distributed high-throughput computing facility… that brings together campus and community infrastructures at all scales… to provide services, support and facilitate the needs of scientific and research communities at all scales… Does not own processing, storage, networking hardware. Does not develop software. 2009 Grid Colombia Workshop Preview 3 OSG: Project & Consortium • A Consortium with more than 100 institutions of Scientists, IT and Software Providers. • A 5 year funded project ($6M/yr) across NSF and DOE SciDAC-2 with staff at 16 institutions. • Staff provides all aspects of the core distributed facility: software, operations, user and administrator support, security, training, collaboration with peers. 2009 Grid Colombia Workshop Preview 4 OSG: Project & Consortium • Consortium members make significant contributions. • Most active are Physics Collaborations: HEP, NP, LIGO, who are prepared to collaborate with and support other programs and disciplines. • Active partnerships with European projects, ESNET, Internet2, Condor, Globus… 2009 Grid Colombia Workshop Preview 5 Virtual Organizations OSG works with Virtual Organizations or Communities There are 30 VOs in OSG spanning scientific, regional, campus, international and education, There are specific “OSG owned VOs” to accommodate individual users 2009 Grid Colombia Workshop Preview 6 OSG Resource Maps Production resources Integration testbed 2009 Grid Colombia Workshop Preview 7 OSG Site Monitoring 2009 Grid Colombia Workshop Preview 8 Why are we doing this? • We see OSG as driving partner in the development in the national cyberinfrastructure in the U.S. • The landscape is complex – we’re still figuring it out… 2009 Grid Colombia Workshop Preview 9 National Science Foundation Landscape – Ed Seidel, Feb 2009 2009 Grid Colombia Workshop Preview 10 …However, at a certain altitude the vision is clear… 2009 Grid Colombia Workshop Preview 11 OSG Production by Users (30 day) 2009 Grid Colombia Workshop Preview 12 OSG Production by Users (1 year) 2009 Grid Colombia Workshop Preview 13 OSG Production by VO 2009 Grid Colombia Workshop Preview 14 OSG Cumulative CPU hours delivered 2009 Grid Colombia Workshop Preview 15 OSG Site Reliability – by WLCG 2009 Grid Colombia Workshop Preview 16 Throughput & Networking – Ex leveraging other projects • Implement a consistent perfSONAR infrastructure (leverage Internet2 tools) • Implement standard dataset for disk-to-disk tests between sites • Work with I2 and Esnet for dedicated T1-T2 circuits • Continue establishing performance benchmarks 200/400 MB/s T1T2, >GB/sT1multi-T2 • Iterate on all the above as needed 2009 Grid Colombia Workshop Preview 17 Network monitoring infrastructure 2009 Grid Colombia Workshop Preview 18 Launching a Grid Colombia • Phase I: preparations in advance of the in-person workshop • Phase II: workshop on scientific computing on Grids and Grid prototype building (that’s this workshop!) Development of a program of work • Phase III: deployment of production facilities across multiple sites in Colombia 2009 Grid Colombia Workshop Preview 19 First Week • Focus is on scientific computing on grids • Will have a practical, hands-on component for users 2009 Grid Colombia Workshop Preview 20 Second Week • Focus on building a prototype Grid Colombia • Will divide into teams: Site builders Build a small cluster with Condor, an OSG compute element, storage element (GridFTP), worker nodes, a grid user management system GOC team Install, configure, validate central “goc”-like services such as an information system 2009 Grid Colombia Workshop Preview 21 Discussion, Questions • Questions? Thoughts? Comments? • More info, see: https://twiki.grid.iu.edu/bin/view/ReleaseDocume ntation/GridColombiaWorkshop2009 • We (Jose, Rob) look forward to meeting you in person – others (Suchandra, Marco, and OSG Integration staff) will “meet” you virtually 2009 Grid Colombia Workshop Preview 22