Transcript Slide 1
IT’10 Grid servisi prilagođeni korisnicima i digitalni identitet istraživača Services oriented towards grid users and researchers' digital identity Branko Marović Belgrade University Computing Center, Serbia [email protected] Žabljak 25.2.2010 IT’10 Žabljak 25.2.2010 Grid market IT’10 The reality for the user Many application domains start using Grid infrastructures But… Grid technology is complex Different systems are used Different programming paradigms Žabljak 25.2.2010 Middleware (Unicore, gLite, Globus) Installation (rpm, tar, Quattor, …) Monitoring Batch type systems vs. service oriented systems Many programming languages The threshold is to high for the “standard” user! IT’10 Grid application lifecycle In most cases, scientists have their application(s) They want to collaborate Žabljak 25.2.2010 Join Virtual Organisations Use infrastructure Start a Grid project Interact with the Grid without knowing all details Legacy code (FORTRAN, C, C++, …) Development, deployment, testing, management, … Tooling is necessary! IT’10 Application Users Application Developers (Scientists) (eScience) Service/Resource Providers (e-Infrastructure) Žabljak 25.2.2010 Grid project Resource Broker Computing Replica Manager Storage Applications Infrastructure Grid project Infrastructure Providers Virtual Organisations Members Programming languages Policies Service Providers Roles Domain services Batch apps Interactive apps Workflows Web services A. Gap. User Applications using Grid User Applications Grid Applications Application Users Application Developers (Grid) Middleware Resources Resource Providers IT’10 Grid angst “Grid needs to be easier to use for all of us (users and tool developers)” “the Grid is hard for users because it is complicated and the complication is not hidden (yet?)” “Don’t show me your grid – I don’t care. It should Just Work” “Horrible to install and horrible to configure.” “None are nicely integrated with existing non-grid systems-management practice.” “The interfaces are so unstable.” User Applications Žabljak 25.2.2010 Moderate Specialist High end Biologists General Physicists Many apps One-off Projects Grid Middleware IT’10 Barriers to adoption Gap between the resource providers and the application developers Infrastructure perspective - not a user perspective Grid applications instead of User applications that use a Grid Tooling is necessary! Žabljak 25.2.2010 Wizards, Editors, … Hide the complexity Agile and Rapid development Rapid assembly of content and functionality Stable, Open 3rd party Familiar and reliable abstraction Grid Web portals fulfill some, bur not all above requirements IT’10 Standards - Global Grid Forum Žabljak 25.2.2010 Community-driven set of working groups that are developing standards and best practices for distributed computing efforts Three primary functions: community, standards, and operations Standards Areas: Infrastructure, Data, Compute, Architecture, Applications, Management, Security, and Liaison Community Areas: Research Applications, Industry Applications, Grid Operations, Technology Innovations, and Major Grid Projects Community Advisory Board represents the different communities and provides input and feedback to GGF IT’10 OGSA - Open Grid Services Architecture OGSA Grid Technologies Žabljak 25.2.2010 Web Services Integrates grid technologies with Web Services WS-Resource Framework - interact with stateful resources “OGSA enables the integration of services and resources across distributed, heterogeneous, dynamic, virtual organizations – whether within a single enterprise or extending to external resource-sharing and service-provider relationships.” IT’10 The g-Eclipse project EC STREP, 24 months, 2 M€, 6 Partners http://www.geclipse.eu Eclipse based framework for other EC Grid projects and Using EGEE infrastructure Middlewares Žabljak 25.2.2010 gLite GRIA Amazon cloud Webservices (AWS): Elastic Compute Cloud (EC2), the Simple, Storage Service (S3), SimpleDB and the Simple QueueService (SQS) UNICORE, Globus Toolkit? Open for contributions - integration support for third party developments Fostering an open source project within the Eclipse community Screenshots I Grid project view Cheat Sheets Editor Auth Token View Glue Info view VOMS Web view IT’10 DGI D-Grid Middleware Infrastructure Generic Grid infrastructure for German research communities User Application Development and User Access GAT API GridSphere Nutzer Scheduling Workflow Management High-level Grid Services Monitoring Data management Basic Grid Services Plug-In UNICORE LCG/gLite Accounting Billing User/VO-Mngt Globus 4.0.1 Security Žabljak 25.2.2010 Resources in D-Grid Distributed Data Archive Data/ Software Network Infrastructur Distributed Compute Resources IT’10 Steps in using the Grid Žabljak 25.2.2010 Get a Grid certificate Join VO Start using the Grid by creating simple jobs Consult with local and regional experts (SEE-GRID community) Exchange information with users sharing your interests Built upon available tools and services Gridify your applications Use available Grid resources Consider providing your resources as a grid site SEEGRID-SCI JRA1 4 0 0 10 4 0 0 30 0 0 10 4 4 0 0 66 4 0 0 4 4 4 4 0 4 4 4 10 0 4 0 46 4 0 0 10 10 0 4 0 0 0 0 0 4 0 4 36 4 0 0 4 4 0 4 0 4 0 0 4 0 4 0 28 10 0 0 4 4 0 4 0 0 30 4 4 0 10 4 74 10 0 0 0 0 0 4 0 0 0 4 4 0 0 10 32 4 0 0 4 10 30 4 30 30 0 4 10 0 0 10 136 4 0 0 4 30 0 4 0 0 0 4 4 0 0 10 60 Total 0 30 30 4 0 0 30 0 0 0 0 0 30 30 0 154 Work Binder Event Logger ESIP 10 0 0 30 4 0 0 0 0 0 0 0 0 0 0 44 UPM 25.2.2010 4 10 4 4 4 0 10 0 0 0 0 4 0 4 4 48 SDSAS Žabljak CHERS ELF FPS GreenView Lizza-PAKP MCSAES MDSSP-WA MSACM MSERRHSA NMMC3D REFS RESEWA SDS SRA WRF-ARW Total DM-Web Application AWT AS RAS P-GRADE Portal Capture commonalities across scientific fields in terms of application requirements on Grid middleware Define development areas for middleware plug-ins and application-level services to cater to application demands and provide improvements to current infrastructure services Implement application-specific services and middleware extensions MEWS FM-J-API IT’10 58 40 34 78 74 34 68 60 38 34 30 44 38 52 42 IT’10 Grid - Vehicle for Scientific Collaboration Researchers collaborate through grid virtual organizations Partnerships are built though sharing of resources, data, and work Grid certificates become researchers’ digital IDs Žabljak 25.2.2010 EUGridPMA SEE-GRID CA MREN CA TERENA Certificate Service (TCS) provides eScience Personal Certificates accredited by the EUGridPMA