Transcript UI-GRID
INherent/INdonesia GRID Bobby Nazief, Ph.D. [email protected] GCRG@CSUI Grid Computing Research Group FASILKOM – University of Indonesia Agenda Komputasi Grid: Motivasi, Konsep, Cakupan Proyek-proyek Pengembangan Komputasi Grid di Dunia inGRID Jul-15 Motivasi, Arsitektur, Spesifikasi Teknis, Rencana SUN HPC GRID Seminar 1 Komputasi Grid: Model Operasional Severs NCSA Cluster (225 CPU) Client (AIST) Severs AIST Cluster (50 CPU) Titech Cluster (200 CPU) KISTI Cluster (25 CPU) Jul-15 SUN HPC GRID Seminar 2 Quality, economies of scale Komputasi Grid: Motivasi Decouple production & consumption, enabling On-demand access Economies of scale Consumer flexibility New devices Time Jul-15 SUN HPC GRID Seminar 3 Komputasi Grid: Konseptual “Resource sharing & coordinated problem solving in dynamic, multi-institutional virtual organizations” 3 1 Jul-15 2 SUN HPC GRID Seminar 4 Komputasi Grid: Cakupan Cluster Grid Jul-15 Enterprise Grid SUN HPC GRID Seminar Global Grid 5 Proyek-proyek Pengembangan Komputasi Grid Many Grid development efforts — all over the world •UK e-Science Grid •NASA Information Power Grid •Netherlands – VLAM, PolderGrid •DOE Science Grid •Germany – UNICORE, Grid proposal •NSF National Virtual Observatory •France – Grid funding approved •NSF GriPhyN •Italy – INFN Grid •DOE Particle Physics Data Grid •Eire – Grid proposals •NSF TeraGrid •Switzerland - Network/Grid proposal •DOE ASCI Grid •Hungary – DemoGrid, Grid proposal •DOE Earth Systems Grid •Norway, Sweden - NorduGrid •DARPA CoABS Grid •DataGrid (CERN, ...) •NEESGrid •EuroGrid (Unicore) •DOH BIRN •DataTag (CERN,…) •Astrophysical Virtual Observatory •NSF iVDGL •GRIP (Globus/Unicore) •GRIA (Industrial applications) •GridLab (Cactus Toolkit) •CrossGrid (Infrastructure Components) •EGSO (Solar Physics) Jul-15 SUN HPC GRID Seminar 6 NEES (Network for Earthquake Engineering Simulation) Collaboratory U.Nevada Reno www.neesgrid.org Jul-15 SUN HPC GRID Seminar 7 NEESgrid at Work UIUC Experimental Model U. Colorado Experimental Model NCSA Computational Model m1 f1 f2 f1 f2 m1 xg Jul-15 xg x g SUN HPC GRID Seminar 8 Inisiatif Komputasi Grid di Negara Tetangga Thailand – ThaiGrid Singapore – NGP (National Grid Project) Proposal “National Technology Roadmap for Grid Computing” diajukan ke MOSTI (inisiator: MIMOS Berhad, th. 2005) Forum-forum Regional: Jul-15 Dimulai pada bulan September 2002 3 univ., 5 kementrian (MOE, MOH, MITA, MINDEF, MTI) Malaysia Dimulai pada tahun 2002 Pendanaan: $ 6M (3 tahun) 10 univ., Weather Forecast Services, NECTEC 158 CPUs SEA Grid Forum (3 negara) ApGrid (14 negara) SUN HPC GRID Seminar 9 inGRID: INHERENT/INDONESIA GRID Ide RI-GRID: Usulan Pengembangan Infrastruktur Komputasi Grid Nasional, Mei 2006 Bagian PHK INHERENT K1 UI ”Menuju Kampus Dijital: Implementasi Virtual Library, Grid Computing, Remote-Laboratory, Computer Mediated Learning, dan Sistem Manajemen Akademik dalam INHERENT,” Sep ’06 – Mei ‘07 Tujuan: Membangun infrastruktur komputasi grid di INHERENT dengan kapasitas sumber daya komputasi awal sebesar 32 prosesor (~ Intel Pentium IV) dan 1 TB Jul-15 Kapasitas ini diharapkan bertambah dengan bergabungnya sumber daya komputasi lainnya di INHERENT lainnya Membangun komunitas e-Science di Indonesia. SUN HPC GRID Seminar 10 INHERENT: Indonesia Higher Education Network Jul-15 SUN HPC GRID Seminar 11 Motivasi inGRID Tersedianya infrastruktur jaringan komputer nasional (INHERENT) Semakin matangnya perangkat lunak komputasi grid Kedua hal di atas memungkinkan pembangunan infrastruktur komputasi berkapasitas besar dan tidak mahal bertahap kolaboratif Infrastruktur komputasi berkapasitas besar dibutuhkan dalam pengembangan e-Science Jul-15 SUN HPC GRID Seminar 12 e-Science The term e-Science (or eScience) is used to describe computationally intensive science that is carried out in highly distributed network environments, or science that uses immense data sets that require grid computing [John Taylor] Bioinformatics (study of the human genome and proteome to understand genetic diseases) Nanotechnology (design of new materials from the molecular scale) Natural Resources and the Environment (weather forecasting, earth observation, modeling and prediction of complex systems) Business (commercial data center, pay-per-use computing) Jul-15 SUN HPC GRID Seminar 13 Arsitektur inGRID inGRID PORTAL User U* Globus Head Node User Windows/x86 Cluster INHERENT Linux/x86 Cluster Solaris/x86 Cluster Jul-15 UI I* Globus Head Node Globus Head Node Linux/Sparc Cluster Custom PORTAL SUN HPC GRID Seminar 14 Spesifikasi Teknis: H/W inGRID Portal Globus Head Node SUN Fire X2100, AMD Opteron Processor (2.2 GHz, dual core), 1 GB Memory, 80 GB Disk, 2 10/100/1000 Mbps NICs, DVD-ROM Drive Linux Cluster (16 simpul) SUN Fire X2100, AMD Opteron Processor (2.4 GHz, dual core), 2 GB Memory, 80 GB Disk, 2 10/100/1000 Mbps NICs, DVD-ROM Drive SUN Fire X2100, AMD Opteron Processor (2.2 GHz, dual core), 1 GB Memory, 80 GB Disk, 2 10/100/1000 Mbps NICs Storage Server Jul-15 Dual Xeon Processor (3.0GHz), 2 GB Memory, 1 TB Disk SUN HPC GRID Seminar 15 Spesifikasi Teknis: S/W Antar-Muka Pengguna: Globus Toolkit Jul-15 Blast Computer Graphic: Gromach Biologi: Sun Grid Engine (SGE) Lingkungan Pemrograman: Kimia: Job Scheduler: Aplikasi Middleware UCLA Grid Portal Povray Utilities: C, Java Paralel: MPICH SUN HPC GRID Seminar Perkalian Matriks, Sort, Octave (Matlab-like) 16 Globus Toolkit™ Kumpulan perangkat lunak yang mendukung komputasi grid, dengan komponen-komponen utama: GSI: Grid Security Infrastructure single sign-on, authentication, authorization, secure data transfer GRAM: Grid Resource Allocation & Management remote job submission & management RFT/GridFTP: Reliable File Transfer secure & robust data movement MDS: Monitoring & Discovery Service directory services of available resources & their status API untuk mengakses komponen-komponen di atas Lingkungan pemrograman (C header files) untuk membangun program-program berbasis grid Jul-15 SUN HPC GRID Seminar 17 inGRID: Alur Kendali Jul-15 SUN HPC GRID Seminar 18 inGRID: Portal http://grid.ui.ac.id/portal Jul-15 SUN HPC GRID Seminar 19 inGRID: Data Management Jul-15 SUN HPC GRID Seminar 20 inGRID: Job Management Jul-15 SUN HPC GRID Seminar 21 inGRID: Application Management Jul-15 SUN HPC GRID Seminar 22 inGRID: Resource Management Jul-15 SUN HPC GRID Seminar 23 Rencana Pengembangan Membangun komunitas pengguna/e-Science (silakan mendaftar di http://grid.ui.ac.id/ingrid/pendaftaran) Menambah koleksi aplikasi Meningkatkan kapasitas sumber daya komputasi (menghubungkan cluster-cluster komputer di PT-PT lainnya) Mengembangkan lingkungan pemrograman komputasi paralel/terdistribusi (Workflow, Ninf, dst.) Mengembangkan portal-portal komputasi grid yang disesuaikan pada kebutuhan komunitas penggunanya (“ChemGrid”, “BioGrid”, dst.) Jul-15 SUN HPC GRID Seminar 24 Beberapa Sumber Informasi Situs Grid Computing Research Group – FASILKOMUI: http://grid.ui.ac.id/ blog pengembangan: http://grid.ui.ac.id/blog Milis inGRID: [email protected] berlangganan: http://news.ui.ac.id/cgibin/mailman/listinfo/ingrid arsip:http://news.ui.ac.id/pipermail/ingrid/ Globus Alliance: http://www.globus.org/ Open Grid Forum: http://www.ogf.org/ Jul-15 SUN HPC GRID Seminar 25 Daftar Referensi Yoshio Tanaka, Asia Pacific Grid: Towards a production Grid Bart Jacob, Grid computing: What are the key components?, June, 2003 Ian Foster, Grid Computing: Concepts, Applications, and Technologies, Tutorial at Grid Computing in Canada Workshop, Edmonton, May 1, 2002 Ian Foster, Introduction to the Grid, COMDEX 2003, Las Vegas, Nevada USA, November 18, 2003 Ian Foster, Globus Toolkit version 4, Tutorial, 1st Intl. Conf. on e-Science and Grid Computing, Melbourne, Australia, December 12, 2005 Bobby Nazief, RI-GRID: Usulan Pengembangan Infrastruktur Komputasi Grid Nasional, e-Indonesia Initiative, Bandung, Mei, 2006 Jul-15 SUN HPC GRID Seminar 26