Transcript Document
1 Grid-enabled Remote Instrumentation with Distributed Control and Computation (GRIDCC) A realtime interactive GRID to integrate instruments, computational and information resources widely spread on a fast WAN Project Coordinator: INFN GM, MIlano, 19 March 2004 2 Main Aims • The design, realization and deployment of an interactive GRID able to integrate: – the interactive and real-time management (process control, remote operation - tele-presence -, data acquisition) of remote instrumentations (e.g. temperature probes or an array of telescopes) distributed over a geographical network – The distributed computational resources needed to the real time data processing and storage – The graphical visualization of the data acquired or analyzed. – Real-time analysis of patterns produced by the grid enabled instruments to provide on-line diagnostics of their functioning and possible automatic actions to fix the problems. GM, MIlano, 19 March 2004 3 • • • • Application Fields Experimental Sciences – Take control of a experiment from a distance (remote operation and control, data taking and data analysis): • High Energy, Nuclear and Solid State Physics • Electronic Microscopes • Telescopes Monitoring and analysis of the territory (e.g. disaster analysis) – Meteorology – Geophysics Bio-medics – Integration of remote operation, data taking, data analysis and data storage of sophisticated instruments like: • Mammography • Pet, TAC, NMR etc. Industrial Applications – widely distributed controls • Electrical power grid • Public transportation • …… GM, MIlano, 19 March 2004 Instr. Instr. GRIDCC Layout Instr. Instr. Web Instr. Cams Virtual Instrument Grid Services User Interface Virtual Control Room User Interface User Interface Farm Services Instr. Instr. DBs Instr. Instr. Farm 4 Storage Services Diagnostic Service Test Bed Grid Infrastructure Problem Solver Service Data Mining Tool Virtual Control Room Knowledge based Services Video Conf. & Chat Service Cooperative Environment GM, MIlano, 19 March 2004 Security & login Service Information Service (Monitor) Work Flow Engine Service Resource Service Job Control Supporting Services 5 Working Package List • WP1: System Architecture – Overall system architecture. Definition of the QoS parameters needed for a network infrastructure where real time and interactive services are used. • WP2: Real-time and Interactive web services middleware – Extending web service based middleware into interactive and real time computing. • WP3: Grid-Enabled Instrumentation - Development of generic Virtual Instrument Service (VIS). Development of the all Supporting Services needed to catalog, configure, monitoring, analyze errors, fixing automatically problems and finally read out the Grid-enabled instrument resources. • WP4: Brokering access to existing Grid resources - Controlling access to gridified resources according agreed levels of service and providing mechanisms for determining and organising complex workflows. • WP5: Cooperative Environment - Design and development of a multiuser cooperative environment (i.e. a groupware software) that will be a common component of the various GRIDCC applications. • WP6: Integration and Pilot Applications - System integration and deployment of a small number of pilot applications on existing Grid testbeds. • WP7: Information dissemination and exploitation – To ensure that the results of the project are widely disseminated and that the results are exploited by existing (e.g. EGEE) and future Grid development projects WP8: Management - To ensure all objectives are realised and all deliverables are completed according to schedule and within budget. Management and resolution of conflict within the project, including the redefinition of WP deliverables. Protection and exploitation of the IP arising from the project. GM, MIlano, 19 March 2004 6 Pilot Applications (I) • Power Grid – • Meteorology – • In electrical utility networks (or power grids), the introduction of very large numbers of ‘embedded’ power generators often using renewable energy sources, creates a severe challenge for utility companies. Existing computer software technology for monitoring and control is not scalable and cannot provide a solution for the many thousands of generators that are anticipated. GridCC technology would allow the generators to participate in a VO, and consequently to be monitored and scheduled in a cost-effective manner Ensemble Forecasting” has been used at large meteorological centers worldwide (e.g. ECMWF, NOAA/NCEP, UK-Met Office, METEO France) with promising results. However “Ensemble Limited Area Forecasting” is still in its infancy. The main reason for this is the demanding requirements for computing resources. These resources are nowadays both available and manageable on the GRID. With real-time extensions, Limited-Area Forecasting can become a common tool. Analysis of neurophysiological data – GM, MIlano, 19 March 2004 An exciting medical application of real-time operations and analysis on the Grid comes from the diagnosis of migraines. Migraine is an incapacitating disorder of neurovascular origin, which consists of attacks of headache, accompanied by autonomic and possibly neurological symptoms. The attacks, if left untreated, typically last from 4 to 72 hours. During acute migraine, sensitisation phenomena occur. These lower the pain threshold at peripheral and central levels. An estimated 4-5% of the world population suffers chronic daily headache. Prompt pharmacological treatment can stop sensitisation, thus avoiding the chronicity of the illness, while an incorrect analgesic drug overuse may by itself precipitate migraine. Since chronicity is the main cause of invalidity it is important to find the correct treatment and implement it, especially on patients with frequent attacks. 7 Pilot Applications (II) • Device Farm for the Support of Cooperative Distributed Measurements in Telecommunications and Networking Laboratories – • High-Energy Physics: control and monitor of experiments – • Focusing on the telecommunication systems and networking area, the goal of this application is to design and implement a “device farm” demonstrator. The demonstrator will be based on the GRIDCC features that will allow the necessary physical (or software-emulated) resources that are involved in a specific experiment to be found and cooperatively used independently of their location. This application involves the use of the Grid in a real-time environment to control and monitor remote large-scale detectors. This application will make use of a High-Energy Physics (HEP) experiment, the CMS detector which is currently under construction at the future LHC collider at CERN. CMS consists of 20,000,000 electronics channels that will be read out by a complex distributed data acquisition (DAQ) system feeding a large processor farm charged with filtering an input rate of up to 100 kHz down to only ~100 Hz of physics events. The DAQ system involves a very large number (a few thousand) of intelligent modules and computers, data throughputs of ~100 Gbytes/s. These characteristics, along with the selectivity of one event in 1,000, are unprecedented in the field, and introduce requirements on the control and monitor of the experiment’s data-taking. Geo-hazards: Remote Operation of Geophysical Monitoring Network – GM, MIlano, 19 March 2004 Electromagnetic techniques have found a wide spectrum of significant applications in the framework of geophysical explorations. Nowadays, new tomographic techniques can be applied to obtain high-resolution “electromagnetic images” of the interior of the earth interior at different scales. The use of active and passive electromagnetic techniques, the possibility to select multiple sources and multi-frequency energizing systems discloses the geometry of complex geological environments (fault systems, landslides, etc.) in depth. It is now possible to obtain in-field temporal sequences of 3D electromagnetic images (4D tomography). The ability to obtain real-time 4D high-resolution images of subsoil pave the way for a wide spectrum of applications in geo-hazard and environmental monitoring. Some notable examples of such applications include the monitoring of fluid and gas migration processes in volcanic areas, the monitoring of diffusion processes of contaminant plumes and the study of groundwater circulation system in landslide bodies. 8 Pilot Application III • (Far) Remote Operation of Accelerator Facility – GM, MIlano, 19 March 2004 Far remote operation of an accelerator facility (i.e. the Elettra Control Room in Italy) involves the planning of accelerator operations, the maintenance of the accelerator and its troubleshooting, the repair of delicate equipment, understanding and pushing performance limitations, performing studies, performing commissioning and set ups and routine operations. All these activities are based on large amounts of information, which are at present accessible only at the accelerator site. Remote control of an accelerator facility has the potential of revolutionising the mode of operation and the degree of exploitation of large experimental physics facilities. Far remote operation combines elements of immersive (i.e. providing the feeling to be present at the remote location) communication and cooperation technology. This includes video and audio presence, allowing the simultaneous operation of the same instruments, having access to the same accelerator controls and the relevant data, meeting easily and spontaneously and providing full awareness of the presence of the collaborators. 9 Partecipants and requested funds Participant name Country Funds (KE) After 1st interaction with eu. Not yet approved Istituto Nazionale di Fisica Nucleare Italy 816 Institute Of Accelerating Systems and Applications Greece 680 Brunel University UK 383 Consorzio Interuniversitario per Telecomunicazioni Italy 243 Sincrotrone Trieste S.C.P.A Italy 464 IBM (Haifa Research Lab) Israel 270 Imperial College of Science, Technology & Medicine UK 644 Istituto di Metodologie per l’Analisi ambientale – Consiglio Nazionale delle Ricerche Italy 146 Universita degli Studi di Udine Italy 162 Greek Research and Technology Network S.A. Greece 225 TOTAL GM, MIlano, 19 March 2004 4033 10 Stato della negoziazione • Buon giudizio tecnico della proposta • I Referee esterni hanno proposto un finanziamento di 4 MEuro contro i 4.7 richiesti • Primo incontro con la commissione fatto il 8 marzo – Vari problemi di forma nella proposta tecnica – Problemi di sostanza nel come fare il taglio del budget • Referee esterni propongono un taglio mirato del 25 % su wp4 e wp6 • Noi vogliamo farlo un po’ piú’uniforme in quanto wp3 e wp6 sono il core del progetto (e INFN ha puntato tutto su questi) • Secondo incontro il 23 marzo GM, MIlano, 19 March 2004