IODE: Oceanographic data and information management in an international context

Peter Pissierssens Head, Ocean Services IOC 1

This presentation

• IOC • IODE mission • Data centre network • Role of the NODC • IODE structure • IODE data policy • IODE activities • Groups of Experts • IODE Global Projects • IODE Capacity building • IODE yesterday. Today and tomorrow • IODE & new technology • IODE’s new CB model (ODIN) • OceanTeacher • IODE Project Office • IODE-XVIII • Cooperation in the WESTPAC region 2

IOC

• Established in 1960, part of UNESCO • Purpose is “ to promote international cooperation and to coordinate programmes in research, services and capacity-building, in order to learn more about the nature and resources of the ocean and coastal areas and to apply that knowledge for the improvement of management, sustainable development, the protection of the marine environment, and the decision-making process of its Member States ” 3

IOC

• IOC Assembly & IOC Executive Council • 3 ‘ vertical ’’ major programmes: – Ocean Sciences : HAB, GCRMN, GIPME,ICAM, … – Ocean Services : IODE, Ocean Mapping – Operational Oceanography: GOOS • ‘ horizontal ’’ programme – Regions/TEMA • Secretariat in Paris + decentralized offices 4

IODE: mission statement

Established in 1961 ‘ to enhance marine research, exploitation and development by facilitating the exchange data and information between participating Member States and by of oceanographic meeting the needs of users for data and information products’ 5

Data Centre Network

• ~ 70 Oceanographic Data Centres • 3 World Data Centres Oceanography • 64 National Oceanographic Data Centres • Responsible National Oceanographic Data centres 6

7

Role of the NODC

• A centralised facility for providing ocean data/ information in a usable form to users; • Acquires, processes, quality controls, inventories, archives and disseminates data in accordance with national responsibilities; • Charged with the responsibility for conducting international exchange; • Traditionally, but not exclusively, deals with delayed mode data 8

IODE organizational structure

• IODE Committee – IODE national coordinators + all below • IODE Chair and Vice-Chair • IODE Officers – Chair, Vice-Chair, Chairs Groups of Experts, Directors WDCs Oceanography, Regional Coordinators.

• Secretariat – HQ, Project offices 9

Crucial: Data policy

• IOC-XXII adopted new IOC Oceanographic Data Exchange Policy

Preamble

The timely, free and unrestricted international exchange of oceanographic data is essential for the efficient acquisition, integration and use of ocean observations gathered by the countries of the world for a wide variety of purposes including the prediction of weather and climate, the operational forecasting of the marine environment, the preservation of life, the mitigation of human-induced changes in the marine and coastal environment, as well as for the advancement of scientific understanding that makes this possible.

10

Data policy (cont)

• • •

Recognising

the vital importance of these purposes to all humankind and the role of IOC and its programmes in this regard, the Member States of the Intergovernmental Oceanographic Commission exchange of oceanographic data and its associated metadata.

agree

that the following clauses shall frame the IOC policy for the international

Clause 1

Member States of shall provide IOC programmes.

timely, free and unrestricted access to all data, associated metadata and products generated under the auspices

Clause 2

Member States are encouraged to provide timely, free and unrestricted access to relevant data and associated metadata from non-IOC programmes that are essential for application to the preservation of life, beneficial public use and protection of the ocean environment, the forecasting of weather, the operational forecasting of the marine environment, the monitoring and modelling of climate and sustainable development in the marine environment.

11

Data policy (cont)

•

Clause 3

Member States are encouraged to provide access to oceanographic data and associated metadata, as referred to in Clauses 1 and 2 above, timely, free and unrestricted for non-commercial use by the research and education communities, • Clause 4 provided that any products or results of such use shall be published in the open literature without delay or restriction.

With the objective of encouraging the participation of governmental and non-governmental marine data gathering bodies in international oceanographic data exchange and maximizing the contribution of oceanographic data from all sources, applicable .

this Policy acknowledges the right of Member States and data originators to determine the terms of such exchange, in a manner consistent with international conventions, where 12

Data policy (cont)

• Clause 5 Member States shall • Clause 6 programmes.

, to the best practicable degree, oceanographic data and associated metadata use data centres linked to IODE’s NODC and WDC network as long-term repositories for . IOC programmes will co-operate with data contributors to ensure that data can be accepted into the appropriate systems and can meet quality requirements.

Member States shall enhance the capacity in developing countries to obtain and manage oceanographic data and information and assist them to benefit fully from the exchange of oceanographic data, associated metadata and products. This shall be achieved through the non-discriminatory transfer of technology and knowledge using appropriate means, including IOC’s Training Education and Mutual Assistance (TEMA) programme and through other relevant IOC 13

IODE Activities

• Expertise: Groups of Experts – GE-TADE (now Joint JCOMM/IODE ETDMP), GE-MIM, GE-BICH • Global activities : – ASFA, GTSPP, GODAR, GOSUD, OceanExpert, MEDI, marineXML, OceanPortal, Regional Ocean Portals, OIT, OceanTeacher – Data policy • Capacity building: – National, regional 14

Groups of Experts

• GE : Team of knowledgeable professionals selected carefully to outline, review and list priorities of tasks for implementation under IODE activities and work on specific issues arising from time to time during intersessional period under its terms of reference 15

GE-MIM

• IODE Group of Experts on Marine Information Management • Established 1984 (IODE-XI) • Terms of Reference: – Advise the IODE Committee on policy, development and further implementation and find solutions to problems of a system for marine information focusing on user needs; – Develop programmes to improve the capability of Member States, particularly developing countries , to benefit from and participate in marine information systems and keep Member States informed on how they might best have access to such systems through the application of information technology; – Coordinate with other UN agencies MEDI); , and represent IOC, on matters related to MIM (specific reference to ASFIS/ASFA and 16

GE-BICH

• • • IODE Group of Experts on Biological and Chemical Data Management and Exchange Practices Established: 2000 (IODE-XVI) Terms of Reference: – Documenting the systems and taxonomic databases various data centres; currently in use in – Documenting the advantages and disadvantages of different methods and practices data; of compiling, managing and archiving biological and chemical – Developing standards and recommended practices and exchange of biological and chemical data, including practices for operational biological data; for the management – Encouraging data centres to compile inventories of past and present biological and chemical data holdings; – Encouraging data holders to contribute data to data centres for the creation of a global integrated oceanographic profile and plankton databases 17

JCOMM/IODE ETDMP

• • • JCOMM/IODE Expert Team on Data Management Practices Established: 2003 (IODE-XVII) Terms of Reference: – Noting the similarity of the terms of reference for the IODE Group of Experts on the Technical Aspects of Data Exchange (GETADE) and the JCOMM Expert Team on Data Management Practices (ETDMP), – Recommends that the IODE Group of Experts on the Technical Aspects of Data Exchange be merged with the JCOMM Expert Team on Data Management Practices, – Further recommends that the funds allocated to the IODE programme for the organization of GETADE sessions be assigned to the organization of ETDMP sessions, thereby assuring annual sessions of the Group, – Requests that the JCOMM Management Committee consider renaming the Group to the JCOMM/IODE Expert Team on Data Management Practices to reflect the joint contribution of both bodies, – Further requests that the JCOMM Management Committee consider filling the vacant position on ETDMP with a representative from the IODE community.

18

IODE Global Projects

Data management • GODAR • GTSPP • GOSUD • MarineXML • MEDI Information management • ASFA • BeeBox • E-Repository • OceanExpert • OceanPortal • Regional Ocean Portals OceanTeacher Often projects are guided by a Steering Group 19

IODE Capacity Building

• National & regional workshops/training courses • Advisory missions • Internships • ODIN Regional data & information exchange networks (RECOSCIX-WIO, RECOSCIX CEA, ODINEA, ODINAFRICA, ODINCARSA) • Training tools: OceanTeacher 20

IODE Yesterday

• centralized data centre architecture • delayed mode operation (weeks-year) • physical oceanography data (T,S,…) • QC, data archival and dissemination 21

IODE today-tomorrow

• distributed model • more attention to chemical, biological data, coastal data • delayed mode + some real-time (close links with GOOS) • E2EDM • products and service oriented 22

Traditional centralized model

inst Data acquisition 1 NODC per country: full control NODC User products/ services archive data WDC 23

Today: NODCs are not alone!

• Individual scientists, research groups or institutions collect, manage and disseminate their own data • National and international programmes organize the management and dissemination of programme data • Private sector (eg oil and gas companies) collect and manage their own data and disseminate products to their clients 24

Result of all this:

• IODE Review results indicate that approximately 24% of the data collected are not submitted to NODCs • Problem of QC and QA because each data collector may use different methods 25

IODE-XVII: promotion of distributed model

• NODC remains final national archive • NODC is national coordinator for data and information management • NODC provides guidelines in data and information management methodology • NODC promotes IOC oceanographic data exchange policy • NODC promotes links with other programmes eg JCOMM 26

Distributed model

inst Data acquisition Data Mgmt inst Data acquisition Realtime services inst Data acquisition NODC inst Data acquisition Data Mgmt Modeling WDC NODC: coordinating, guiding role User products/ services 27

IODE towards transversal programme?

TEMA Ocean Science

GOOS

IODE IODE must provide the tools and services that enables observations to become information 28

IODE: new Technology

• Old problem: formats !!

• Metadata standard : MEDI and JCOMM/IODE ETDMP pilot projects (centralized repositories, decentralized metadatabases, harvesters, automated generation by instruments,…??) • How make different systems exchange data more easily?

– New solution: marineXML 29

marineXML

• marine XML will support tracking of data from collection through to generation of integrated global and regional datasets.

• marineXML can support metadata describing the data collection, quality control and subsequent processing. • The generation of data tagged with descriptions marineXML at the instrument level can enable automating processes like generation of metadata 30

IODE involvement in mXML

• ICES-IOC Study Group on the Development of Marine Data Exchange Systems using XML [SGXML] • EU Marine XML project 31

IODE Capacity Building:

internships

new deal

• Before: occasional training courses, • Now: ODIN strategy – Linking training, equipment, operational support – Regional context – Product and service oriented – Multi-stakeholder approach – Continuous professional development: NEW!

32

The new integrated CB model

Ocean Science TEMA IODE

GOOS

ODIN PROJECT OceanTeacher 33

ODIN projects

ODIN-Pac.Isl

ODINCARSA 2001-… ODINAFRICA 2001-… ODINCINDIO 2004-… 34

ODINAFRICA

• Started 2001 • 20 African countries 35

ODINAFRICA

• 2001-2003: 19 NODCs established • Data products and services developed – Data atlases, metadatabases, national ocean awareness activities, stakeholder meetings, national coordination teams established,… • 2004: ODINAFRICA-III 36

ODINAFRICA-III

3 components: 1. coastal ocean observing system 2. data/information management 3. product development, end-user communication and information delivery system Modeling?

Data acquisition Data Mgmt User products/ services 37

ODINAFRICA-III: observation

• Physical – Sea-level, Water Temperature, Salinity, Currents, Surface Waves, Changes in Bathymetry, Changes in Shoreline Position, Sediment grain size, Attenuation of solar radiation , • Chemical – Sediment organic content, Dissolved inorganic nitrogen, phosphorus, silicon, Dissolved oxygen • Biological – Benthic biomass, Phytoplankton Biomass, Faecal Indicators 38

Training Tool: OceanTeacher

• OceanTeacher to ODIMeX (2004-2007) = single integrated e-learning and expert system • expert and training resources for marine data management and marine information management needed by professional ocean data and information managers and scientists involved in data management; • provide ocean researchers and students with the necessary knowledge to interact effectively with their national oceanographic data centres 39

ODIMeX

• Distance learning technology • Topics expansion : Remote Sensing, Biological data management, Operational oceanography data management, Modelling • Tools expansion : GIS, Programming, XML, development of WWW based services • Expanded audience: 40

AUDIENCES

41

The Binary Model

42

IODE new deal

• IODE needs to lead way in coordinating access to support needs of users • Close to marine data and information collaboration operational oceanography • Need to develop with sciences and new technologies • Need to undertake major training at global scale (existing and new DCs!) 43

IODE project Office

• establish a creative environment facilitating the further development & maintenance of IODE projects, services & products with emphasis on improving the efficiency & effectiveness of the data & product/service stream between the stage of sampling & the user; • to assist in strengthening the capacity of Member States to manage oceanographic data & information & to provide ocean data & information products & services required by users.

44

45

1000m2 -2 meeting rooms -1 large conference/training room - broadband Internet connection -10 offices -2 D&IM lab areas - web/db servers 46

IODE-XVIII: 26-30 April 2005

• Will be presented with report of IODE review and recommend actions • Will need to review IODE structure • Will need to prioritize projects and activities for 2005-2007 47

Cooperation in the WESTPAC region?

• What mechanism currently exists in the WESTPAC region to promote the management and exchange of oceanographic data and information?

• Is any capacity building required (start from zero or CPD?) 48

IODE web sites

• http://www.iode.org

• http://www.marinexml.net

• http://ioc.unesco.org/medi • http://www.oceans-it.net

• http://www.odinafrica.net

• http://www.odincarsa.net

• http://www.oceanportal.net

• http://www.oceanteacher.org

• http://www.oceanexpert.net

49

Thank you

50