Transcript GENESI-DR GEOSS AIP3 KO INFRA-2007-1.2.1 : Scientific Digital Repositories Duration : January 1, 2008 – April 30, 2010 Total EC funding : 4.4 M€ Pedro.

GENESI-DR
GEOSS AIP3 KO
INFRA-2007-1.2.1 : Scientific Digital Repositories
Duration : January 1, 2008 – April 30, 2010
Total EC funding : 4.4 M€
Pedro Goncalves
[email protected]
Roberto Cossu (ESA)
[email protected]
EC Grant Agreement no. 212073
GENESI-DR: the key points
Ground European Network for Earth Science Interoperations – Digital Repositories:
an Earth Science e-infrastructure federating Digital Repositories
•Discovery of heterogeneous
distributed data (in situ, satellite,
airborne) from different data
providers;
•Controlled access to data in the
respect of the data providers’ local
policies;
•Access to high performance
processing services;
•Strong scalability for easy
federation of new Digital
Repositories;
•Adoption of data curation and
preservation solutions for
selected federated data.
11/6/2015
GEOSS AIP3
2
The current deployment
topology
•Chorographic
maps of the
Italian territory
•Color
Orthophotos
•Demos HR DEM and aerial
photography
•Chlorophyll water data
•Chlorophyll Terrestrial
data
•POLDER
products
•MERCATOR
products
•SPOT 1-3, 4, 5
•Landsat 5, 7
•SRTM
VOS/Buoys
SWACI
Infoterra
CNES
JRC
SST
ENEA
DLR
NDACC
Lidar
Min for
Env
CNR
CENTRAL
SITE
Registy
ISPL
ASI
NASA
CENIA
NILU
GENESI-DR
Web Portal
ESA
KSAT
OMI NO2 Level 3
11/6/2015
•CORINE Land Cover
1990, 2000
•High resolution
images of the Czech
Rep.
SIR_C_X_SAR
•ENVISAT ASAR
•KOMPSAT2
•Vessel/wind
detection
•ENVISAT
(MERIS,ASAR,AATSR,
SCIAMACHY)
•ERS-2 (GOME,SAR)
•PROBA (CHRIS,HRC)
•DORIS (POR, VOR)
•L3 products
GEOSS AIP3
•GLOBmodel
(ozone columns,
temperature)
•SCIAMACHY
•OMI DOAS O3
column
3
GENESI-DR users
GENESI-DR data and services can be accessed by:
DR
DR
DR
human users
through the
GENESI-DR Web
Portal
CENTRAL
SITE
Registy
external
applications
through an
OpenSearch–
based interface
GENESI-DR
Web Portal
External
Applications
11/6/2015
GEOSS AIP3
4
The GENESI-DR Web Portal
Users can discover data and services via the GENESI-DR Web portal
searching on the base of:
…geographical
area, temporal
range..
DR
DR
CENTRAL
SITE
registry
…and other specific parameters
as applicable
…free text
string
11/6/2015
DR
GEOSS AIP3
5
The GENESI-DR Web Portal
DRs reply with all data
and services
matching the query
DR
DR
CENTRAL
SITE
Registy
Direct and controlled access: Data are not copied to the central
site and download/access is allowed only to authorized users
11/6/2015
GEOSS AIP3
DR
Individual DR data policies are
considered and respected
6
GENESI-DR Users
GENESI-DR data and services can be accessed by:
DR
DR
DR
human users
through the
GENESI-DR Web
Portal
CENTRAL
SITE
Registy
external
applications
through an
OpenSearch–
based interface
GENESI-DR
Web Portal
External
Applications
11/6/2015
GEOSS AIP3
7
Data processing in GENESI-DR
GENESI-DR provides on demand processing capabilities: application/algorithms are run on Grid
resources
GENESI-DR splits the processing
steps in several jobs.
These are run in parallel as possible in
different computing nodes of the
underlying Grid infrastructure.
Expert users are so enabled to
produce the final desired product.
11/6/2015
GEOSS AIP3
8
 GENESI-DR
•
•
Other processing solutions in GENESI-DR
GENESI-DR is also experimenting:
Web Processing Services (WPS) using GENESI-DR data
discovery capabilities (and interfacing with Grid
resources)
– by JRC through the Application "Near real time
orthorectification for agricultural crop check“
•
GridWay, making different applications able to use
already GENESI-fied grid resources (without the need of
integrating services in GENESI-DR webportal) – both
globus and gLite
11/6/2015
GEOSS AIP3
9
 GENESI-DR
•
Cloud Computing in GENESI-DR
Cloud Infrastructure-as-a-Service has been experimented in GENESI-DR to
offer “infinite” infrastructure on-demand in a complex
multidisciplinary/distributed environment (Amazon EC2 and S3):
• GENESI-DR should be able to run virtually
any software application or configuration
while paying only for the capacity and
services it consumes
• GENESI-DR data could be partially stored
and made accessible in Cloud Computing
storages with virtually “infinite” capacity
• Alternative Cloud infrastructures (existing
and under development) will be analysed
to assess performance, costs, readiness
for operation…
11/6/2015
GEOSS AIP3
Example of cloud test bed environment
10
IPR management in GENESI-DR
GENESI-DR has encouraged IPR policies harmonization and negotiated
with data owners to agree access terms and conditions;
Recommendations on policy and operating procedures for data
ownership and access, storage and distribution, security and
protection, etc, have been developed, in line with GEOSS Data
Sharing Principles
Nonetheless, GENESI-DR does not impose any overarching data
access or use policy;
being part of the federation does not affect existing IPR for federated
data: local policies at the federated Digital Repositories are fully
respected.
Details on the GENESI-DR data policy are provided in:
DNA4.3 - Data Archiving and Dissemination Policy
DNA4.6 - Data Archiving and Dissemination Policy – Compendium
11/6/2015
(soon available at: http://www.genesi-dr.eu/index.php?menu=documents&type=Deliverables)
GEOSS AIP3
11
Access control and licensing
• Data discovery through
GENESI-DR is allowed to
any authenticated user;
• Data access is only allowed
to authorized users, i.e.
users registered to the
“Virtual Organization”
providing access to such
data;
• A Virtual Organization is a
set of individuals and/or
institutions sharing the same
privileges on data and/or
resources
• It is up to DR owners to
decide which VOs are
allowed to access which
data and under which
conditions
11/6/2015
User not
identified
Data not
found
Authentication
Data Discovery
Data Access Request
Restricted
access
User not
authorized
User does not
accept license terms
and conditions
Authorization
Authorization
criteria as specified
by the provider
License Evaluation
Data Download
GEOSS AIP3
Open
Access
Data license
as specified
by the
provider
12
License representation
11/6/2015
GEOSS AIP3
13
License representation
GENESI-DR employs digital representations of licences… an example
…showing users
a summary of the
usage terms…
…and conditions…
…and referencing the
legal data provider’s
license document.
11/6/2015
GEOSS AIP3
14
Plans for the future
To consolidate GENESI-DR and evolve it in terms of
Data
– new DRs
– interoperation with Research
Infrastructures (addressing security
model interoperability)
Community
Building
DIGITAL
EARTH
COMMUNITY
Multidisciplinary
Collaboration
Communities and Virtual Research
Facilities
– engage a wider user community
– Make it be accessible through several
portals representative of the different
communities
– provide a larger set of services;
– build user customised services on the
base of their specific needs (also use of
semantics-based service composition);
– provide dedicated visualization tools
for the different communities.
11/6/2015
Creating user-configured Virtual Research Facilities
Interoperating with Research Infrastructures
New data, facilities and applications
Consolidating existing
infrastructure
All this will enable community building and
will allow multidisciplinary collaboration.
GEOSS AIP3
15
Plans for the future
– Worldwide providers: Europe, US, China, Japan
(agreements already reached)
– “GENESI-fication” of DRs + interoperation with other
data infrastructures
– More data (greater focus on non-satellite data)
– Multidisciplinary communities (offered with data and a
large set of customizable services)
More Land surface
(satellite, insitu and
airborne) data
More Ocean related data
New Seafloor data
More Atmospheric data
New spatial
indicator data
GENESI-DR
Communities
Seafloor and ocean
Global Atmosphere
Observation
Global Change
Territorial development
and spatial planning
Black Sea catchment
observation
Projects/
Programmes
11/6/2015
GEOSS AIP3
16
GENESI-DR
GEOSS AIP3
Frascati, 11-12 March 2010
http://www.genesi-dr.eu http://portal.genesi-dr.eu