Data, information and knowledge repositories: developing infrastructure to support the e-Research landscape. Dr Liz Lyon, Director UKOLN, University of Bath, UK euroCRIS Strategic Seminar, Brussels, September.

Download Report

Transcript Data, information and knowledge repositories: developing infrastructure to support the e-Research landscape. Dr Liz Lyon, Director UKOLN, University of Bath, UK euroCRIS Strategic Seminar, Brussels, September.

Data, information and knowledge
repositories: developing
infrastructure to support the
e-Research landscape.
Dr Liz Lyon, Director
UKOLN, University of Bath, UK
euroCRIS Strategic Seminar, Brussels, September 2005.
UKOLN is supported by:
www.ukoln.ac.uk
a centre of expertise in digital information management
www.bath.ac.uk
Overview
1. e-Research: a changing landscape
2. Developing infrastructure: repository
services & adding value
•
•
•
Aggregation and linking: eBank UK
Integration and workflow
Enabling knowledge extraction & postprocessing
3. Looking to the longer term: digital
curation and preservation
euroCRIS Seminar, Brussels, September 2005
2
1. e-Research: a changing landscape
A medieval scriptorium…..
euroCRIS Seminar, Brussels, September 2005
4
eScience - the data deluge
Data
Overload!
EPSRC National
Crystallography
Service
How do we
disseminate?
euroCRIS Seminar, Brussels, September 2005
5
Presentation services: subject, media-specific, data, commercial portals
Data creation /
capture /
gathering:
laboratory
experiments,
Grids,
fieldwork,
surveys, media
Searching ,
harvesting,
embedding
Resource
discovery, linking,
embedding
Data analysis,
transformation,
mining, modelling
Aggregator
services: national,
commercial
Resource
discovery,
linking,
embedding
Learning object
creation, re-use
Harvesting
metadata
Research &
e-Science
workflows
Learning &
Teaching
workflows
Repositories :
institutional,
e-prints, subject,
data, learning objects
Deposit / selfarchiving
Validation
Publication
Resource
discovery, linking,
embedding
The scholarly knowledge cycle.
Liz Lyon, Ariadne, July 2003.
© Liz Lyon (UKOLN, University of Bath), 2005
Deposit / selfarchiving
Institutional
presentation
services: portals,
Learning
Management
Systems, u/g, p/g
courses, modules
Peer-reviewed
publications: journals,
conference proceedings
This work is licensed under a Creative Commons License
Attribution-ShareAlike 2.0 euroCRIS
Seminar, Brussels, September 2005
Validation
Quality
assurance
bodies
6
Diversity of data collections
•
•
Very large, relatively homogeneous:
Large-scale Hadron Collider (LHC) outputs from CERN
Smaller, heterogeneous and richer collections:
World Data Centre for Solar-terrestrial Physics CCLRC
Small-scale laboratory results:
“jumping robots” project at the University of Bath
Population survey data: UK Biobank
•
Highly sensitive, personal data: patient care records
•
•
euroCRIS Seminar, Brussels, September 2005
7
Taxonomy of data collections
•
•
•
Research collections:
jumping robots
Community collections:
Flybase at Indiana (with
UC Berkeley )
Reference collections:
Protein Data Bank
Evolution……
Source: NSF Long-Lived Digital
Data Collections
Draft report revised
May 2005
euroCRIS Seminar, Brussels, September 2005
8
Evidence from recent reports
• Large scale data sharing in the life sciences
Draft Report June 2005
(MRC, BBSRC, NERC, JISC, Wellcome)
–
–
–
–
Importance of standards and good quality metadata
Require a data management plan
Work needed on vocabularies & ontologies
Awareness of archiving & long term preservation
• Institutional repositories CNI/JISC/SURF Country
update D-Lib Magazine September 2005
– Germany 103, UK 31, Sweden 25
– Policy: Germany YES, UK RCUK draft
– National programmes: UK, Germany, Australia, Sweden,
Netherlands YES
– Services: indexing, search, harvesting
euroCRIS Seminar, Brussels, September 2005
9
2. Developing infrastructure:
repository services & adding value
eBank UK Project
• JISC-funded September 2003, Phase 2 February 2005
• UKOLN at the University of Bath (lead), University of
Southampton, University of Manchester
• Exemplar: e-Science testbed ‘Combechem’
– Grid-enabled combinatorial chemistry / crystallography
– Development of an e-Lab using pervasive computing technology
– National Crystallography Service
• Resource Discovery Network / PSIgate physical
sciences portal
• Two key themes:
– Open access to datasets
– Linking research data to learning
• http://www.ukoln.ac.uk/projects/ebank-uk/
euroCRIS Seminar, Brussels, September 2005
11
Create
Data Flow in eBank UK
HTML
Deposition
Interface
Submit
Store/link
Institutional
repository
eCrystals
Index
and
Search
Harvest
(XML)
eBank
aggregator
service
Present
HTML
Present
OAI-PMH
Deposit
Service Provider
interfaces e.g.
Subject Portal
Local archive
search
interface
euroCRIS Seminar, Brussels, September 2005
Data files
Metadata
12
Dataset
Searching,
linking and
embedding
eBank data model
Dataset
Dataset
dcterms:references
Harvesting
OAI-PMH
oai_dc
Crystal structure
(data holding)
Linking
ebank_dc
record (XML)
dc:identifier
Crystal structure
report (HTML)
Linking
dc:type=“CrystalStructure”
and/or “Collection”
Institutional
repository
Searching,
linking and
embedding
Harvesting
OAI-PMH
PSIgate
portal
ebank_dc
eBank UK
aggregator
service
dcterms:isReferencedBy
Eprint
“jump-off”
page
(HTML)
Eprint
manifestation
(e.g. PDF)
Deposit
ePrint UK
aggregator
service
dc:identifier
Harvesting
OAI-PMH
oai_dc
Eprint oai_dc
record (XML)
dc:type=“Eprint”
and/or ”Text”
Model input Andy Powell, UKOLN. euroCRIS Seminar, Brussels, September 2005
Subject service
Searching,
linking and
embedding
13
CombeChem: An EPSRC pilot project
Simulation
Video
Diffractometer
Properties
Analysis
Structures
Database
Properties
e-Lab
X-Ray
e-Lab
Grid Middleware
euroCRIS Seminar, Brussels, September 2005
14
Crystallography workflow
RAW DATA
DERIVED DATA
RESULTS DATA
• Initialisation: mount new sample set up data collection
• Collection: collect data
• Processing: process and correct images
• Solution: solve structures
• Refinement: refine structure
• CIF: produce CIF (Crystallographic Information File)
• Validation: chemical & crystallographic checks
• Report: generate Crystal Structure Report
euroCRIS Seminar, Brussels, September 2005
15
euroCRIS Seminar, Brussels, September 2005
16
A data repository entry
euroCRIS Seminar, Brussels, September 2005
17
Access to the underlying data
ecrystals.chem.soton.ac.uk
euroCRIS Seminar, Brussels, September 2005
18
Harvesting: OAIster
euroCRIS Seminar, Brussels, September 2005
19
Aggregating: search & discover
euroCRIS Seminar, Brussels, September 2005
20
Linking data to publications
euroCRIS Seminar, Brussels, September 2005
21
eBank embedded in a science portal
euroCRIS Seminar, Brussels, September 2005
22
Ontologies for aggregating, linking &
discovery
• Transform the ‘list’ into an
‘ontology’
• Embed ontology into the
deposition process
• Publish keywords in OAI
• Aggregators use keywords
for linking with the broader
literature
• Researchers use keyword
ontology in search and
discovery services
euroCRIS Seminar, Brussels, September 2005
23
Persistent identifiers for
data citation
• eBank use cases: depositor, author, service
provider, reader, publisher, ?
• Schemes: DOI, Handle, ARK, PURL
• Global identification: express as http URIs
• Added value services: CrossRef, resolution
service, integration (Globus), look-up service, ?
• Degree of trust or persistence
• Future potential: political, ?
• Domain identifiers: International Chemical Identifier
(InChI) codes
euroCRIS Seminar, Brussels, September 2005
24
Publication & citation of
Primary Data project
• National Library for Science & Technology (TIB),
University of Hanover, Germany
• STD-DOI Project http://www.std-doi.de
• DOI registry for datasets
• Data requirements: quality control, long-term curation,
use DOI resolver
• Data publication agents: World Data Center Climate,
GeoForschungsZentrum Potsdam
• Exemplar data citation:
– Kamm, H; Machon, L; Donner, S (2004): Gas chromatography
(KTB Field Lab), GFZ Potsdam.
doi:10.1594/GFZ/ICDP/KTB/ktb-geoch-gaschr-p
euroCRIS Seminar, Brussels, September 2005
25
Integration into
crystallographic
publishing
practices
Publishers
seal of
approval
euroCRIS Seminar, Brussels, September 2005
26
Integration into chemistry
research workflows
• R4L Repository for the Laboratory Project (JISC-funded)
automated data capture from instrumentation, registration of results
• SMART TEA electronic Laboratory notebook
• Related sub-domains of chemistry: SPECTRa Project (JISC-funded)
• Research assessment (RAE) process?
euroCRIS Seminar, Brussels, September 2005
27
Integration into the curriculum
and e-Learning workflows
• MChem course
• Assess role in
Undergraduate Chemical
Informatics courses
• Pedagogic evaluation
• Introducing school
children to e-Research?
euroCRIS Seminar, Brussels, September 2005
28
3. Looking to the longer term:
digital curation & preservation
Repositories and digital curation
For later use?
In use now (and the future)?
Static
Dynamic
Data preservation
Data curation
“maintaining and adding value to a trusted body
of digital information for current and future use”
euroCRIS Seminar, Brussels, September 2005
30
Assuring long term access to
the research record
• Trusted digital repositories
–
–
–
–
Audit Checklist for Certification Draft Report
Research Libraries Group, August 2005
RLG-NARA Taskforce
Defined criteria under 4 categories
•
•
•
•
Organisation
Functions, processes & procedures
Designated community & usability
Technologies & technical infrastructure
• UK Digital Curation Centre http://www.dcc.ac.uk
– 1st International DCC Conference Sep 29-30, Bath UK
euroCRIS Seminar, Brussels, September 2005
31
Thank you.
Questions?…..