Transcript Recordkeeping Metadata Seminar ASA/ARANZ CONFERENCE …

IMS 5010 - Evidence and Metadata
30 May 2006
Investigating metadata
interoperability in the Clever
Recordkeeping Metadata Project
www.monash.edu.au
Imagining automated metadata re-use
Points to description
Registry
Service
Descriptions
Locate service
Describes
service
Finds
service
Exchange messages
Consumer
Translation
Service
Source: Based on diagram from http://www.softstar-inc.com /
www.monash.edu.au
2
Clever Recordkeeping Metadata Project
Chief Investigator
•
Professor Sue McKemmish, Monash
University
Partner Investigators
•
•
Professor Anne Gilliland-Swetland, UCLA
Adrian Cunningham, National Archives of
Australia
Industry Partners and Collaborators
•
•
•
National Archives of Australia
State Records Authority of New South
Wales
Australia Society of Archivists, Committee
on Descriptive Standards
www.monash.edu.au
3
Create once, use many times
Practical Perspectives
Research Perspectives
Overcome barriers to
implementation of
recordkeeping and resource
discovery standards
Explore role of recordkeeping
metadata in support of
business and recordkeeping
processes
How to enable recordkeeping
metadata interoperability?
Demonstrate the business
case for recordkeeping
metadata
Impact on recordkeeping
and archiving functions
Requirements for meta-tools for
recordkeeping metadata management
www.monash.edu.au
4
Traditional recordkeeping architectures
Web Management
System
Archival
Gateways
Email
Desktop
Applications
Business
Systems
Records
Management
Application
Archival
Management
Application
Subject
Portals
Community
Archives
www.monash.edu.au
5
Metadata broker as middleware
Records
Management
Application
Email and
Desktop
Applications
Web
Management
Systems
Metadata
Broker
Business
Information
Systems
Archival
Management
Application
Archival
Gateways
Subject
Portals
Community
Archives
www.monash.edu.au
6
Metadata broker as middleware (cont.)
Records
Management
Application
Email and
Desktop
Applications
Web
Management
Systems
Metadata
Broker
Business
Information
Systems
Archival
Management
Application
Archival
Gateways
Subject
Portals
Community
Archives
www.monash.edu.au
7
Metadata broker as middleware - outcomes
• Observations
– Standards not as interoperable as assumed
– Complexity in recordkeeping metadata re-use
– Limitations of current recordkeeping metadata
standards
• Reflections on observations
– Sustainability requires moving beyond hand crafting
crosswalks and hard wiring applications
– Constraints of records management and archival
processes, technologies and tools developed for
paper recordkeeping and in application-centric IT
environments
www.monash.edu.au
8
Second iteration agenda
• Develop metadata broker as a cluster of web
services
• Revise scenario processes in line with continuum
and SOA view
• Test use of broker within such a framework
• Develop business case for recordkeeping
metadata in such a framework
www.monash.edu.au
9
Service oriented architectures
Open systems
Open standards
Service Oriented
Architecture
Open communication
protocols
Standards
Metadata
www.monash.edu.au
10
Web services technologies
WSDL
Service
Descriptions
Points to description
UDDI
Registry
Locate service
Describes
service
Finds
service
Exchange messages - SOAP
Consumer
Service
Source: Based on diagram from http://www.softstar-inc.com /
www.monash.edu.au
11
CRKM Metadata Broker November 2005
Validation service
Source metadata
Translation service
Target metadata
Crosswalk compilation service
Registration
Registry services
Registry
Request for Schema
Authoritative information on metadata
schemas, metadata elements and
crosswalks in human readable and
machine processable forms
Repository
Schema information
Machine processable
representations of metadata
schemas and crosswalks
www.monash.edu.au
12
ebXML Registry
• Two part specification of requirements
for object repository and associated
registry
– ebXML Registry Information Model
– ebXML Registry Services and Protocols
• Availability of freeBXML Registry - open
source reference implementation of an
ebXML Registry
– see http://ebxmlrr.sourceforge.net/
www.monash.edu.au
13
Metadata broker as web services cluster
CRKM Registry
ebXML Registry
Schemas
CRKM Broker
Crosswalks
www.monash.edu.au
14
CRKM Registry Implementation Framework
WSDL service
descriptions
UDDI
UDDI
Registry
UDDI
Registry
Registry
CRKM Registry
ebXML Registry
External links to entries for
versions of standards
Querying for schema
and crosswalk objects
MADRAS
Registry
www.monash.edu.au
15
Metadata broker as web services cluster
Request the AGEMS –
RKMSCA crosswalk
Translation Service
Metadata Registry
Web Service Layer
Web Service Layer
Request to
translate
AGEMS to
RKMSCA
AGEMS
AGEMS – RKMSCA
Crosswalk Service
RKMSCA
Web Service Layer
Metadata Broker Client
www.monash.edu.au
16
CRKM Registry Information Model
Layer 3
Conceptual Model
Abstract
Metadata/Data
Standard
Version 1
Metadata/Data
Standard
Version 2
Metadata/Data
Standard
Version n
Layer 2
Representation
Encoding 1
Encoding 2
Encoding n
Version 1
Version 2
Version n
Registry
Objects
www.monash.edu.au
17
Realising sustainable interoperability
API EDI
Middleware
Web
services
Service
oriented
architecture
Prototype
Conceptualisation
www.monash.edu.au
19
Service oriented architectures
Recordkeeping Services
Data/Information/Object Stores
Business
Services
Infrastructure
Services
Utility
Services
Service Bus
Business
Process Engines
Business Logic/
Rule Bases
Service
Registries
Metadata
Registries
www.monash.edu.au
20
Recordkeeping services in SOA
Metadata Broker
Data/Information/Object Stores
Recordkeeping
Business
Services
Infrastructure
Services
Utility
Services
Service Bus
Recordkeeping
Business Process
Engines
Recordkeeping
Business Logic/Rule
Bases
Recordkeeping Service
Registries
Recordkeeping
Metadata Registries
www.monash.edu.au
21
Conclusions
• Extent to which paper paradigms still dominate
recordkeeping practice
• Why the service oriented paradigm is desirable
for recordkeeping
• Point to the degree of re-thinking required in
the profession to make recordkeeping in such
environments a reality
• Highlight the infrastructure required to support
clever metadata, particularly the role of
registries at different levels of operation and
granularity
www.monash.edu.au
22
Conclusions (continued)
• For schema and standard developers
– Moving from compliance to interoperability
requires rigorous conceptual modelling
translatable into unambiguous and precise
representations for machine processing
– Need for identification and descriptive
frameworks for schemas to facilitate their
use
www.monash.edu.au
23
For more information
• See the Clever Recordkeeping Metadata
Project web site at:http://www.sims.monash.edu.au/
research/rcrg/research/crm/index.html
www.monash.edu.au
24