Metadata Management Case Study Date: 10/21/2008

Download Report

Transcript Metadata Management Case Study Date: 10/21/2008

M D Metadata Solutions

Metadata Management

Case Study Date: 10/21/2008 Dan McCreary President Dan McCreary & Associates [email protected]

(952) 931-9198

Overview

• The Challenge • Why XRX is an Ideal Solution • Screen Images • Results

M D

Gartner on Metadata

Metadata cast into formal logics will drive interoperability, automation, cost cutting, better search capabilities and new business opportunities.

Semantic Web Drives Data Management, Automation and Knowledge and Discovery Alexander Linder March 2005 G00125145

The Challenge

• Allow the business people (not the IT department or developers) to manage all aspects of metadata – Definitions – Approval – ISO/IEC Metadata Registry – Shopping Cart – Wantlist Management – Automatic Form Generation

Semantic Triangle

A pattern of neural activity in our brain Concept

Refers To Symbolizes

M D Symbol Referent

Stands For

“cat”

“gato” (Spanish) “katze” (German) Physical Objects

Ogden, C. K., & Richards, I. A. (1923) The Meaning of Meaning

Semantic Web Standards Stack

M Source: Tim Berners-Lee www.w3c.org

Trusted Semantic Web Proof Logic Rules/Query URI/IRI XML Query XML Ontology (OWL) RDF Model & Syntax XML Schema Namespaces Unicode http://www.w3.org/Consortium/Offices/Presentations/SemanticWeb/34.html

Example of K-12 Registry

M D

A (meta) Data Registry

Goal: create semantic maps to a federal & state metadata standard, not many standards R N R 2 R N NIEM R 2 M R 7 R 3 R 7 NIEM R 3 D R 6 R 4 R 5

Mapping from Minnesota's metadata registry to N other metadata registries:

The O(N 2 ) problem R 6 R 4 R 5

Mapping from Minnesota's metadata registry to counties & federal The O(N) problem

UML XML XML Doc

Evolving Metadata Standards

ISO/IEC 11179 MDR Federal XML Developer’s Guide (xml.gov)

ISO commercial schemas

ebXML Non-ISO schemas Public Schemas XLink xBRL GJXDM M D NIEM Federal XML Naming and Design Rules Dept Stds.

Federal Data Reference Model (DRM) Minnesota Data Standards UBL

Future Standards (?)

MOF XMI CWM OASIS Standards Division Stds

Minnesota Enterprise Technical Architecture

M D

• Follow established Minnesota metadata standards

Build an Inventory of Data Elements

Sample Data Element

M D

Examples of Federal Meta Data Registries

• NIEM – National Information Exchange Model • GJXDM – Global Justice XML Data Model • ebXML – Extensible Business XML • UBL – Universal Business Language • EPA – Environmental Protection Agency • DOD – Department of Defense Metadata Registry • xBRL – XML Business Reporting Language

M D

Examples of Local Metadata Registries

• Minnesota Department of Education Registry • Minnesota Department of Revenue Property Taxation Registry • Financial Institution

Property Taxation Example

M D

Example: NIEM.gov

M D Fill your shopping cart with Data elements Easily create sub schemas for different needs

Registry helps track data source mapping

Metadata Registry A M Local Registry or database D Table Column Column Column Table Column Column Column OLTP RDBMS Data Warehouse

• • • • • Registry data elements can map to one or more data sources. Concepts usually map to tables and properties map to columns.

Mappings can be used to facilitate transfers Mapping can be stored directly in the registry Tools are frequently used to create initial mappings Organizations can create mappings between their internal systems and a central metadata registry

Metadata Registry Workflow Funnel

Glossary Of Terms Draft Data Elements Review & Edit Approve

• • •

Create the Registry Define your glossary and data elements Review & make changes Approve & publish by stakeholders

The registry defines the data we exchange and keeps our need for code changes to a minimum

• •

Use the Registry Generate data schemas (XML) by selecting and organizing data elements Add new items to the registry as needs change

Federated Search

•

Federation

: When many different sources can return search results from a single search

Search Business Terms WebSite Terms Data Elements ACORD Other Standards RDMS Columns 18 D

Federated Search Results

M D

Metadata Shopper

M D

Why XRX?

• Metadata is complex • Many nested structures • Metadata needs to be quickly customized to meet the needs of different stakeholders • Data governance is a collaborative process

Before XRX

• Staffing/Skills – XML Schemas – XSLT to transform data elements into HTML – DBAs to create RDBMS tables and indexes – One or more Java Developers – HTML Forms and Reports – CSS – Reporting tools (Crystal Reports etc) – Limited form functionality (no AJAX) • Six people, 9 months $250,000 to $500,000

After XRX

• Skills – XForms, REST and XQuery • Steps – Import data definitions from spreadsheets and XML sources – Create data element registry – Create shopping cart tools with XForms – Generate XML sub-schemas for importing into document exchanges – Higher quality user experience (suggest items) • One Person Three Months: $40,000

Thank You!

Please contact me for more information: • Metadata Management • Metadata Registries • Service Oriented Architectures • Business Intelligence and Data Warehouse • Semantic Web • Native XML Databases Dan McCreary, President Dan McCreary & Associates Metadata Strategy Development [email protected]

(952) 931-9198

D 24

Metadata Management Case Study Date: 10/21/2008

Transcript Metadata Management Case Study Date: 10/21/2008