Transcript Taalee Presentation - PersonalWebIWayanSW
The Mysteries of Metadata
Workshop at Content World 2001, Burlingame, CA. May 15, 2001 Amit Sheth [email protected]
Founder/CEO, Taalee ( www.ta
al ee.com
) [Taalee is now Semagix: www.semagix.com
] Also, Director, Large Scale Distributed Information Systems ( LSDIS ) Lab, University Of Georgia (lsdis.cs.uga.edu) Metadata Extraction is a patented technology of Taalee, Inc.
Semantic Engine and WorldModel are trademarks of Taale. Inc.
Confidential HP
Workshop Agenda
What is Metadata ?
Metadata Descriptions and Standards Metadata Storage/Exchange/Infrastructure (Automated) Metadata Creation/Extraction/Tagging Metadata Usage/Applications
HP
2
What is Metadata?
Data about data Statements, contexts Recursive – data about “data about data” Applications Content management Cataloguing Information retrieval, search … "A Web content repository without metadata is like a library without an index," - Jack Jia, IWOV
HP
3
Information Interoperability:
key metadata objective and benefit
System Syntax Structure Semantics Protocols Metadata Domain Modeling, Ontologies
HP
4
Semantics
Meaning, Understanding Facts, Context, Reasoning Related to: exchange, usage, application
HP
5
A metadata classification
User Move in this Ontologies
Classifications Domain Models
direction to information overload!!
tackle Domain Specific Metadata
area, population (Census), land-cover, relief (GIS),metadata concept descriptions from ontologies
Domain Independent (structural) Metadata
(C++ class-subclass relationships, HTML/SGML Document Type Definitions, C program structure...)
Direct Content Based Metadata
(inverted lists, document vectors, WAIS, Glimpse, LSI)
Content Dependent Metadata
(size, max colors, rows, columns...)
Content Independent Metadata
(creation-date, location, type-of-sensor...)
Data
(Heterogeneous Types/Media) HP
6
Types of Metadata
for digital media
Media type-specific metadata eg.,texture of images,font size… Media processing-specific metadata eg.,search, retrieval, personalized filtering Content Specific metadata eg.,rocket related video and documents
HP
7
Metadata for Digital Data
Metadata
Q-Features [Jain and Hampapur] R-Features [Jain and Hampapur] Meta-Features [Jain and Hampapur] Impression Vector [Kiyoki et al.] NDVI, Spatial Registration [Anderson and Stonebraker] Speech Feature Index [Glavitsch et al.] Topic Change Indices [Chen et al.] Document Vectors [ Deerwester et al.] Inverted Indices [Kahle and Medlar] Content Classification Metadata [Bohm and Rakow] Document Composition Metadata [Bohm and Rakow] Metadata Templates [Ordille and Miller] Land Cover, Relief [Sheth and Kashyap] Parent Child Relationships [Shklar et al.] Contexts [Sciore et al., Kashyap and Sheth] Concepts from Cyc [Collet et al.] User’s Data Attributes [Shoens et al.] Domain Specific Ontologies [Mena et al.]
Data Type
Image, Video Image, Video Image, Video Image Image Audio Audio Text Text MultiMedia MultiMedia Media Independent Media Independent Text Structured Structured Text, Structured Media Independent
Metadata Type
Domain Specific Domain Independent Content Independent Content Descriptive Domain Specific Direct Content Based Direct Content Based Direct Content Based Direct Content Based Domain Specific Domain Independent Domain Specific Domain Specific Domain Independent Domain Specific Domain Specific Domain Specific Domain Specific HP
8
Types of Specs and Standards
(or MetaModels)
Domain Independent: (MCF), RDF , MOF, DublinCore Media Specific: MPEG4, MPEG7, VoiceXML Domain/Industry Specific (metamodels): MARC (Library), FGDC and UDK (Geographic), NewsML (News), PRISM (Publishing) Application Specific: ICE (Syndication) Exchange/Sharing: XCM, XMI Orthogonal/(Other): RDFS, namespaces, ontologies, domain models, (DAML, OIL)
HP
9
what RDF can do for metadata ?
Designed to impose structural constraint on syntax to support consistent encoding, exchange and processing of metadata. Domain Independent Metadata standard.
HP
10
RDF
(Resource Description Format)
Resource Property Value •RDF data consists of nodes and attached attribute/value pairs •Nodes can be any web resources (pages, servers, basically anything for which you can give a URI), even other instances of metadata. •Attributes are named properties of the nodes, and their values are either atomic (text strings, numbers, etc.) or other resources or metadata instances.
HP
11
RDF Example 1
dc:title Mysteries of Metadata URI:TALK dc:creator URI:AMIT
12
RDF Example 2
dc:title Mysteries of Metadata URI:TALK BIB:Aff URI:LIB dc:creator URI:AMIT BIB:Name Amit Sheth BIB:Email [email protected]
HP
13
RDFS (RDF Schema)
Enables resource description communities to define (and share) vocabularies (museum, library, e commerce…) Vocabulary (in RDFS) = the meaning, characteristics, and relationships of a set of properties.
HP
14
RDF Based Web
RDF Schemas RDF/XML Descriptions Resources HTML
Source:http://www.w3c.rl.ac.uk
HP
15
Dublin Core Metadata Initiative
Simple element set designed for resource description International, inter-discipline, W3C community consensus “Semantic” interface among resource description communities (very limited form of semantics) Source:www.desire.org
HP
16
Dublin Core RDF
DC:Title = "I've Never Metadata I've Never Liked“ DC:Creator = "Mary Crystal“ DC:Subject = "Metadata, Dublin Core, Stuff"/> HP
17
MOF
(Metadata Object Facility) and XMI
MOF models metadata using a subset of UML that is relevant to modeling metadata (class models - classes, associations and subtyping), a set of rules for mapping the elements of the MOF Core to CORBA IDL XML Metadata Interchange (XMI) is an extension of the MOF into the XML space
HP
18
NewsML
NewsML is a packaging and metadata format for news content.
NewsML is developed by the International Press Telecommunications Council (IPTC), a consortium of news providers, mostly in the print or wire-service industries. Since it deals only with packaging and metadata, NewsML is complementary both to news content formats like NITF and to syndication protocols like ICE .
HP
19
NewsML…
It can be used by news providers to combine their pictures, video, text, graphics and audio files in news output available on web sites, mobile phones, high end desktops interactive television and any other device.
accurate, objective set of description tools, which help qualify the information and make the search more precise.
NewsML allows a range of metadata to be attached to a multi-media story, including a detailed computer readable description of what an item is about.
HP
20
Example of the end-to-end flow NewsML
The content provider supplies NewsML packaged media content to the operator. The content is categorized as current events, finance, sport, etc. and updated hourly.
Source:http://www.mediabricks.com
The operator receives NewsML data from the content provider. The content server automatically pushes updated news articles to all news service subscribers. Consumers sign up for the news service directly on the device. When using the news service, the user browses through the categories and reads the news articles. The news articles are presented in a continuous flow (one after the other) without end-user interaction.
HP
21
PRISM
Publishing Requirements for Industry Standard Metadata Version: 1.0, April 2001 Authors: IDEAlliance (Adobe, Vignette, Kinecta et al.) Idea: “a standard for interoperable content
description, interchange, and reuse in both traditional and electronic publishing contexts
” Web site: http://www.prismstandard.org
HP
22
PRISM Design
Built on existing standards like Dublin Core (DC), RDF, XML Designed to be used in a simple, straightforward way over the Internet Compatible with NewsML Integrates easily with ICE (for syndication) Vocabulary: Basic: DC Extensions: “Controlled Vocabularies”, e.g., “North American Industrial Classification System“ (NAICS) HP
23
PRISM Example
(Source: PRISM spec v. 1; http://www.prismstandard.org/techdev/prismspec1.asp)
HP
24
VoiceXML
A language for specifying voice dialogs.
Voice dialogs use audio prompts and text- to- speech (TTS) for output; touch- tone keys (DTMF) and automatic speech recognition (ASR) for input.
Goal is to bring the advantages of web-based development and content delivery to interactive voice response applications.
High- level voice-specific language simplifies application development.
Source: http://www.voicexml.org
HP
25
Voice Based Internet Applications
Source: http://www.voicexml.org
HP
26
Voice XML Metadata
Voice Specific metadata Supports Syntactic interoperablity Text data to voice data Voice XML = XML + Voice Metadata
HP
27
VoiceXML – Possible Services
Information retrieval – News, sports, traffic, stock quotes.
e- Transactions (e- commerce, e- tailing, etc.) Financial: banking, stock trading.
Catalog browsing (generally as an adjunct to paper).
Telephone services Personal voice dialing, One- number find- me services.
Intranet – Inventory, HR services, corporate portals.
Unification – My Whatever: personal portals, personal agents, unified messaging.
Source: http://www.voicexml.org
HP
28
Information and Content Exchange (ICE)
Main Goal: efficient and extensible Content Syndication protocol for the Internet, using XML syntax Authors: Adobe, Kinecta, MS, Sun, Vignette et al.
Status: latest spec version 1.1, May 2000; submitted to W3C for review Implementations: Vignette Syndication Server, MS BizTalk, Kinecta Interact, … Web Site: http://www.icestandard.org
HP
31
What is the ICE Protocol?
Syndication Protocol for communication between Syndicators and Subscribers Metadata to define roles and responsibilities of involved parties: Subscriber vs. Syndicator, Requestor vs. Responder, Sender vs. Receiver format and method of content exchange (e.g., sequenced packages, pull vs. push model)
HP
32
ICE Applications
ICE vocabulary + domain vocabulary = complete application ICE establishes and manages the syndication delivers data logs events => content-independent metadata industry-specific vocabulary defines the content => domain-specific metadata Source: http://www.icestandard.org
HP
33
ICE Explained
ICE: Information and Content Exchange protocol Syndicator: A content aggregator and distributor Subscriber: A content consumer Subscription: An agreement between a subscriber and a syndicator for the delivery of content according to the delivery policy and other parameters in the agreement Collection: The current content of a subscription ICE Package: A delivery of commands to update a collection such as the addition of content items ICE Payload: The XML document used by ICE to carry protocol information. Examples include requests for packages, catalogs of subscription offers, usage logs and other management information Sources: InternetWeek; "ICE Cookbook, version 1.0" http://www.internetweek.com/ebizapps01/ebiz050701-3.htm
HP
34
ASCII-encoded image)
Content (domain-specific metadata)
XCM
( eXtended Content Management)
a framework that allows customers to classify content management offerings according to the business problems they address. The segments of XCM are
Content Development
- Developing static content and managing the process of its subsequent approval, versioning, storage, and retrieval.
Application Content Management
(Vignette) - Deploying content dynamically to a Web site and managing that content throughout its online lifecycle.
Content Delivery
- Delivering content through multiple channels to minimize customer waiting time and improve Web site stability and scalability.
Source :http://www.vignette.com/CDA/Site/0,2097,1-1-30-1458-1146-1743,00.html
HP
36
XCM
eXtended Content Management Content Development Management Content Authoring Digital Asset Management Software Configuration Management Document Process Management Application Content Management Metadata Management Recombination Personalization Content Delivery Edge Network Delivery Streaming Media Delivery Caching Source :http://www.vignette.com/
HP
37
Multiple heterogeneous metadata models with different tag names for the same data in the same GIS domain Kansas State FGDC Metadata Model
Theme keywords
: digital line graph, hydrography, transportation...
Title
: Dakota Aquifer
Online linkage
: http://gisdasc.kgs.ukans.edu/dasc/ Direct Spatial Reference Method: Vector Horizontal Coordinate System Definition: Universal Transverse Mercator
… … … ...
UDK Metadata Model
Search terms
: digital line graph, hydrography, transportation...
Topic
: Dakota Aquifer
Adress Id:
http://gisdasc.kgs.ukans.edu/dasc/ Measuring Techniques: Vector Co-ordinate System: Universal Transverse Mercator
… … … ...
HP
38
Different views of Metadata
Domain Independent Specifications (RDF) Frameworks/Infrastructures (XCM) Application Specific ICE Metadata Media Specific MPEG7, VoiceXML Domain Specific NewsML, FGDC/UDK
HP
39
Creating and Serving Metadata to Power the Life-cycle of Content
Taalee Infrastructure Services
Produce Aggregate
Where is the content? Whose is it?
Catalog/ Index
What is this content about?
Taalee Content Applications
Integrate Syndicate
What other content is it related to?
Personalize Interactive Marketing
What is the right content for this user?
What is the best way to monetize this interaction?
Taalee Semantic MetaBase
Broadcast, Wireline, Wireless, Interactive TV
HP
40
Taalee’s Intelligent Content Process
HP
41
Metadata Creation and Semanticization
•
Automatic Content Classification/Categorization
•
Metadata Creation/Extraction: Types of metadata created
Semantic Engine and WorldModel are trademarks of Taalee, Inc.
Metadata Extraction is a patented technology of Taalee, Inc.
HP
42
Forms/Types/Ingest of Content
Sources: Web Sites, Content Feeds and Private Repositories Types: Text, Graphics, Audio, Video, Multimedia Forms: Unstructured text, Semi-structured text, Structured text (+Media); Static or Dynamic Ingest: Feed (push), Web (pull), Repository/Database (usually pull)
HP
43
Content Handling/Ingest
Infrastructure/Exchange Feed Handlers Crawlers/Screen Scrapers/Bots Software Agents Centralized, Distributed, Mobile/Migratory
HP
44
Information Extraction for Metadata Creation
Global/Enterprise Web Repositories Nexis UPI AP Documents . . .
Digital Videos . . .
Digital Maps Digital Images Data Stores . . .
Digital Audios EXTRACTORS
METADATA
HP
45
Extracting a Text Document:
Syntactic approach
INCIDENT MANAGEMENT SITUATION REPORT
LAYOUT
Friday August 1, 1997 - 0530 MDT NATIONAL PREPAREDNESS LEVEL II CURRENT SITUATION: Alaska continues to experience large fire activity. Additional fires have been staffed for structure protection.
SIMELS, Galena District, BLM .
This fire is on the east side of the Innoko Flats, between Galena and McGr The fore is active on the southern perimeter, which is burning into a continuous stand of black spruce. The
Date => day month int ‘,’ int
35% contained, while protection of the historic cabit continues.
CHINIKLIK MOUNTAIN, Galena District, BLM .
A Type II Incident Management Team (Wehking) is assigned to the Chiniklik fire. The fire is contained. Major areas of heat have been mopped up. The fire is contained. Major areas of heat have been mopped-up. All crews and overhead will mop-up where the fire burned beyond the meadows. No flare-ups occurred today. Demobilization is planned for this weekend, depending on the results of infrared scanning.
HP
46
Traditional Text Categorization Customer Training Set Statistical/AI Techniques Classify Place in a taxonomy Customer Article Feed 4715 Routing/Distribution Classification of Article 4715 Standard Metadata
Feed Source: iSyndicate Posted Date: 11/20/2000
Taalee’s Categorization & Automatic Metadata Creation Knowledge-base & Statistical/AI Techniques Taalee Training Set Customer Training Set Classify Place in a taxonomy
Standard metadata Semantic metadata
Catalog Metadata Article 4715 Metadata
Feed Source: iSyndicate Posted Date: 11/20/2000 Company Name: France Telecom , Equant Ticker Symbol: FTE , ENT Exchange: NYSE Topic: Company News
Automated Content Enrichment (ACE) FTE
Company Analysis Conference Calls Earnings Stock Analysis
ENT
Company Analysis Conference Calls Earnings Stock Analysis
NYSE
Member Companies Market News IPOs
Classification of Article 4715 Article Feed 4715 Precise syndication/filtering Routing/Distribution Map to another taxonomy
Automatic Categorization & Metadata Tagging (unstructured text/transcript of A/V) ABSOLUTE CONTROL OF THE SENATE IS STILL IN QUESTION. AS OF TONIGHT, THE REPUBLICANS HAVE 50 SENATE SEATS AND THE DEMOCRATS 49. IN WASHINGTON STATE, THE SENATE RACE REMAINS TOO CLOSE TO CALL. IF THE DEMOCRATIC CHALLENGER UNSEATS THE REPUBLICAN IUMBENT THE SENATE WILL BE EVENLY DIVIDED. IN MISSOURI, REPUBLICAN SENATOR JOHN Auto ASHCROFT SAYS HE WILL NOT CHALLENGE HIS LOSS TO GOVERNOR MEL CARNAHAN GOVERNOR CARNAHAN'S WIFE IS EXPECTED TO TAKE HIS PLACE. IN THE HIGHEST PROFILE SENATE EVENT OF THE NIGHT, HILLARY CLINTON WON THE NEW YORK SENATE SEAT. SHE IS THE FIRST FIRST LADY TO RUN MUCH LESS WIN. Video Segment with Associated Text Segment Description Semantic Metadata HP
49
Automatic Categorization & Metadata Tagging (Web page) Video with Editorialized Text on the Web Auto Categorization Semantic Metadata HP
50
Automatic Categorization & Metadata Tagging (Feed) Text From Bllomberg Auto Categorization Semantic Metadata HP
51
Taalee Extraction and Knowledgebase Enhancement
Web Page Enhanced Metadata Asset Extraction Agent
HP
52
Basis for Semantics
A.
Facts/Concepts/Terms/Entities Dictionary, Thesaurus, Reference Data, Vocabulary
B.
Facts with Relationships Taxonomy/(Categories), Ontology Domain Modeling
(e.g., Golf = golfer, tournament name, golf course, event)
Knowledge Base
HP
53
Basis for Semantics
C.
Reasoning/Inference (Statistical) (Information Retrieval) Statistical Learning/AI (Bayesian, Neural Networks, HMM,…) Logic Based (Description Logic) Natural Language/Grammar (part of speech,..)
HP
54
Alternatives for Metadata Extraction
Word or Phrase deeper understanding Statistical methods/Cluster Analysis Learning/AI and Collab. Filtering Reference data/Concept-terms/ Dictionary/Thesaurus By topic/industry/subject/domain Ontologies/Domain Models KnowledgeBase By Entities and Relationships
HP
55
Open Directory Project (ODP): Classification/Taxonomy & Directory
HP
56
Ontology
Standardize meaning, description, representation of involved attributes Capture the semantics involved via domain characteristics Allow knowledge sharing and reuse (Ontological Commitment)
HP
57
An Ontology
HP
59
Example: Interrelated ontologies
RECREATIONAL LANDFILL SITE CULTIVATED AREA GREENLAND AREA LAND (SITE) LAND BANK ZONING COMERCIAL LAND USE INDUSTRIAL WASTE DISPOSAL RURAL MILITARY AGRICULTURAL RESIDENTIAL SOLID HAZARDOUS RESOURCE REC.
LANDFILL RECYCLING shredding magnetic separation screening washing SEWAGE FIRE AVALANCHE STORM FLOOD TSUNAMI causes NATURAL DISASTER VOLCANO causes causes EARTHQUAKE causes LANDSLIDE
Large Vocabularies/ Taxonomies/Ontologies
WordNet The Medical Subject Headings (MeSH): NLM's controlled vocabulary used for indexing articles, for cataloging books and other holdings, and for searching MeSH-indexed databases, including MEDLINE . MeSH terminology provides a consistent way to retrieve information that may use different terminology for the same concepts. Year 2000 MeSH includes more than 19,000 main headings, 110,000 Supplementary Concept Records (formerly Supplementary Chemical Records), and an entry vocabulary of over 300,000 terms.
HP
61
Metadata enabled Applications
Confidential HP
Metadata Usage: Impact on Search & Query processing
traditional queries based on keywords attribute based queries content-based queries
HP
63
Oingo.com
Oingo Ontology – ODP based(?), the database of millions of concepts and relationships that powers Oingo's semantic technology Oingo Seek - the database of millions of concepts and relationships that powers Oingo's semantic technology Oingo Sense - the knowledge extraction tool that uncovers the essential meaning of information by sensing concepts and context Oingo Lingua - the language of meaning used to state intent. The basis for intelligent interaction Assets catalogued are Web sites or Web pages.
HP
64
Use of Categories for Search
After 3 or 4 clicks
HP
65
Metadata & Search
Metadata can improve search significantly, but metadata enables much more than search Alternatives for improving search: clustering, link and other analysis (e.g., Google’s Link Flux analysis), classification as context, ontologies, metadata, knowledgebases …
HP
69
Metadata Usage: Keyword, Attribute and Content Based Access
The VisualHarness system at LSDIS/UGA
HP
70
Keyword Search vs Attribute Search with Semantic metadata
Taalee Metadata on
Football Assets
Metadata from Typical Virage Search on Cataloging of Football football touchdown Assets
Brian Griese Interview Part Four Brian Griese talks about the first touchdown he ever threw. URL:
http://cbs.sportsline...
Jimmy Smith Interview Part Seven Jimmy Smith explains his philosophy on showboating. URL:
http://cbs.sportsline...
Rich Media Reference Page Baltimore 31, Pit 24 http://www.nfl.com
Quandry Ismail and Tony Banks hook up for their third long touchdown, this time on a 76 yarder to extend the Raven’s lead to 31-24 in the third quarter.
League: Teams: Score: Players: Event: Produced by: Posted date: Professional Ravens, Steelers Bal 31, Pit 24 Quandry Ismail, Tony Banks Touchdown NFL.com
2/02/2000 HP
71
Taalee’s Semantic Search
Highly customizable, precise and freshest A/V search Context and Domain Specific Attributes Delightful, relevant information, exceptional targeting opportunity Uniform Metadata for Content from Multiple Sources, Can be sorted by any field HP
72
HP
73
Taalee Directory Georgia Bulldogs System recognizes ENTITY & CATEGORY
Careless whisper Taalee Directory
Semantic Relationships
HP
76
Metadata Application Example
Semantic Applications for highly relevant and fresh content: Personalization and Targeting/interactive marketing
Please contact Taalee for live demonstrations
HP
77
Personalized Directory
Obtain a whole universe of information (that you may not even have thought of) about some entities that have always been of interest to you. Please enter such semantic keywords below.
Change Context
Personalized Queries & Hot Topics
PERSONALIZATION
Personalized Queries 1. My Stock Portfolio
Microsoft suffers serious hack attack Cisco Systems Inc Analyst Safa Rashtchy on Yahoo!
PeopleSoft, Inc AT&T Corp. more…
2. My Football Fantasy Team
Gators' Spurrier ready for 'big' game Tech's Vick looks to become complete QB Bucs excited about Hamilton Edwards explains reasons for leaving BYU
1. Election 2000
more… Video: Explaining the electoral map more… Trailer - Runaway Bride Patrick
2. Middle East Peace Conflict
Movie Trailer: "Stepmom" Conspiracy Theory more… Pentagon probes Cole's security
4. Pink Floyd Collection
Set the Controls for the Heart of the Sun… Wish You Were Here Napster Lawsuit Keep Talking Creative Nomad II The Post War Dream more… more… more…
Metadata: Targeting
HP
80
Semantic/Interactive Targeting
Buy Al Pacino Videos Buy Russell Crowe Videos Buy Christopher Plummer Videos Buy Diane Venora Videos Buy Philip Baker Hall Videos Buy The Insider Video Precisely targeted through the use of Structured Metadata and integration from multiple sources
Web: Extreme Personalization
Realtime Feeds Web sites and Pages Content Databases Interests, Preferences
Time-Shifted Content Aggregator
Content Personalized Content
Semantic Engine TM
Personalized Content Structured, Hi-Quality Semantic Metabase HP
82
Application of Semantic Metadata and Automatic Content Enrichment MyMedia $
w
MyStocks
News Sports Music % %
User has already completed Web Based registration and personalization at Voquette’s Enterprise Customer site.
User’s “Wireless Home page” shows the categories for his interests. There is an alert (new content) for his stock and sports categories.
HP
83
Application of Semantic Metadata and Automatic Content Enrichment MyMedia $
w
MyStocks
News Sports Music % %
My Stocks CSCO
NT IBM Market
Clicking on MyStocks brings down user’s Personal Portfolio list. The user wants to see news items about Cisco (see next slide). Search at the bottom is a semantic search that understands the financial domain, and the knowledge of user’s portfolio. Typically search can be done by typing one word or selecting from a dynamic, personalized menu.
HP
84
Application of Semantic Metadata and Automatic Content Enrichment MyMedia $
w
MyStocks
News Sports Music
My Stocks
% NT IBM Market
CSCO Analyst Call
Conf Call Earnings %
Different types of recent audio content about Cisco are available.
The user clicks to see a listing of Analyst Calls on Cisco (next slide).
Icons at the bottom of the screen enable contextually relevant functions: listen, set alert on story, add to playlist.
HP
85
Application of Semantic Metadata and Automatic Content Enrichment MyMedia $
w
MyStocks
% News Sports % Music
My Stocks CSCO
NT IBM Market
CSCO Analyst Call
Conf Call Earnings
CSCO Analysis
11/08 ON24 Payne 11/07 ON24 H&Q CC 11/06 CBS Langlesis %
Clicking on the link for Cisco Analyst Calls displays a listing sorted by date. Semantic filtering uses just the right metadata to meet screen and other constrains. E.g., Analyst Call focuses on the source and analyst name or company. The icon denote additional metadata, such as “Strong Buy” by H&Q Analyst.
HP
86
iTV: Taalee’s Extreme Personalization
Content Provider (DBS, DISH, Wink, AOL-TV)
Content, “Programs” Meta-Data Tagged Content
Semantic Engine TM
Structured, Hi-Quality Semantic Metabase Immediate Interests, Preferences, Personalized Content Capsules, Redirects and Programming HP
87
Metadata for Automatic Content Enrichment
Interactive Television This screen is customizable with interactivity feature using metadata such as whether there is a new Conference Call video on CSCO.
Part of the screen can be automatically customized to show conference call specific information – including transcript, participation, etc. all of which are relevant metadata Conference Call itself can have embedded metadata to support personalization and interactivity.
This segment has embedded or referenced metadata that is used by personalization application to show only the stocks that user is interested in.
HP
88
Metadata in Enterprise Apps
Processing Production Support Network Content Affiliate Feeds Public Sources
Categorize Catalog Integrate
Rich Data Metabase
Filter, Search, Consolidate, Personalize, Archive, Licensing, Syndication
HP
89
(1.33) – 12/06/00 ABC (2.53) - 12/06/00 CBS (5.16) - 12/06/00 ABC (2.46) - 12/06/00 FOX (1.33) - 12/06/00 NBC -- Breaking News - Gore Demands That Recount Restart (1.33) - 12/06/00 ABC Gore Says Fla. Can't Name Electors (2.33) - 12/06/00 CBS Bush Meets Colin Powell at Ranch (3.12) - 12/06/00 NNS Market Tumbles on Earnings Warning (0.32) - 12/06/00 CBS Barak Outlines His Peace Plan (1.33) - 12/06/00 CBS (1.33) - 12/06/00 CBS (3.57) - 12/06/00 CBS (4.27) - 12/06/00 ABC (3.44) - 12/06/00 FOX (7.24) - 12/06/00 CBS (5.33) - 12/06/00 Description
Produced by : CNN Posted Date : 12/07/2000 Reporter : Event : David Lewis Election 2000 Location : Tallahassee, Florida, USA People : Al Gore TALLAHASSEE, Florida (CNN) – Though the two presidential candidates have until noon Wednesday to file briefs in Al Gore's appeal to the Florida Supreme Court, the outcome of two trials set on the same day in Leon County, Florida, may offer Gore his best hope for the presidency. Democrats in Seminole County are seeking to have 15,000 absentee ballots thrown out in that heavily Republican jurisdiction -- a move that would give Gore a lead of up to 5,000 votes statewide. Lawyers for the plaintiff, Harry Jacobs, claim the ballots should be rejected because they say County Elections Supervisor Sandra Goard allowed Republican workers to fill out voter identification numbers on 2,126 incomplete absentee ballot applications sent in by GOP voters, while refusing to allow Democratic workers to do the same thing for Democratic voters. The GOP says that suit, and one similar to it from Martin County, demonstrates Democratic Party politics at its most desperate. Gore is not a party to either of those lawsuits. On Tuesday, the judge in the
HP
91
Video Metadata’s role in emerging iTV infrastructure Enhanced Digital Cable MPEG Encoder
Create Scene Description Tree
Channel sales through Video Server Vendors, Video App Servers, and Broadcasters “Cisco Systems” Node Taalee Semantic Engine MPEG-2/4/7 MPEG Decoder
Retrieve Scene Description Track
Node = AVO Object License metadata decoder and semantic applications to device makers Scene Description Tree
GREAT USER EXPERIENCE
Enhanced XML Description
Produced by: Fox Sports
Creation Date: 12/05/2000
League: NFL
Teams: Seattle Seahawks,
Atlanta Falcons
Players: John Kitna
Coaches: Mike Holmgren,
Dan Reeves
Location: Atlanta Object Content Information (OCI) “Cisco Systems” Metadata-rich Value-added Node HP
92
Intelligent Metadata Creation Usage
Metadata for Intelligent Content Content which does contain the words the user asked for Extractor Agents + Content which does not contain the words the user asked for, but is about what he asked for.
Value-added Metadata + Content the user did not think to ask for, but which he needs to know.
Semantic Associations HP
93
Intelligent Content via Value-Added Metadata
HP
94
Example 1 – Snapshots (“Jamal Anderson”) Search for ‘Jamal Anderson’ in ‘Football’ Click on first result for Jamal Anderson View the original source HTML page. Verify that the source page contains no mention of Team name and League name . They were Taalee’s value additions to the metadata to facilitate easier search.
View metadata. Note that Team name and League name are also included in the metadata HP
98
Example 2 – Snapshots (“Gary Sheffield”) Search for ‘Gary Sheffield’ in ‘Baseball’ View the original source HTML page. Verify that the source page contains no mention of Team name and League name . They were Taalee’s value additions to the metadata to facilitate easier search.
Click on first result for Gary Sheffield View metadata. Note that Team name and League name are also included in the metadata HP
99
Intelligent Content – Value-Added Metadata
Some Metadata are obtained
explicitly from the asset
. Others (not present in the asset) are added by Taalee using its
semantic relationships
.
The asset is
richly, fully described in the many ways the
users chose to interact.
Posted Date
Date of asset posting – Extracted automatically Name of content provider that produced the asset
Producer Name Rich Media Sports Asset League Name
Name of league to which the payer’s team belongs –
Not mentioned explicitly in asset
–
Value added by Taalee’s processing based on semantic associations.
Name of sport
Sport Team Name
Name of team for which player plays –
Not mentioned explicitly in asset
–
Value added using Taalee’s semantic relationships
Name of players mentioned explicitly in the asset – Extracted automatically
Player Names Legend: X Y means Taalee uses X to add Y as value-added metadata to the asset HP
100
Intelligent Content via Semantic Associations
HP
101
Example (test on http://directory.mediaanywhere.com) Links to news on companies that compete against Commerce One Search for company ‘Commerce One’ Links to news on companies Commerce One competes against (To view news on Ariba, click and automatically HP
103
ASP/Enterprise hosted Internal Source 1 Research Internal Source 2 Extractor Agent 1 Extractor Agent 2 External feeds/Web (e.g. Reuters) Extractor Agent 3 Story on Cisco Story on Lucent World Model 3
Consults Knowledge Base for Cisco ’s competition Returns result: Lucent is a competitor of Cisco
2 Semantic Engine
Lucent story from external feeds picked for publishing as “semantically related” to Cisco story – passed on to Dashboard
4 1
Cisco story from PW Source 1 passed on to add semantic associations
Taalee Metabase Semantic Application Third-party Content Mgmt And Syndication Metadata centric Content Management Architecture
XCM-compliant metadata, XML or other format
HP
104
Semantic Associations
supported by Taalee Semantic Engine Intelligent Content = What You Asked for + What you need to know!
Related Stock News
COMPANIES in Same or Related INDUSTRY
COMPANY Competition
COMPANIES in INDUSTRY with Competing PRODUCTS
Technology Products
Important to INDUSTRY or COMPANY
Industry News EPA
Regulations
SEC
Impacting INDUSTRY or Filed By COMPANY
HP
105
Semantic Web Application Example: Financial Advisor Research Dashboard
Automatic Collation of semantically related digital media information from Multiple Sources Research Inferred Automatically Semantically Related News Not Specifically Asked For Semantic Search/ Personalization, etc.
HP
106
A vision for future
Semantic Web, Complex Relationships and Knowledge Discovery, E.g., InfoQuilt project at LSDIS Lab, Univ. of Georgia
Beyond RDF – one proposal
(cf: Ora Lassila)
Structural modeling obviously not enough we need a “logic layer” on top of RDF some type of description logic is a possibility Exposing a wide variety of data sources as RDF useful, particularly if we have logic/rules is which allow us to draw inference from this data RDF + DL = “Frame System for WWW” Source : www.ontoknowledge.org/oil
HP
108
Semantic Web -
next step in Web evolution
“ A Web in which machine reasoning will be ubiquitous and devastatingly powerful.” [Berners-Lee] “A place where the whim of a human being and the reasoning of a machine coexist in an ideal, powerful mixture.” [Berners-Lee] “A semantic Web would permit more accurate and efficient Web searches, which are among the most important Web based activities.” [Berners-Lee] A personal definition Semantic Web: The concept that Web-accessible content can be organized semantically, rather than though syntactic and structural methods.
HP
109
What is DAML
(DARPA Agent Markup Language)
a proposal to create technologies that will enable software agents to dynamically identify and understand information sources, and to provide interoperability between agents in a semantic manner.
Based on RDF+XML Agent readable Tags www.daml.org
DAML Example
Three layered Architecture Of Semantic Web
Logical Layer Formal Semantics and Reasoning Support – OIL, DAML-O Schema Layer Definition of Vocabulary RDF Schema Data Layer Simple data model and syntax for metadata - RDF
OIL – as RDF Extension
<
rdfs:Class
rdf:ID=” herbivore ”> <
rdf:type
rdf:resource=” http://www.ontoknowledge.org
/# DefinedClass ”/> <
rdfs:subClassOf
<
rdfs:subClassOf
> rdf:resource=”# animal ”/> <
oil:NOT
>
DAML and OIL – Evolving towards Semantic Web
OIL Mission OIL is a Web-based representation and inference layer for ontologies, which combines the widely used modeling primitives from frame-based languages with the formal semantics and reasoning services provided by description logics
Knowledge Discovery Example
Earthquake Sources
(USGS, NEIC)
Nuclear Test Sources
(Oklahoma Observatory, etc.)
Nuclear Test May Cause Earthquakes
Is it really true?
Complex Relationships
A nuclear test
could have caused
an earthquake if the earthquake occurred
some time after
the nuclear test was conducted and
in a nearby region
.
NuclearTest <= Causes dateDifference Earthquake ( NuclearTest.eventDate, Earthquake.eventDate ) < 30 AND distance ( NuclearTest.latitude, NuclearTest.longitude, Earthquake,latitude, Earthquake.longitude ) < 10000
Knowledge Discovery Example
When was the first recorded nuclear test conducted?
1950 Find the total number of earthquakes with a magnitude 5.8 or higher on the Richter scale per year starting from 1900 Increase in number of earthquakes since 1945
Knowledge Discovery Example…
For each group of earthquakes with magnitudes in the ranges 5.8-6, 6-7, 7-8, 8-9, and >9 on the Richter scale per year starting from 1900, find average number of earthquakes Number of earthquakes with magnitude > 7 almost constant. So nuclear tests probably only cause earthquakes with magnitude < 7
Knowledge Discovery Example
… Find pairs of nuclear tests and earthquakes such that the earthequake occurred within 30 days after the test was conducted and in a radius of 10000 miles from the epicenter of the earthquake Demo
Resources/References
RDF: w w w .
w 3 .
o r g / T R / R E C r d f s y n t a x / ICE: www.icestandard.org
Meta Object Facility (MOF) Specification, Version 1.3, September 27, 1999: http://cgi.omg.org/cgi-bin/doc?ad/99-09-05 XML Metadata Interchange (XMI) Specification, Version 1.1, October 25, 1999: http://cgi.omg.org/cgi-bin/doc?ad/9910-02 http://cgi.omg.org/cgi-bin/doc?ad/99-10-03 DAML: www.daml.org
NEWSML: newsshowcase.reuters.com
PRISM: www.prismstandard.org/techdev/prismspec1.asp
XCM: www.vignette.com
OIL: www.ontoknowledge.org/oil SEMANTICWEB: www.semanticweb.org
VOICEXML: www.voicexml.org
MPEG7: www.darmstadt.gmd.de/mobile/MPEG7/ Taalee: www.taalee.com
Oingo: www.oingo.com
Multimedia Data Management: Using Metadata to Integrate and Apply Digital Media, Amit Sheth and Wolfgang Klas, Eds., McGraw Hill, ISBN: 0-07-057735-8, 1998.