Taalee Presentation - PersonalWebIWayanSW

Download Report

Transcript Taalee Presentation - PersonalWebIWayanSW

The Mysteries of Metadata

Workshop at Content World 2001, Burlingame, CA. May 15, 2001 Amit Sheth [email protected]

Founder/CEO, Taalee ( www.ta

al ee.com

) [Taalee is now Semagix: www.semagix.com

] Also, Director, Large Scale Distributed Information Systems ( LSDIS ) Lab, University Of Georgia (lsdis.cs.uga.edu) Metadata Extraction is a patented technology of Taalee, Inc.

Semantic Engine and WorldModel are trademarks of Taale. Inc.

Confidential HP

Workshop Agenda

What is Metadata ?

Metadata Descriptions and Standards Metadata Storage/Exchange/Infrastructure (Automated) Metadata Creation/Extraction/Tagging Metadata Usage/Applications

HP

2

What is Metadata?

Data about data Statements, contexts Recursive – data about “data about data” Applications Content management Cataloguing Information retrieval, search … "A Web content repository without metadata is like a library without an index," - Jack Jia, IWOV

HP

3

Information Interoperability:

key metadata objective and benefit

System Syntax Structure Semantics Protocols Metadata Domain Modeling, Ontologies

HP

4

Semantics

Meaning, Understanding Facts, Context, Reasoning Related to: exchange, usage, application

HP

5

A metadata classification

User Move in this Ontologies

Classifications Domain Models

direction to information overload!!

tackle Domain Specific Metadata

area, population (Census), land-cover, relief (GIS),metadata concept descriptions from ontologies

Domain Independent (structural) Metadata

(C++ class-subclass relationships, HTML/SGML Document Type Definitions, C program structure...)

Direct Content Based Metadata

(inverted lists, document vectors, WAIS, Glimpse, LSI)

Content Dependent Metadata

(size, max colors, rows, columns...)

Content Independent Metadata

(creation-date, location, type-of-sensor...)

Data

(Heterogeneous Types/Media) HP

6

Types of Metadata

for digital media

Media type-specific metadata eg.,texture of images,font size… Media processing-specific metadata eg.,search, retrieval, personalized filtering Content Specific metadata eg.,rocket related video and documents

HP

7

Metadata for Digital Data

Metadata

Q-Features [Jain and Hampapur] R-Features [Jain and Hampapur] Meta-Features [Jain and Hampapur] Impression Vector [Kiyoki et al.] NDVI, Spatial Registration [Anderson and Stonebraker] Speech Feature Index [Glavitsch et al.] Topic Change Indices [Chen et al.] Document Vectors [ Deerwester et al.] Inverted Indices [Kahle and Medlar] Content Classification Metadata [Bohm and Rakow] Document Composition Metadata [Bohm and Rakow] Metadata Templates [Ordille and Miller] Land Cover, Relief [Sheth and Kashyap] Parent Child Relationships [Shklar et al.] Contexts [Sciore et al., Kashyap and Sheth] Concepts from Cyc [Collet et al.] User’s Data Attributes [Shoens et al.] Domain Specific Ontologies [Mena et al.]

Data Type

Image, Video Image, Video Image, Video Image Image Audio Audio Text Text MultiMedia MultiMedia Media Independent Media Independent Text Structured Structured Text, Structured Media Independent

Metadata Type

Domain Specific Domain Independent Content Independent Content Descriptive Domain Specific Direct Content Based Direct Content Based Direct Content Based Direct Content Based Domain Specific Domain Independent Domain Specific Domain Specific Domain Independent Domain Specific Domain Specific Domain Specific Domain Specific HP

8

Types of Specs and Standards

(or MetaModels)

Domain Independent: (MCF), RDF , MOF, DublinCore Media Specific: MPEG4, MPEG7, VoiceXML Domain/Industry Specific (metamodels): MARC (Library), FGDC and UDK (Geographic), NewsML (News), PRISM (Publishing) Application Specific: ICE (Syndication) Exchange/Sharing: XCM, XMI Orthogonal/(Other): RDFS, namespaces, ontologies, domain models, (DAML, OIL)

HP

9

what RDF can do for metadata ?

Designed to impose structural constraint on syntax to support consistent encoding, exchange and processing of metadata. Domain Independent Metadata standard.

HP

10

RDF

(Resource Description Format)

Resource Property Value •RDF data consists of nodes and attached attribute/value pairs •Nodes can be any web resources (pages, servers, basically anything for which you can give a URI), even other instances of metadata. •Attributes are named properties of the nodes, and their values are either atomic (text strings, numbers, etc.) or other resources or metadata instances.

HP

11

RDF Example 1

dc:title Mysteries of Metadata URI:TALK dc:creator URI:AMIT

< dc:title >Mysteries of Metadata < dc:creator rdf:resource = “URI:AMIT”/> HP

12

RDF Example 2

dc:title Mysteries of Metadata URI:TALK BIB:Aff URI:LIB dc:creator URI:AMIT BIB:Name Amit Sheth BIB:Email [email protected]

HP

13

RDFS (RDF Schema)

Enables resource description communities to define (and share) vocabularies (museum, library, e commerce…) Vocabulary (in RDFS) = the meaning, characteristics, and relationships of a set of properties.

HP

14

RDF Based Web

RDF Schemas RDF/XML Descriptions Resources HTML

Source:http://www.w3c.rl.ac.uk

HP

15

Dublin Core Metadata Initiative

Simple element set designed for resource description International, inter-discipline, W3C community consensus “Semantic” interface among resource description communities (very limited form of semantics) Source:www.desire.org

HP

16

Dublin Core RDF

DC:Title = "I've Never Metadata I've Never Liked“ DC:Creator = "Mary Crystal“ DC:Subject = "Metadata, Dublin Core, Stuff"/> HP

17

MOF

(Metadata Object Facility) and XMI

MOF models metadata using a subset of UML that is relevant to modeling metadata (class models - classes, associations and subtyping), a set of rules for mapping the elements of the MOF Core to CORBA IDL XML Metadata Interchange (XMI) is an extension of the MOF into the XML space

HP

18

NewsML

NewsML is a packaging and metadata format for news content.

NewsML is developed by the International Press Telecommunications Council (IPTC), a consortium of news providers, mostly in the print or wire-service industries. Since it deals only with packaging and metadata, NewsML is complementary both to news content formats like NITF and to syndication protocols like ICE .

HP

19

NewsML…

It can be used by news providers to combine their pictures, video, text, graphics and audio files in news output available on web sites, mobile phones, high end desktops interactive television and any other device.

accurate, objective set of description tools, which help qualify the information and make the search more precise.

NewsML allows a range of metadata to be attached to a multi-media story, including a detailed computer readable description of what an item is about.

HP

20

Example of the end-to-end flow NewsML

The content provider supplies NewsML packaged media content to the operator. The content is categorized as current events, finance, sport, etc. and updated hourly.

Source:http://www.mediabricks.com

The operator receives NewsML data from the content provider. The content server automatically pushes updated news articles to all news service subscribers. Consumers sign up for the news service directly on the device. When using the news service, the user browses through the categories and reads the news articles. The news articles are presented in a continuous flow (one after the other) without end-user interaction.

HP

21

PRISM

Publishing Requirements for Industry Standard Metadata Version: 1.0, April 2001 Authors: IDEAlliance (Adobe, Vignette, Kinecta et al.) Idea: “a standard for interoperable content

description, interchange, and reuse in both traditional and electronic publishing contexts

” Web site: http://www.prismstandard.org

HP

22

PRISM Design

Built on existing standards like Dublin Core (DC), RDF, XML Designed to be used in a simple, straightforward way over the Internet Compatible with NewsML Integrates easily with ICE (for syndication) Vocabulary: Basic: DC Extensions: “Controlled Vocabularies”, e.g., “North American Industrial Classification System“ (NAICS) HP

23

PRISM Example

< dc :identifier rdf:resource="http://wanderlust.com/content/2357845" /> < dc :description>Photograph taken at 6:00 am on Corfu with two models < dc :title>Walking on the Beach in Corfu < dc :creator>John Peterson < dc :contributor>Sally Smith, lighting < dc :format>image/jpeg

(Source: PRISM spec v. 1; http://www.prismstandard.org/techdev/prismspec1.asp)

HP

24

VoiceXML

A language for specifying voice dialogs.

 Voice dialogs use audio prompts and text- to- speech (TTS) for output; touch- tone keys (DTMF) and automatic speech recognition (ASR) for input.

Goal is to bring the advantages of web-based development and content delivery to interactive voice response applications.

High- level voice-specific language simplifies application development.

Source: http://www.voicexml.org

HP

25

Voice Based Internet Applications

Source: http://www.voicexml.org

HP

26

Voice XML Metadata

Voice Specific metadata Supports Syntactic interoperablity Text data to voice data Voice XML = XML + Voice Metadata

HP

27

VoiceXML – Possible Services

 Information retrieval – News, sports, traffic, stock quotes.

 e- Transactions (e- commerce, e- tailing, etc.)  Financial: banking, stock trading.

 Catalog browsing (generally as an adjunct to paper).

 Telephone services  Personal voice dialing, One- number find- me services.

 Intranet – Inventory, HR services, corporate portals.

 Unification – My Whatever: personal portals, personal agents, unified messaging.

Source: http://www.voicexml.org

HP

28

Information and Content Exchange (ICE)

Main Goal: efficient and extensible Content Syndication protocol for the Internet, using XML syntax Authors: Adobe, Kinecta, MS, Sun, Vignette et al.

Status: latest spec version 1.1, May 2000; submitted to W3C for review Implementations: Vignette Syndication Server, MS BizTalk, Kinecta Interact, … Web Site: http://www.icestandard.org

HP

31

What is the ICE Protocol?

Syndication Protocol for communication between Syndicators and Subscribers Metadata to define roles and responsibilities of involved parties: Subscriber vs. Syndicator, Requestor vs. Responder, Sender vs. Receiver format and method of content exchange (e.g., sequenced packages, pull vs. push model)

HP

32

ICE Applications

ICE vocabulary + domain vocabulary = complete application ICE establishes and manages the syndication delivers data logs events => content-independent metadata industry-specific vocabulary defines the content => domain-specific metadata Source: http://www.icestandard.org

HP

33

ICE Explained

ICE: Information and Content Exchange protocol Syndicator: A content aggregator and distributor Subscriber: A content consumer Subscription: An agreement between a subscriber and a syndicator for the delivery of content according to the delivery policy and other parameters in the agreement Collection: The current content of a subscription ICE Package: A delivery of commands to update a collection such as the addition of content items ICE Payload: The XML document used by ICE to carry protocol information. Examples include requests for packages, catalogs of subscription offers, usage logs and other management information Sources: InternetWeek; "ICE Cookbook, version 1.0" http://www.internetweek.com/ebizapps01/ebiz050701-3.htm

HP

34

PdXIWZQ8IiPLhHrQcrjxAQ8VquFJS8vDC … (

ASCII-encoded image)

Content (domain-specific metadata)

XCM

( eXtended Content Management)

a framework that allows customers to classify content management offerings according to the business problems they address. The segments of XCM are

Content Development

- Developing static content and managing the process of its subsequent approval, versioning, storage, and retrieval.

Application Content Management

(Vignette) - Deploying content dynamically to a Web site and managing that content throughout its online lifecycle.

Content Delivery

- Delivering content through multiple channels to minimize customer waiting time and improve Web site stability and scalability.

Source :http://www.vignette.com/CDA/Site/0,2097,1-1-30-1458-1146-1743,00.html

HP

36

XCM

eXtended Content Management Content Development Management Content Authoring Digital Asset Management Software Configuration Management Document Process Management Application Content Management Metadata Management Recombination Personalization Content Delivery Edge Network Delivery Streaming Media Delivery Caching Source :http://www.vignette.com/

HP

37

Multiple heterogeneous metadata models with different tag names for the same data in the same GIS domain Kansas State FGDC Metadata Model

Theme keywords

: digital line graph, hydrography, transportation...

Title

: Dakota Aquifer

Online linkage

: http://gisdasc.kgs.ukans.edu/dasc/ Direct Spatial Reference Method: Vector Horizontal Coordinate System Definition: Universal Transverse Mercator

… … … ...

UDK Metadata Model

Search terms

: digital line graph, hydrography, transportation...

Topic

: Dakota Aquifer

Adress Id:

http://gisdasc.kgs.ukans.edu/dasc/ Measuring Techniques: Vector Co-ordinate System: Universal Transverse Mercator

… … … ...

HP

38

Different views of Metadata

Domain Independent Specifications (RDF) Frameworks/Infrastructures (XCM) Application Specific ICE Metadata Media Specific MPEG7, VoiceXML Domain Specific NewsML, FGDC/UDK

HP

39

Creating and Serving Metadata to Power the Life-cycle of Content

Taalee Infrastructure Services

Produce Aggregate

Where is the content? Whose is it?

Catalog/ Index

What is this content about?

Taalee Content Applications

Integrate Syndicate

What other content is it related to?

Personalize Interactive Marketing

What is the right content for this user?

What is the best way to monetize this interaction?

Taalee Semantic MetaBase

Broadcast, Wireline, Wireless, Interactive TV

HP

40

Taalee’s Intelligent Content Process

HP

41

Metadata Creation and Semanticization

•

Automatic Content Classification/Categorization

•

Metadata Creation/Extraction: Types of metadata created

Semantic Engine and WorldModel are trademarks of Taalee, Inc.

Metadata Extraction is a patented technology of Taalee, Inc.

HP

42

Forms/Types/Ingest of Content

Sources: Web Sites, Content Feeds and Private Repositories Types: Text, Graphics, Audio, Video, Multimedia Forms: Unstructured text, Semi-structured text, Structured text (+Media); Static or Dynamic Ingest: Feed (push), Web (pull), Repository/Database (usually pull)

HP

43

Content Handling/Ingest

Infrastructure/Exchange Feed Handlers Crawlers/Screen Scrapers/Bots Software Agents Centralized, Distributed, Mobile/Migratory

HP

44

Information Extraction for Metadata Creation

Global/Enterprise Web Repositories Nexis UPI AP Documents . . .

Digital Videos . . .

Digital Maps Digital Images Data Stores . . .

Digital Audios EXTRACTORS

METADATA

HP

45

Extracting a Text Document:

Syntactic approach

INCIDENT MANAGEMENT SITUATION REPORT

LAYOUT

Friday August 1, 1997 - 0530 MDT NATIONAL PREPAREDNESS LEVEL II CURRENT SITUATION: Alaska continues to experience large fire activity. Additional fires have been staffed for structure protection.

SIMELS, Galena District, BLM .

This fire is on the east side of the Innoko Flats, between Galena and McGr The fore is active on the southern perimeter, which is burning into a continuous stand of black spruce. The

Date => day month int ‘,’ int

35% contained, while protection of the historic cabit continues.

CHINIKLIK MOUNTAIN, Galena District, BLM .

A Type II Incident Management Team (Wehking) is assigned to the Chiniklik fire. The fire is contained. Major areas of heat have been mopped up. The fire is contained. Major areas of heat have been mopped-up. All crews and overhead will mop-up where the fire burned beyond the meadows. No flare-ups occurred today. Demobilization is planned for this weekend, depending on the results of infrared scanning.

HP

46

Traditional Text Categorization Customer Training Set Statistical/AI Techniques Classify Place in a taxonomy Customer Article Feed 4715 Routing/Distribution Classification of Article 4715 Standard Metadata

Feed Source: iSyndicate Posted Date: 11/20/2000

Taalee’s Categorization & Automatic Metadata Creation Knowledge-base & Statistical/AI Techniques Taalee Training Set Customer Training Set Classify Place in a taxonomy

Standard metadata Semantic metadata

Catalog Metadata Article 4715 Metadata

Feed Source: iSyndicate Posted Date: 11/20/2000 Company Name: France Telecom , Equant Ticker Symbol: FTE , ENT Exchange: NYSE Topic: Company News

Automated Content Enrichment (ACE) FTE

Company Analysis Conference Calls Earnings Stock Analysis

ENT

Company Analysis Conference Calls Earnings Stock Analysis

NYSE

Member Companies Market News IPOs

Classification of Article 4715 Article Feed 4715 Precise syndication/filtering Routing/Distribution Map to another taxonomy

Automatic Categorization & Metadata Tagging (unstructured text/transcript of A/V) ABSOLUTE CONTROL OF THE SENATE IS STILL IN QUESTION. AS OF TONIGHT, THE REPUBLICANS HAVE 50 SENATE SEATS AND THE DEMOCRATS 49. IN WASHINGTON STATE, THE SENATE RACE REMAINS TOO CLOSE TO CALL. IF THE DEMOCRATIC CHALLENGER UNSEATS THE REPUBLICAN IUMBENT THE SENATE WILL BE EVENLY DIVIDED. IN MISSOURI, REPUBLICAN SENATOR JOHN Auto ASHCROFT SAYS HE WILL NOT CHALLENGE HIS LOSS TO GOVERNOR MEL CARNAHAN GOVERNOR CARNAHAN'S WIFE IS EXPECTED TO TAKE HIS PLACE. IN THE HIGHEST PROFILE SENATE EVENT OF THE NIGHT, HILLARY CLINTON WON THE NEW YORK SENATE SEAT. SHE IS THE FIRST FIRST LADY TO RUN MUCH LESS WIN. Video Segment with Associated Text Segment Description Semantic Metadata HP

49

Automatic Categorization & Metadata Tagging (Web page) Video with Editorialized Text on the Web Auto Categorization Semantic Metadata HP

50

Automatic Categorization & Metadata Tagging (Feed) Text From Bllomberg Auto Categorization Semantic Metadata HP

51

Taalee Extraction and Knowledgebase Enhancement

Web Page Enhanced Metadata Asset Extraction Agent

HP

52

Basis for Semantics

A.

Facts/Concepts/Terms/Entities Dictionary, Thesaurus, Reference Data, Vocabulary

B.

Facts with Relationships Taxonomy/(Categories), Ontology Domain Modeling

(e.g., Golf = golfer, tournament name, golf course, event)

Knowledge Base

HP

53

Basis for Semantics

C.

Reasoning/Inference (Statistical) (Information Retrieval) Statistical Learning/AI (Bayesian, Neural Networks, HMM,…) Logic Based (Description Logic) Natural Language/Grammar (part of speech,..)

HP

54

Alternatives for Metadata Extraction

Word or Phrase deeper understanding Statistical methods/Cluster Analysis Learning/AI and Collab. Filtering Reference data/Concept-terms/ Dictionary/Thesaurus By topic/industry/subject/domain Ontologies/Domain Models KnowledgeBase By Entities and Relationships

HP

55

Open Directory Project (ODP): Classification/Taxonomy & Directory

HP

56

Ontology

Standardize meaning, description, representation of involved attributes Capture the semantics involved via domain characteristics Allow knowledge sharing and reuse (Ontological Commitment)

HP

57

An Ontology

HP

59

Example: Interrelated ontologies

RECREATIONAL LANDFILL SITE CULTIVATED AREA GREENLAND AREA LAND (SITE) LAND BANK ZONING COMERCIAL LAND USE INDUSTRIAL WASTE DISPOSAL RURAL MILITARY AGRICULTURAL RESIDENTIAL SOLID HAZARDOUS RESOURCE REC.

LANDFILL RECYCLING shredding magnetic separation screening washing SEWAGE FIRE AVALANCHE STORM FLOOD TSUNAMI causes NATURAL DISASTER VOLCANO causes causes EARTHQUAKE causes LANDSLIDE

Large Vocabularies/ Taxonomies/Ontologies

WordNet The Medical Subject Headings (MeSH): NLM's controlled vocabulary used for indexing articles, for cataloging books and other holdings, and for searching MeSH-indexed databases, including MEDLINE . MeSH terminology provides a consistent way to retrieve information that may use different terminology for the same concepts. Year 2000 MeSH includes more than 19,000 main headings, 110,000 Supplementary Concept Records (formerly Supplementary Chemical Records), and an entry vocabulary of over 300,000 terms.

HP

61

Metadata enabled Applications

Confidential HP

Metadata Usage: Impact on Search & Query processing

  

traditional queries based on keywords attribute based queries content-based queries

HP

63

Oingo.com

Oingo Ontology – ODP based(?), the database of millions of concepts and relationships that powers Oingo's semantic technology Oingo Seek - the database of millions of concepts and relationships that powers Oingo's semantic technology Oingo Sense - the knowledge extraction tool that uncovers the essential meaning of information by sensing concepts and context Oingo Lingua - the language of meaning used to state intent. The basis for intelligent interaction Assets catalogued are Web sites or Web pages.

HP

64

Use of Categories for Search

After 3 or 4 clicks

HP

65

Metadata & Search

Metadata can improve search significantly, but metadata enables much more than search Alternatives for improving search: clustering, link and other analysis (e.g., Google’s Link Flux analysis), classification as context, ontologies, metadata, knowledgebases …

HP

69

Metadata Usage: Keyword, Attribute and Content Based Access

The VisualHarness system at LSDIS/UGA

HP

70

Keyword Search vs Attribute Search with Semantic metadata

Taalee Metadata on

Football Assets

Metadata from Typical Virage Search on Cataloging of Football football touchdown Assets

Brian Griese Interview Part Four Brian Griese talks about the first touchdown he ever threw. URL:

http://cbs.sportsline...

Jimmy Smith Interview Part Seven Jimmy Smith explains his philosophy on showboating. URL:

http://cbs.sportsline...

Rich Media Reference Page Baltimore 31, Pit 24 http://www.nfl.com

Quandry Ismail and Tony Banks hook up for their third long touchdown, this time on a 76 yarder to extend the Raven’s lead to 31-24 in the third quarter.

League: Teams: Score: Players: Event: Produced by: Posted date: Professional Ravens, Steelers Bal 31, Pit 24 Quandry Ismail, Tony Banks Touchdown NFL.com

2/02/2000 HP

71

Taalee’s Semantic Search

Highly customizable, precise and freshest A/V search Context and Domain Specific Attributes Delightful, relevant information, exceptional targeting opportunity Uniform Metadata for Content from Multiple Sources, Can be sorted by any field HP

72

HP

73

Taalee Directory Georgia Bulldogs System recognizes ENTITY & CATEGORY

Careless whisper Taalee Directory

Semantic Relationships

HP

76

Metadata Application Example

Semantic Applications for highly relevant and fresh content: Personalization and Targeting/interactive marketing

Please contact Taalee for live demonstrations

HP

77

Personalized Directory

Obtain a whole universe of information (that you may not even have thought of) about some entities that have always been of interest to you. Please enter such semantic keywords below.

Change Context

Personalized Queries & Hot Topics

PERSONALIZATION

Personalized Queries 1. My Stock Portfolio

Microsoft suffers serious hack attack Cisco Systems Inc Analyst Safa Rashtchy on Yahoo!

PeopleSoft, Inc AT&T Corp. more…

2. My Football Fantasy Team

Gators' Spurrier ready for 'big' game Tech's Vick looks to become complete QB Bucs excited about Hamilton Edwards explains reasons for leaving BYU

1. Election 2000

more… Video: Explaining the electoral map more… Trailer - Runaway Bride Patrick

2. Middle East Peace Conflict

Movie Trailer: "Stepmom" Conspiracy Theory more… Pentagon probes Cole's security

4. Pink Floyd Collection

Set the Controls for the Heart of the Sun… Wish You Were Here Napster Lawsuit Keep Talking Creative Nomad II The Post War Dream more… more… more…

Metadata: Targeting

HP

80

Semantic/Interactive Targeting

Buy Al Pacino Videos Buy Russell Crowe Videos Buy Christopher Plummer Videos Buy Diane Venora Videos Buy Philip Baker Hall Videos Buy The Insider Video Precisely targeted through the use of Structured Metadata and integration from multiple sources

Web: Extreme Personalization

Realtime Feeds Web sites and Pages Content Databases Interests, Preferences

Time-Shifted Content Aggregator

Content Personalized Content

Semantic Engine TM

Personalized Content Structured, Hi-Quality Semantic Metabase HP

82

Application of Semantic Metadata and Automatic Content Enrichment MyMedia $

 w

MyStocks

News Sports  Music % %

User has already completed Web Based registration and personalization at Voquette’s Enterprise Customer site.

User’s “Wireless Home page” shows the categories for his interests. There is an alert (new content) for his stock and sports categories.

HP

83

Application of Semantic Metadata and Automatic Content Enrichment MyMedia $

 w

MyStocks

News Sports  Music % %

My Stocks CSCO

NT IBM Market

Clicking on MyStocks brings down user’s Personal Portfolio list. The user wants to see news items about Cisco (see next slide). Search at the bottom is a semantic search that understands the financial domain, and the knowledge of user’s portfolio. Typically search can be done by typing one word or selecting from a dynamic, personalized menu.

HP

84

Application of Semantic Metadata and Automatic Content Enrichment MyMedia $

 w

MyStocks

News Sports  Music

My Stocks

% NT IBM Market

CSCO Analyst Call

Conf Call Earnings   %

Different types of recent audio content about Cisco are available.

The user clicks to see a listing of Analyst Calls on Cisco (next slide).

Icons at the bottom of the screen enable contextually relevant functions: listen, set alert on story, add to playlist.

HP

85

Application of Semantic Metadata and Automatic Content Enrichment MyMedia $

 w

MyStocks

% News Sports %  Music

My Stocks CSCO

NT IBM Market

CSCO Analyst Call

Conf Call Earnings

CSCO Analysis

11/08 ON24 Payne 11/07 ON24 H&Q CC 11/06 CBS Langlesis   %

Clicking on the link for Cisco Analyst Calls displays a listing sorted by date. Semantic filtering uses just the right metadata to meet screen and other constrains. E.g., Analyst Call focuses on the source and analyst name or company. The icon denote additional metadata, such as “Strong Buy” by H&Q Analyst.

HP

86

iTV: Taalee’s Extreme Personalization

Content Provider (DBS, DISH, Wink, AOL-TV)

Content, “Programs” Meta-Data Tagged Content

Semantic Engine TM

Structured, Hi-Quality Semantic Metabase Immediate Interests, Preferences, Personalized Content Capsules, Redirects and Programming HP

87

Metadata for Automatic Content Enrichment

Interactive Television This screen is customizable with interactivity feature using metadata such as whether there is a new Conference Call video on CSCO.

Part of the screen can be automatically customized to show conference call specific information – including transcript, participation, etc. all of which are relevant metadata Conference Call itself can have embedded metadata to support personalization and interactivity.

This segment has embedded or referenced metadata that is used by personalization application to show only the stocks that user is interested in.

HP

88

Metadata in Enterprise Apps

Processing Production Support Network Content Affiliate Feeds Public Sources

 Categorize  Catalog  Integrate

Rich Data Metabase

Filter, Search, Consolidate, Personalize, Archive, Licensing, Syndication

HP

89

(1.33) – 12/06/00 ABC (2.53) - 12/06/00 CBS (5.16) - 12/06/00 ABC (2.46) - 12/06/00 FOX (1.33) - 12/06/00 NBC -- Breaking News - Gore Demands That Recount Restart (1.33) - 12/06/00 ABC Gore Says Fla. Can't Name Electors (2.33) - 12/06/00 CBS Bush Meets Colin Powell at Ranch (3.12) - 12/06/00 NNS Market Tumbles on Earnings Warning (0.32) - 12/06/00 CBS Barak Outlines His Peace Plan (1.33) - 12/06/00 CBS (1.33) - 12/06/00 CBS (3.57) - 12/06/00 CBS (4.27) - 12/06/00 ABC (3.44) - 12/06/00 FOX (7.24) - 12/06/00 CBS (5.33) - 12/06/00 Description

Produced by : CNN Posted Date : 12/07/2000 Reporter : Event : David Lewis Election 2000 Location : Tallahassee, Florida, USA People : Al Gore TALLAHASSEE, Florida (CNN) – Though the two presidential candidates have until noon Wednesday to file briefs in Al Gore's appeal to the Florida Supreme Court, the outcome of two trials set on the same day in Leon County, Florida, may offer Gore his best hope for the presidency. Democrats in Seminole County are seeking to have 15,000 absentee ballots thrown out in that heavily Republican jurisdiction -- a move that would give Gore a lead of up to 5,000 votes statewide. Lawyers for the plaintiff, Harry Jacobs, claim the ballots should be rejected because they say County Elections Supervisor Sandra Goard allowed Republican workers to fill out voter identification numbers on 2,126 incomplete absentee ballot applications sent in by GOP voters, while refusing to allow Democratic workers to do the same thing for Democratic voters. The GOP says that suit, and one similar to it from Martin County, demonstrates Democratic Party politics at its most desperate. Gore is not a party to either of those lawsuits. On Tuesday, the judge in the

HP

91

Video Metadata’s role in emerging iTV infrastructure Enhanced Digital Cable MPEG Encoder

Create Scene Description Tree

Channel sales through Video Server Vendors, Video App Servers, and Broadcasters “Cisco Systems” Node Taalee Semantic Engine MPEG-2/4/7 MPEG Decoder

Retrieve Scene Description Track

Node = AVO Object License metadata decoder and semantic applications to device makers Scene Description Tree



GREAT USER EXPERIENCE

Enhanced XML Description 

Produced by: Fox Sports

Creation Date: 12/05/2000

League: NFL

Teams: Seattle Seahawks,

Atlanta Falcons

Players: John Kitna

Coaches: Mike Holmgren,

Dan Reeves

Location: Atlanta Object Content Information (OCI) “Cisco Systems” Metadata-rich Value-added Node HP

92

Intelligent Metadata Creation Usage

Metadata for Intelligent Content Content which does contain the words the user asked for Extractor Agents + Content which does not contain the words the user asked for, but is about what he asked for.

Value-added Metadata + Content the user did not think to ask for, but which he needs to know.

Semantic Associations HP

93

Intelligent Content via Value-Added Metadata

HP

94

Example 1 – Snapshots (“Jamal Anderson”) Search for ‘Jamal Anderson’ in ‘Football’ Click on first result for Jamal Anderson View the original source HTML page. Verify that the source page contains no mention of Team name and League name . They were Taalee’s value additions to the metadata to facilitate easier search.

View metadata. Note that Team name and League name are also included in the metadata HP

98

Example 2 – Snapshots (“Gary Sheffield”) Search for ‘Gary Sheffield’ in ‘Baseball’ View the original source HTML page. Verify that the source page contains no mention of Team name and League name . They were Taalee’s value additions to the metadata to facilitate easier search.

Click on first result for Gary Sheffield View metadata. Note that Team name and League name are also included in the metadata HP

99

Intelligent Content – Value-Added Metadata

Some Metadata are obtained

explicitly from the asset

. Others (not present in the asset) are added by Taalee using its

semantic relationships

.

The asset is

richly, fully described in the many ways the

users chose to interact.

Posted Date

Date of asset posting – Extracted automatically Name of content provider that produced the asset

Producer Name Rich Media Sports Asset League Name

Name of league to which the payer’s team belongs –

Not mentioned explicitly in asset

–

Value added by Taalee’s processing based on semantic associations.

Name of sport

Sport Team Name

Name of team for which player plays –

Not mentioned explicitly in asset

–

Value added using Taalee’s semantic relationships

Name of players mentioned explicitly in the asset – Extracted automatically

Player Names Legend: X Y means Taalee uses X to add Y as value-added metadata to the asset HP

100

Intelligent Content via Semantic Associations

HP

101

Example (test on http://directory.mediaanywhere.com) Links to news on companies that compete against Commerce One Search for company ‘Commerce One’ Links to news on companies Commerce One competes against (To view news on Ariba, click and automatically HP

103

ASP/Enterprise hosted Internal Source 1 Research Internal Source 2 Extractor Agent 1 Extractor Agent 2 External feeds/Web (e.g. Reuters) Extractor Agent 3 Story on Cisco Story on Lucent World Model 3

Consults Knowledge Base for Cisco ’s competition Returns result: Lucent is a competitor of Cisco

2 Semantic Engine

Lucent story from external feeds picked for publishing as “semantically related” to Cisco story – passed on to Dashboard

4 1

Cisco story from PW Source 1 passed on to add semantic associations

Taalee Metabase Semantic Application Third-party Content Mgmt And Syndication Metadata centric Content Management Architecture

XCM-compliant metadata, XML or other format

HP

104

Semantic Associations

supported by Taalee Semantic Engine Intelligent Content = What You Asked for + What you need to know!

Related Stock News

COMPANIES in Same or Related INDUSTRY

COMPANY Competition

COMPANIES in INDUSTRY with Competing PRODUCTS

Technology Products

Important to INDUSTRY or COMPANY

Industry News EPA

Regulations

SEC

Impacting INDUSTRY or Filed By COMPANY

HP

105

Semantic Web Application Example: Financial Advisor Research Dashboard

Automatic Collation of semantically related digital media information from Multiple Sources Research Inferred Automatically Semantically Related News Not Specifically Asked For Semantic Search/ Personalization, etc.

HP

106

A vision for future

Semantic Web, Complex Relationships and Knowledge Discovery, E.g., InfoQuilt project at LSDIS Lab, Univ. of Georgia

Beyond RDF – one proposal

(cf: Ora Lassila)

Structural modeling obviously not enough we need a “logic layer” on top of RDF some type of description logic is a possibility Exposing a wide variety of data sources as RDF useful, particularly if we have logic/rules is which allow us to draw inference from this data RDF + DL = “Frame System for WWW” Source : www.ontoknowledge.org/oil

HP

108

Semantic Web -

next step in Web evolution

“ A Web in which machine reasoning will be ubiquitous and devastatingly powerful.” [Berners-Lee] “A place where the whim of a human being and the reasoning of a machine coexist in an ideal, powerful mixture.” [Berners-Lee] “A semantic Web would permit more accurate and efficient Web searches, which are among the most important Web based activities.” [Berners-Lee] A personal definition Semantic Web: The concept that Web-accessible content can be organized semantically, rather than though syntactic and structural methods.

HP

109

What is DAML

(DARPA Agent Markup Language)

a proposal to create technologies that will enable software agents to dynamically identify and understand information sources, and to provide interoperability between agents in a semantic manner.

Based on RDF+XML Agent readable Tags www.daml.org

DAML Example

Three layered Architecture Of Semantic Web

Logical Layer Formal Semantics and Reasoning Support – OIL, DAML-O Schema Layer Definition of Vocabulary RDF Schema Data Layer Simple data model and syntax for metadata - RDF

OIL – as RDF Extension

<

rdfs:Class

rdf:ID=” herbivore ”> <

rdf:type

rdf:resource=” http://www.ontoknowledge.org

/# DefinedClass ”/> <

rdfs:subClassOf

<

rdfs:subClassOf

> rdf:resource=”# animal ”/> <

oil:NOT

>

DAML and OIL – Evolving towards Semantic Web

OIL Mission OIL is a Web-based representation and inference layer for ontologies, which combines the widely used modeling primitives from frame-based languages with the formal semantics and reasoning services provided by description logics

Knowledge Discovery Example

Earthquake Sources

(USGS, NEIC)

Nuclear Test Sources

(Oklahoma Observatory, etc.)

Nuclear Test May Cause Earthquakes

Is it really true?

Complex Relationships

A nuclear test

could have caused

an earthquake if the earthquake occurred

some time after

the nuclear test was conducted and

in a nearby region

.

NuclearTest <= Causes dateDifference Earthquake ( NuclearTest.eventDate, Earthquake.eventDate ) < 30 AND distance ( NuclearTest.latitude, NuclearTest.longitude, Earthquake,latitude, Earthquake.longitude ) < 10000

Knowledge Discovery Example

When was the first recorded nuclear test conducted?

1950 Find the total number of earthquakes with a magnitude 5.8 or higher on the Richter scale per year starting from 1900 Increase in number of earthquakes since 1945

Knowledge Discovery Example…

For each group of earthquakes with magnitudes in the ranges 5.8-6, 6-7, 7-8, 8-9, and >9 on the Richter scale per year starting from 1900, find average number of earthquakes Number of earthquakes with magnitude > 7 almost constant. So nuclear tests probably only cause earthquakes with magnitude < 7

Knowledge Discovery Example

… Find pairs of nuclear tests and earthquakes such that the earthequake occurred within 30 days after the test was conducted and in a radius of 10000 miles from the epicenter of the earthquake Demo

Resources/References

RDF: w w w .

w 3 .

o r g / T R / R E C r d f s y n t a x / ICE: www.icestandard.org

Meta Object Facility (MOF) Specification, Version 1.3, September 27, 1999: http://cgi.omg.org/cgi-bin/doc?ad/99-09-05 XML Metadata Interchange (XMI) Specification, Version 1.1, October 25, 1999: http://cgi.omg.org/cgi-bin/doc?ad/9910-02 http://cgi.omg.org/cgi-bin/doc?ad/99-10-03 DAML: www.daml.org

NEWSML: newsshowcase.reuters.com

PRISM: www.prismstandard.org/techdev/prismspec1.asp

XCM: www.vignette.com

OIL: www.ontoknowledge.org/oil SEMANTICWEB: www.semanticweb.org

VOICEXML: www.voicexml.org

MPEG7: www.darmstadt.gmd.de/mobile/MPEG7/ Taalee: www.taalee.com

Oingo: www.oingo.com

Multimedia Data Management: Using Metadata to Integrate and Apply Digital Media, Amit Sheth and Wolfgang Klas, Eds., McGraw Hill, ISBN: 0-07-057735-8, 1998.