Transcript MUSCLE E-Team on “Integration of structural and semantic
Slide 1
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 2
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 3
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 4
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 5
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 6
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 7
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 8
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 9
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 2
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 3
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 4
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 5
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 6
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 7
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 8
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network
Slide 9
MUSCLE WP9 E-Team
Integration of structural and semantic models
for multimedia metadata management
Aims:
•(Semi-)automatic MM metadata specification process
•Information extraction techniques
•Intelligent approaches
•Semantic Web and multimedia content analysis
•Multimedia data indexing
Participants: BILKENT, CEA, CNR, IBAI
E-Team “Integration of structural and semantic models for multimedia
metadata management”
Partners Contributions
BILKENT
video database system
CEA LIST
Text analysis and XML metadata extraction and
collection
CNR-ISTI
design and development of an Infrastructure for
MultiMedia Metadata Management (4M)
for MUSCLE integration
IBAI
data preparation of web log files
E-Team “Integration of structural and semantic models for
multimedia metadata management”
Study, design and implementation of an
Infrastructure for
MultiMedia MetaData Management
- 4M -
Multimedia Metadata
Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
elaboration
Key tools:
• MPEG-7 provides detailed and multimedia specific
metadata descriptors.
•
Semantic Web technologies (RDF, OWL, etc),
promoted by the W3C, enable large scale
interoperability of structured knowledge
repositories.
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
O
I
Integration
Annotations
A
network
XML DB
X
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
network
BILKENT
•XML metadata
(video annotation; salient
object extraction
from video key frames;
spatio-temporal,
semantic and low-level
features on video data)
•Direct links to local
resources (e.g., BilVideo)
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
CEA
•XML metadata
(text analysis)
•Web-Searching
(XML DB)
network
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
XML DB
X
O
I
Integration
Annotations
A
CNR
network
•System software
•Database development
•Features extraction from audio/images
•Ontology for image analysis
4M Infrastructure
...
Algorithms
Ontology
M
MPEG-7
feature
processing
X
O
I
Integration
Annotations
XML DB
A
IBAI
•XML metadata
(semantic transformation
of Log Files,
features discretization)
•Web Server interaction
network