Transcript Structured Media for Media Integration & Document Authoring Tien TRAN_THUONG and Cécile ROISIN Project OPERA - INRIA Grenoble - France.

Structured Media for
Media Integration & Document Authoring
Tien TRAN_THUONG and Cécile ROISIN
Project OPERA - INRIA
Grenoble - France
Work Context and Objective

Multimedia Document:
 Set
of basic media: audio, video, text, image, HTML, etc.
 Multimedia document model: the way to integrate a set of
basic media in time, space and hypermedia  Madeus
language
 Authoring & presentation system for multimedia documents
 Madeus editor

Objective: semantic media fragment integration and
authoring more complex and efficient documents

Structured media
Current media fragment integration

Anchor and Area elements


Decompose media into spatial/temporal segments for hypermedia and
fine-grained synchronizations (CMIF, HyTime, SMIL)
Ex: Area in SMIL2.0
<video src="http://www.inrialpes.fr/operaVideo">
<area id="Madeus"
begin= "5s" end= "7s"
coords= "84, 249, 188, 272"
href ="Madeus-Editor.html" />
</video>
absolute specification,
no structure and
lack of signification
Active area

The fragment attribute of the Area element provides naming facilities for
external structured media
<area fragment="Madeus-frag"
href="Madeus-Editor.html" />
Structured media


Atomic media is a media node in a document that
refers to a media content
Structured media is a media node in a document
that refers to a media content and includes or
refers to a structure description of that media
content
Multimedia content description




DCMES: Dublin Core Metadata Element Set
RDF: Resource Description Framework
Mpeg7: Multimedia Content Description Interface
Need a multimedia content description model for
composing multimedia document
Experimentation in Madeus
Media structure description



Structured video:
sequence, scene, shot,
videoEvent, videoObject,
etc.
Structured audio:
speech, music, sound,
audioEvent, audioObject,
etc.
Structured free text:
word, phrase, sentence,
paragraph, etc.
Allows
Media fragment integration
Temporal/spatial
synchronization of
video/audio fragment with
other media or media
fragments
 Hyperlink/tracking/erasing
action on video objects
 Hyperlink/highlight action
on text fragments

Authoring multimedia documents
Media description process before used 
 Media is directly
used media
 atomic media
structured

Video
Image
Audio
Analysis &
Generation
Authoring
media content
description
Media
integration
Free text
Media
content
Media content
model
Media content
described by
standards (Mpeg7)
Multimedia
document
Conclusion and Perspectives





An authoring tool for complex multimedia
presentations
Export to presentation-oriented formats
Fragments authoring for media (Image, Audio,
Free text)
Import of multimedia content description
standards (Mpeg7)
Need for media analysers to be integrated in my
tool