File Format for Scalable Video Coding Outline
Download
Report
Transcript File Format for Scalable Video Coding Outline
File Format for Scalable Video Coding
Outline
I. SVC Introduction
II. Review of File Format Basics
III.SVC File Format
IV.Examples of Use
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC Introduction
SVC Scalabilities and the Cube Model
Bit-Stream Representation
Usage and Application Scenarios
SVC High-Level Syntax
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC Introduction – Scalability & Data Model
SVC Scalabilities and the Cube Model
Temporal, Spatial, and SNR (Fidelity/Quality) scalability
Cube data model
SVC Syntax Elements – PDTQ
Priority-id
Dependency_id
Temporal_id
Quality_id
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC Introduction – Bit-Stream Representation
•
Flexible Combined Scalability
•
Layered Scalability
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC Introduction – Usage and Application
•
Direct File Access
Adaptation Operation
•
Erosion Storage - Surveillance
•
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC Introduction – SVC High-Level Syntax
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Outline
I. SVC Introduction
II. Review of File Format Basics
III.SVC File Format
IV.Examples of Use
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
File Format Review – ISO Base Media File Format
•
The file structure is object-oriented and can be decomposed into
its constituent objects easily
•
The files have
•
Logical structure – a set of time parallel tracks, “movie”
•
Time structure – sequence samples in time
•
Physical structure – separate logical and time structure data from media data
themselves
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
File Format Review – ISO Base Media File Format
•
Tracks alternative to each other – using the same nonzero alternate group
number
•
•
Special samples:
•
Synchronization point ( I-frame)
•
Track sample dependency
•
Sample groups – used in SVC file format
File type box
•
The specifications to which the file complies
•
Permission for a reader
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
File Format Review – ISO Base Media File Format
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
File Format Review – AVC File Format
A sequence of access unit, each divided into a number of NAL
units
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Outline
I. SVC Introduction
II. Review of File Format Basics
III.SVC File Format
IV.Examples of Use
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Design Principles
•
Extractor – Extract subsets that will be often extracted
easily
•
Grouped into tiers which contain one or more
scalability layers (Sample groups)
•
Have time-parallel data (Time parallel metadata track)
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Extractor Tracks
Allow “Cookbook” construction, take the forms of tracks within
the alternate group
3 different ways to represent subset
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Extractor Tracks ‘Continue
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Sample Groups
•
•
Using sample groups
Structure of sample groups
•
•
A number of sets of description tables
A number of mapping tables
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Metadata
•
Structured as a sequence of file format samples, just
like a video track
•
Each metadata sample is structured as a metadata
statement
•
Empty statement
•
Group of statements
•
Sequence of statements
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Metadata ‘Continue
some statement about the whole sample
sequenceOfStatements {
empty statement about SEI NALu
groupOfStatements: {
NALu header 1 statement;
some other statement about NALu 1
}
groupOfStatements {
aggregator statement
sequenceOfStatements {
NALu header 2.1 statement;
groupOfStatements: {
NALu header 2.2 statement
another statement about NALu 2.2
}
}
}
some statement about NALu 3
}
CMPT 820 – 2008 Summer
SEI NALu
Base-layer Slice NALu 1
aggregator NALu 2 containing {
enhancement NALu 2.1,
enhancement NALu 2.2
}
another enhancement NALu 3
Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – AVC Compatibility
•
•
AVC compatibility can be divided into two major areas:
•
File Format Compatibility
•
Video coding compatibility
Sample-entry name used by SVC track
•
Avc1 – Define for AVC, use no data extraction, fully back-ward compatible
•
Avc2 – use data extraction
•
Svc1 – No AVC compatible
•
It is recommended to store AVC base layer in a separated AVC base track.
SVC enhancement layer data reference the AVC base track
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Outline
I. SVC Introduction
II. Review of File Format Basics
III.SVC File Format
IV.Examples of Use
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Example I – Simple Extractor Tracks
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Example II – Base Track
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Example III – Aggregator Uasge
•
Including NAL units in an aggregator
•
Referencing NAL units by an aggregator
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Example IV – Reading Map and Group Information
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Example IV – Reading Map and Group Information
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Example IV – Reading Map and Group Information
Tiers
Tier T0: H.264/AVC base layer (QCIF at 15 fps).
Tier T1: spatial enhancement of T0 to CIF.
Tier T2: temporal enhancement of T1 to 30 fps.
Tier T3: spatial enhancement of T2 to 4CIF (including the MGS
enhancement).
Groups
Group G0 Tier T0, primary definition;
Group G1 Tier T0, tier IDR;
Group G2 Tier T1, primary definition;
Group G3 Tier T1, tier IDR;
Group G4 Tier T2, primary definition;
Group G5 Tier T3, primary definition;
Group G6 Tier T3, tier IDR.
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Example IV – Reading Map and Group Information
Maps
Map M0: G1, G3, G3, G6, G6, G5, G5 (as in sample 0);
Map M1: G0, G2, G5, G5 (as in samples 1 and 2);
Map M2: G4, G5, G5 (as in samples 3 and 4).
Samples
Sample 0: M0;
Sample 1: M1;
Sample 2: M1;
Sample 3: M2;
Sample 4: M2.
CMPT 820 – 2008 Summer
Presented by Jeff Jiang
File Format for Scalable Video Coding
Summary
•
The SVC File Format defines techniques to describe operation
points and the resulting grouping of bit stream elements
•
It describes the bit stream structure and the dependencies exited
between bit stream elements
•
Defines 3 types of scalability assisance
•
Precomputed scalability assistance
•
Scalability assistance through tiers (mainly assistance for layered scalability)
•
Scalability assistance with parallel metadata
CMPT 820 – 2008 Summer
Presented by Jeff Jiang