Transcript Personal Telepresence using Scalable Video Coding

PERSONAL TELEPRESENCE USING
SCALABLE VIDEO CODING
Alex Eleftheriadis, Chief Scientist
[email protected]
Videoconferencing Industry – Quality vs. Scale
Resolution
High
Definition
Cisco, HP, Polycom
Tandberg, LifeSize
Standard
Definition
Quality
Interactivity
$10K-$300K
Endpoint
Existing Technology
All Vendors
Price-Performance,
Interactivity
Cisco, Microsoft,
Nortel, Avaya,Siemens
Skype, Yahoo, AOL,
Adobe, Google
Low
Definition
10
1000
10,000
Number of
End Points
2
TNC-2008 / May 21, 2008
1,000,000
Key Videoconferencing System
Characteristics
Rate Matching
Support for heterogeneous endpoints and access networks
Personalized Layout
Each user selects the resolution and users he/she wants to see
Delay
Interactivity requires <200msec end-to-end
Error Resilience
Tolerance to packet loss rates >10%
Error Localization
An error in one user should not affect other users
Complexity
Lower complexity = Lower cost
Low complexity allows to integrate with existing network services (e.g., in cheap routers)
3
TNC-2008 / May 21, 2008
H.264 SVC
Scalable Video Coding (SVC)
Developed by JVT (=Joint Video Team of ITU and ISO)
SVC is Amendment 3 to H.264 AVC
Most of SVC is in Annex G of H.264 AVC
CFP April 2004, Consented in Nov 2007
RTP payload format should go to last-call in July 2008 IETF (Dublin)
Vidyo™ is the first company to offer H.264/SVC standard-based
solution to solve video conferencing challenges
Architecture centered on VidyoRouter™
4
TNC-2008 / May 21, 2008
Temporal Structure of Non-Scalable Codecs
5
TNC-2008 / May 21, 2008
Temporal Scalability
6
TNC-2008 / May 21, 2008
Spatial Scalability
texture
Hierarchical MCP &
Intra prediction
Base layer
coding
motion
Spatial
decimation
Inter-layer prediction:
• Intra
• Motion
• Residual
texture
Hierarchical MCP &
Intra prediction
Base layer
coding
Multiplex
motion
Spatial
decimation
Inter-layer prediction:
• Intra
• Motion
• Residual
texture
H.264/AVC MCP &
Intra prediction
Base layer
coding
motion
H.264/AVC compatible encoder
7
TNC-2008 / May 21, 2008
H.264/AVC-compatible
base layer bit-stream
Scalable
bit-stream
Temporal + Spatial Scalability
8
TNC-2008 / May 21, 2008
Temporal + Spatial Scalability
QVGA
30 fps
9
TNC-2008 / May 21, 2008
Temporal + Spatial Scalability
VGA
15 fps
10
TNC-2008 / May 21, 2008
Multipoint with Native Rate Matching
VidyoRouter™
High Resolution
High Frame Rate
1.5Mbps
Medium Resolution
High Frame Rate
512Kbps
Medium Resolution
Medium Frame Rate
High Resolution
High Frame Rate
256Kbps
Low Resolution
Low Frame Rate
128Kbps
11
TNC-2008 / May 21, 2008
Traditional Transcoding MCU
ENCODE
ENCODE
DECODE
DECODE
COMPOSE
ENCODE
Packet Loss
Sensitivity,
Requires
Dedicated Network
12
DECODE
TNC-2008 / May 21, 2008
High Cost
High Delay
Quality Degradation
VidyoRouter™
ENCODE
ENCODE
VidyoDesktop™
Endpoint
VidyoRoom™
Endpoint
VidyoRouter™
DECODE
VidyoRoom™
Endpoint
13
TNC-2008 / May 21, 2008
VidyoRouter™ vs. MCU
VidyoRouter is simply an application layer router
Nearly zero-delay (~10msec), allows cascading
Eliminates video quality loss due to transcoding
Extremely low cost of compute power
Limiting parameter is network I/O bandwidth and not number of video streams or
resolution
Endpoint processing of the video from different participants makes the
VidyoRouter highly scalable
Rate matching and personalized layout are routing decisions
Similar complexity to other network appliances
USER 1
DECODE
DECODE
COMPOSE
USER 2
USER 1
VidyoRouter
USER 2
ROUTE
MCU
USER 3
ENCODE
14
USER 3
TNC-2008 / May 21, 2008
HD at 60 fps on Every Port
9-site call (US and Europe) mixing HD Rooms and VGA desktops across the public Internet
15
TNC-2008 / May 21, 2008
Error Resilience
Conventional Coding
Significant Impact
Scalable Coding
Minor or No Impact
Low Reliability Channel
High Reliability Channel
16
TNC-2008 / May 21, 2008
MCU vs. VidyoRouter™: Computation
Feature
Rate matching
Personalized layout
Frame Rate Increase
(30fps to 50fps)
HD overhead for Server
Max resolution limited by
Server Complexity
Server Scalability
Obsolescence Risk
Compatibility with H.264 AVC
Server Integration with Routers
17
MCU
VidyoRouter
Transcoding
Transcoding
Free
Free
Faster Transcoding
None
High
Server
High
Low
High
√
Minimal
Client
Low
Very High
Low
√
√

Transcoding MCU is complex, adds delay and distortion, and scales poorly

Move to HD 720p to HD 1080p to HD 1600p requires “forklift” upgrade for a
transcoding MCU
TNC-2008 / May 21, 2008
MCU vs. VidyoRouter™: Network
Feature
Rate matching
Error Resilience (packet loss)
End-to-End Delay
Switched Server
End-to-End Delay
Multipoint Server
Max resolution limited by
Cascaded Servers
MCU
VidyoRouter
Transcoding
Free
3%
20% +
~150-200ms
~150-200ms
~400+ms
~150-200ms
Server
Client
√
VidyoRouter operates effectively over the Internet
Cascading VidyoRouters improves user experience, even in point-to-point calls
18
Videoconferencing Industry – The Future
Resolution
High
Definition
Cisco, HP, Polycom
Tandberg, LifeSize
Standard
Definition
Quality
Interactivity
$10K-$300K
Endpoint
Existing Technology
All Vendors
Price-Performance,
Interactivity
Cisco, Microsoft,
Nortel, Avaya,Siemens
Skype, Yahoo, AOL,
Adobe, Google
Low
Definition
10
1000
10,000
Number of
End Points
19
TNC-2008 / May 21, 2008
1,000,000
VidyoConferencing™ Components
20
July 17, 2015
Vidyo Proprietary Confidential & Patent Pending Information
VidyoConferencing™ Summary
Based on a new standard H.264 SVC, the first effective video codec
truly designed for converged IP Networks (Internet)
Much better user experience: better quality, easier to use, more
natural
HD becomes deployable everywhere and can reach any desktop or
laptop over shared IP networks
A unified video solution from telepresence to desktop
An affordable and scalable architecture that matches the
Internet model
21
21
TNC-2008 / May 21, 2008
Vidyo™ Demo
Demo to be held after the end of the session
(transatlantic connection using laptop over WiFi connection)
Demo accounts can be set up upon request on the Vidyo system
hosted by Surfnet (http://vidyo.showcase.surfnet.nl).
Contact: Eric Le Guiniec, [email protected]
22
22
TNC-2008 / May 21, 2008