Transcript Mobile Multimedia Streaming Standards

Nextreaming
이동통신을 위한 표준 기반의
멀티미디어 서비스 구현 기술
2002-9-27
임일택
넥스트리밍 주식회사
Nextreaming Corporation
Wireless, Mobile Multimedia?
생일 축하해~
00:11
옵션
생일 축하하구~
사랑해~
정지
대체영상
취소
Streaming
Jordan
Matrix
0:15
tu: Rew/FF
정지
옵션
tu: Rew/FF
재생
옵션
리스트
2
0:02
리스트
Nextreaming
스트리밍 규격 표준화 필요성
 무선 단말 능력의 제한
• 다양한 서비스에서 동일 코덱을 재사용할 필요
- 스트리밍, 메시징, 브로드캐스트, 화상통신
• 단말 개발 비용의 절감
 서비스의 고품질화
•
•
•
•
경쟁에 의한 품질 개선 촉진
각 기능 요소별로 전문화된 기업 등장 가능
관련 부가 응용 기술 및 장비 개발 촉진
컨텐츠 생성, 가공 및 응용이 쉬워짐
 국내 관련 분야 산업 활성화
• 최고의 시장 환경에서 국제 규격과 호환성 가지는 제품의 경
쟁력 확보를 통한 해외진출 가속화, 국가 경쟁력 제고
3
Nextreaming
Multimedia Streaming Service Flow
Creation
Distribution
Playback
Wired
Network
Contents Creation
Web
Server
Wireless
Network
File Server
Streaming Server
4
Streaming Player
Nextreaming
Architecture of Simple Streaming Client
V ideo D ecoder
A udio O utput
A udio D ecoder
S y stem C ontrol
U ser Interface
S y stem C ontrol
Interface
5
Wireless Communication Network
V ideo O utput
Packetizer (Packet-Switched)
Scope of V ideo Str eaming Ser v ice
Nextreaming
Technical Elements for Streaming
 Session Set-up and Control
 Media Codecs
• Speech, Audio, Video
• Still Images, Vector Graphics, Synthetic Audio, etc.
 Transport Protocol
• For Realtime Media
• For Static Media
 Scene Description
• Spatial and Temporal Layout of Media Objects
 File Formats
• Exchange
• Storage and Retrieval
6
Nextreaming
Standards for Streaming Services
 Standardization Bodies
• UMTS (W-CDMA)
• cdma2000
 Industry Forum
• WMF
• ISMA
7
Nextreaming
3GPP (3rd Partnership Project)
 Evolved from GSM
 Packet Switched Multimedia Services
• TSG-SA WG4 (CODEC)
- Packet Switched Streaming (TS 26.233, 26.234)
- Multimedia Codecs for MMS (TS 26.140)
- Circuit Switched / Packet Switched Conversational
Services (TS 26.110, TS 26.235, etc.)
 Streaming
• From 3GPP Spec Release 4
• Rel-4 (2001/3)  Rel-5 (2002/3)  Rel-6 (2003/12?)
8
Nextreaming
3GPP Streaming Terminal
• Vector graphics,
synthetic audio
added
• Capability exchange
specified for
personalized
services
Vector
Graphics
Decoder
Text
Timed text
Decoder
Audio
Decoder
Sound
Output
Speech
Decoder
Synthetic audio
Decoder
3GPP L2
 Rel-5
Synchronisation
• Video, Audio,
Speech, Image, Text
• SMIL to integration
various media types
Image
Decoder
Packet based network interface
Graphics
Display
Spatial layout
 Rel-4
Video
Decoder
Scene
Description
Session
Control
User
Interface
Session
Establishment
Terminal
Capabilities
Capability
Exchange
9
Nextreaming
3GPP Specification details
 Default video codec : H.263 baseline
 Optional video codec : MPEG-4 SP @ L0, H.263 profile
3 level 10
 Default speech codec : AMR
 Optional audio codec : AAC Low Complexity (LC)
 Transport : RTP
 Control : RTSP, SDP
 Default still image : JPEG
 Optional still image : GIF
 Formatted text : xhtml
 Scene description : SMIL 2.0 basic profile
 File format : 3GPP (based on MP4 file format)
10
Nextreaming
3GPP2
 Evolved from CDMA
 Working Groups Relevant to Multimedia Services
• TSG-C WG1 SWG2 (Video Services)
 Two Service Categories
• Multimedia Streaming Services (C.S0027)
- Started from Video Streaming Services
- Current draft is highly related to 3GPP works
• Video Conferencing Services
- Circuit Switched (C.P9016)
- Packet Switched (C.P9008)
11
Nextreaming
3GPP2 Specification details
 Default video codec : MPEG-4 SP @ L0
 Optional video codec : MPEG-4 SSP @ L0,
H.263 Profile 3&4 @ L 10
 Optional speech codec : EVRC, QCELP, SMV
 Transport : RTP
 Control : RTSP, SDP
12
Nextreaming
Wireless Multimedia Forum (WMF)
 Overview
• Working Period: Mar. 2000 ~ Mar. 2002
• Members: more than 60 vendors (device manufacturers,
service providers, solution providers, contents providers, …)
 Activity
• Technical Specification
• Interop Test – Completed in Oct. 2001 (6 months)
 Impacts
• Influence many other organization’s activity
• Became a basement of 3GPP’s initial works
• IMTC took over its interop experiences (procedures,
management, and so on)
13
Nextreaming
WMF Spec Details




MPEG-4 SP @ L0 (QCIF, 64 kb/s)
Either AMR or EVRC
RTP
RTSP, SDP
14
Nextreaming
Internet Streaming Media Alliance (ISMA)
 Founded in Dec. 2000
• Apple, Cisco, Sun, IBM, Phillips, Kasenna
 Goals
• To accelerate the market adoption of open standards for
streaming rich media over Internet Protocol (IP).
 Specification
• Version 1.0 released (available at www.isma.tv)
 Current works
• Corrigenda to Technical Spec
• Digital Right Management
• Advanced Contents
15
Nextreaming
ISMA Specification Details
 Profile 0
• MPEG-4 SP @ L1 (QCIF, 64 kb/s)
• High Quality Audio Profile @ L2 (CELP, AAC LC)
• RTP, RTSP, SDP
 Profile 1
• MPEG-4 Advanced Simple Profile(ASP) @ L3b (CIF,
1.5 Mb/s)
• High Quality Audio Profile @ L2 (CELP, AAC LC)
• RTP, RTSP, SDP
16
Nextreaming
Standards-Related Organizations
Interoperability Tests
Certificate
Streaming Specification
17
Nextreaming
IMTC (International Multimedia Telecommunication Consortium)
 Interop Tests
• H.323, H.324, SIP, IP Security, etc.
• 3GPP Packet-Switched Streaming  PSS-AG
 PSS-AG
• 12 vendors are participating
- Ericsson, Motorola, Nokia, Philips, Siemens, Serome, etc.
• 1st round completed in Mar. 2002 (9 vendors)
• 2nd round is ongoing  to be completed 4Q 2002
18
Nextreaming
국내 관련 표준화
 TTA (한국정보통신기술협회)
 무선인터넷표준화 포럼
• 서비스 분과 산하
- PSM 소분과에서 스트리밍 서비스 규격 담당
- MMS 소분과에서 멀티미디어 메시징 서비스 규격 담당
• 이동통신 3사, 이동단말업체, 인코더 및 서버 업체
등을 중심으로 참여
• 스트리밍 서비스 규격 작성
• 규격 기반 연동 테스트 (현재 계획 중)
• 홈페이지: www.kwisforum.org
19
Nextreaming
KWISF 스트리밍 서비스 규격
 시스템 모델
컨텐츠
저작단
서버
무선단말
파일저장
 소요 기술
• 저작단: 미디어코덱, 파일포맷
• 서버: 전송프로토콜, 제어프로토콜, 파일포맷
• 무선단말: 미디어코덱, 전송프로토콜, 제어프로토콜, (파일
포맷)
20
Nextreaming
KWISF 규격 (1/2)
 미디어 코덱
• 비디오
- H.263 Profile 0 Level 10(Baseline) (필수)
- MPEG-4 SP@L0 (권고)
• 음성 (아래 두 가지에서 선택)
- AMR
- 3GPP2 음성코덱 (EVRC, SMV, etc.)
• 오디오
- AAC Low Complexity (권고)
21
Nextreaming
KWISF 규격 (2/2)
 전송프로토콜
• RTP (Realtime Transport Protocol)
• 각 코덱별 페이로드는 IETF의 해당 RFC를 따름
 제어프로토콜
• IETF RTSP (RFC 2326)
• IETF SDP (RFC 2327)
 파일포맷
• MP4 파일 포맷을 기반으로 하며, 3GPP와 호환성을 가지도록
하였음
• 국내 실정에 맞도록 추후 확장이 가능하도록 함.
22
Nextreaming
Next Generation Streaming Services
 Rich Media
• SMIL (Synchronized Multimedia Integration Language)
• BIFS (Binary Format for Scenes)
 Interaction with User
 Personalized Services
• Tailored services based on user profile
• Automatic contents selection according to
terminal capability
• Service differentiation per subscriber’s gender,
age, interests
23
Nextreaming
Rich Media Example: SMIL
<smil>
<head>
<layout>
<root-layout width=“176” height=“144” />
<region id=“title” top=“124” left=“17” width=“159” height=“20” />
<region id=“map” top=“3” left=“131” width=“42” height=“42” />
<region id=“movie” top=“0” left=“0” width=“176” height=“144” />
</layout>
</head>
<body>
<par>
<video region=“movie” src=“rtsp://foo.com/movice.mp4” begin=“0s” />
<img region=“map” src=“http://bar.com/map.jpg” begin=“5s” />
<text region=“title” src=“http://bar.com/welcome.txt” begin=“3s” />
</par>
</body>
</smil>
Define spatial layout
of the scene
“map”
“movie” area
area
“title” area
Define temporal layout
and their URLs
movie
map
title
The syntax of
SMIL looks like
HTML
t
...
...
...
...
...
24
Nextreaming
Rich Media Example: BIFS
Caption On/Off
Button
(Image with Event
Callback)
Synchronized Caption
(Realtime text may be
pushed dynamically
during a session)
25
Highlight Image
(Shows larger images
when clicked)
Nextreaming
Multimedia Codecs for Mobile Terminals
 Software codec (i.e., inside modem)
• Qualcomm MSM 5000 series : ARM7 core, 20 MHz
 128x96 size H.263 decoding : 2 frames/sec
• Qalcomm MSM 6000 series : built-in MPEG-4 block
(QCIF size video and AAC LC audio)
 Hardware codec (i.e., outside modem)
•
•
•
•
Emblaze ER4520: ARM9 core + peripherals
Hitachi SH Mobile: SH3 core + DSP + peripherals
Toshiba T3: hardwired logic based, codec
TI OMAP: C5x DSP + peripherals
26
Nextreaming
OS or Middleware for Mobile Terminals







REX, z-REX
pSOS
Qualcomm Brew
Java
WIPI
Symbian
WinCE
27
Nextreaming
부록: 관련 단체 홈페이지










3GPP, www.3gpp.org
3GPP2, www.3gpp2.org
ISMA, www.isma.tv
IMTC, www.imtc.org (http://www.imtc.org/act_pss.htm)
M4IF, www.m4if.org
MPEG, mpeg.telecomitalialab.com
IETF, www.ietf.org
W3C, www.w3.org (SMIL, http://www.w3.org/AudioVideo/)
TTA, www.tta.or.kr
KWISF, www.kwisforum.org
28
Nextreaming
Nextreaming
Thank you !
Q&A
Jae-Yong Lee
([email protected])