Transcript Video Media

Video Media
Department of Computer Education
KMUTNB
Multimedia
Video features
Video
Mediain a range of
Multimedia application
• Entertainment
– Broadcast television and VCR/DVD recordings
• Interpersonal
– Video telephony and videoconferencing
• Interactive
– Windows containing short video clips
724401
2
Multimedia
Video Media
Broadcast Television
• 525 Lines
– NTSC American standard
– 60 Fields / second
– 30 Frames / second
• 625 Lines
– PAL European standard /CCIR/SECAM
– 50 Fields / second
– 25 Frames / second
724401
3
Multimedia
Video Media
Scanning illustrated
1
2
3
4
5
6
Voltage
720 pixel
720 Sample
1
2
Time
724401
3
4
5
6
4
Multimedia
Video Media
Type of Scanning
• Progressive = every scan line done in turn.
• Interlaced = every other scan line done.
– Creates two fields: odd field and even field.
– NTSC: 262.5 lines per field at 60 fields per sec.
– PAL: 312.5 lines per field at 50 fields per sec.
• Fields are separated in time.
724401
5
Multimedia
Video Media
Computer & TV
724401
1 TV Frame = 2 Field
1 Computer Frame
interlaced scan
Progressive scan
6
Multimedia
Video Media
Computer & TV
Computer
1 Frame
……. …..
62
5
1 2 3 4 5 6 7 .. …..
……. …..
1 3 5 7 .. …..
4 6 8 ……
312.5
Odd Field
724401
…….
625 2 62
4
312.5
Even Field
Television
1 Frame
7
……. …..
1 2 3 4 5 6 7 .. …..
……. …..
…….
62
5
625 2 62
4
312.5
1 2 3 4 5 6 7 .. …..
……. …..
1 3 5 7 .. …..
4 6 8 ……
312.5
62
4
Multimedia
Computer 1
Television
8
724401
Computer 2
Video
Media
Video capture with both field
Multimedia
Video
Media
Video capture with one field
Television
..312
…….
625 2 62
4
312.5
Discard
MPEG 1 ( VCD)
….
1 2 3 4 5 6 7 ..
……. …..
1 3 5 7 .. …..
4 6 8 ……
312.5
724401
Computer 1
From Interlaced to
Progressive system
discard resolution in half
9
Multimedia
Video
Media
Scanning Sequence in TV
724401
Interlaced scanning principles
10
Multimedia
Video
Media
Scanning Sequence in TV
724401
525-line systems : 262.5 each field, 240 visible
625-line systems : 312.5 each field, 288 visible
11
Safe Frame
To TV
From Camera View Finder
724401
To
Digital File
12
Multimedia
Video Media
Broadcast Television
• Video resolution and quality
724401
13
Multimedia
Video
Media
3 Main Properties of a Color
• Hue:
The actual color of the source,
each color has a different
frequency/wavelength and eye
determines the color from this.
• Saturation:
The strength of
vividness of the color, a pastel color has
a lower level of saturation than a color
such as red.
• Brightness :
The amount of energy
that stimulates the eye and varies on a
gray scale from black (lowest) Through
to white(highest)
724401
14
Multimedia
Video
Media
Luminance & Chrominance
• Luminance : is used to refer to the
brightness of a source, and the hue and
saturation
• Chrominance: is used to refer to the color
characteristics.
724401
15
Multimedia
Video Media
TV Color Signals
Traditional monochrome TV
Luminance White --> Black
Component Signal
Chrominance
Magnitude of the 3 electrical signals
that energize the R,G,B Phosphors
0.299R + 0.587G + 0.114B
724401
16
Multimedia
Video
Media
Composite Video Signals
Ys = 0.299 Rs + 0.587 Gs + 0.114 Bs
Cr = Rs - Ys
Cb = Bs - Ys
724401
Ys is amplitude of luminance signal
Rs, Gs, Bs is magnitude of 3 color
component signals
17
Multimedia
Video
Media
Composite Video Signals
R
G
-
+
B
724401
Cr
Ysmonochrome
Cb
-
+
Rs
-
Gs
+
Bs
Composite Video Signal
18
Multimedia
Video
Media
Chrominance components
From Ys, Cr, Cb
PAL : Y = 0.299 R + 0.587 G + 0.114 B
U = 0.493 (B - Y)
V = 0.877 (R - Y)
NTSC : Y = 0.299 R + 0.587 G + 0.114 B
I = 0.74 (R-Y) - 0.27(B-Y)
Q = 0.48 (R-Y) + 0.41(B-Y)
724401
19
Multimedia
Video Media
Signal bandwidth
Baseband spectrum of color television signals in
724401
NTSC : Y = 4.2 MHz
I = 2 MHz
Q = 1 MHz
20
Multimedia
Video Media
Signal bandwidth
Baseband spectrum of color television signals in
724401
PAL : Y = 5.5 MHz
U = 3 MHz
V = 3 MHz
21
Multimedia
Multimedia
Summary
Digital Video Frames
•
•
•
•
Almost always progressive
3 planes of pixel values (Y, U, and V)
Pixel depth
Geometry of each plane: width x height
– Chrominance is generally subsampled.
724401
22
Multimedia
Video Media
Digital video
• The visual perception of the eye have less
sensitive for color than luminance
• This means that 2 chrominance signals can
tolerate a reduced resolution relative to that
used for the luminance signal
• Saving in terms of resulting bit rate and
transmission bandwidth
724401
23
Multimedia
Video
Media
Digital video standard
• International Telecommunications Union
Radiocommunications Branch (ITU-R)
• Formerly known as the Consultative
Committee for International
Radiocommunications (CCIR)
Recommendation CCIR-601
724401
24
Multimedia
Video MediaCCIR-601
• Standard established for digitizing NTSC
and PAL signals
Digital
Component
Analog
Counterpart
CCIR-601
Recommendation
Height
Lines
Width
Continuous
voltage changes
along scan line.
NTSC: 480
PAL: 576
Sample at 13.5 MHz
Results in 702 pixels
Recommended 720
Pixel depth
Voltage range.
Gamma-corrected
8-bit sample.
Chrominance
subsampling
Bandwidth
differences
4:2:2, 4:2:0, 4:1:1
724401
25
Multimedia
VideoVideo
Media
Color Storing
The visual perception of the eye have less sensitive for color than luminance
Cb
Cr
Y 1, 2,
1 2,
1
1,
3,
1
3,
4,
1
4,
Cb
Cr
Y 1, 2,
1 2,
1
1,
3,
1
3,
4,
1
4,
2
1,
3
1,
2
2,
3
2,
2
3,
3
3,
2
4,
3
4,
2
1,
3
1,
2
2,
3
2,
2
3,
3
3,
2
4,
3
4,
4
4
4
4
4
4
4
4
From Source
724401
Storing method
26
Multimedia
Video
Media
Video Color Playback
Cr,Cb
Cb
Cr
Y 1, 2,
1 2,
1
1,
3,
1
3,
4,
1
4,
2
1,
3
1,
2
2,
3
2,
2
3,
3
3,
2
4,
3
4,
4
4
4
4
Cr,Cb
3,
Cb 1, 1, 3,
1
Cr 1, 1 1, 1 3, 1 3,3,
1
Y 1, 12, 1 3, 14, 3,
2
3,
2
1
1
1
1
3,
1, 2, 3, 4,
3
3,
3
2 2,
2 3,
2 4,
2 3,
1,
4
4
3
3
3
3
1, 2, 3, 4,
4
4
4
4
Playback process
724401
27
Multimedia
Video
Media
Video Digitization Formats
 4:2:2 means 2:1 horizontal downsampling, no
vertical downsampling.
(Think 4 Y samples for every 2 Cb and 2 Cr samples in a scanline.)
 4:1:1 ought to mean 4:1 horizontal downsampling, no
vertical.
(Think 4 Y samples for every 1 Cb and 1 Cr samples in a scanline.)
It is often misused to mean the same as 4:2:0 .
 4:2:0 means 2:1 horizontal and 2:1 vertical
downsampling.
(Think 4 Y samples for every Cb and Cr samples in a scanline.)
724401
28
4:2:2
• Use in television Studio
• For every 4 luminance samples, take 2
chrominance samples from odd lines
and 2 from even lines.
• Chrom. planes just as tall, half as
wide.
• JPEG does this.
724401
Multimedia
Video Media
29
Multimedia
Video Media
4:2:2
30
724401
Sample positions with 4:2:2 digitization format
Multimedia
Video Media
4:2:2
Every 4 pixel
Cb
Cr
Y 1, 2,
1 2,
1
1,
3,
1
3,
4,
1
4,
2
1,
3
1,
2
2,
3
2,
2
3,
3
3,
2
4,
3
4,
4
4
4
4
From Source
Cb
Cr
Y 1, 2,
Keep 2 odd
1 2,
1
1,
Keep 2 even
2 2,
2
1,
3 2,
3
1,
Storage size Y+Cr+Cb
4
4
3,
1
3,
4,
1
4,
2
3,
3
3,
2
4,
3
4,
4
4
Storing method
Storage size Y+0.5Cr+0.5
31
724401
Sample positions with 4:2:2 digitization format
4:2:0
• Used in Digital Video broadcast
application
• 2 chrominance samples for every 4
luminance samples, odd lines only.
• Chrominance halved in both directions.
• MPEG generally does this.
724401
Multimedia
Video Media
32
Multimedia
Video Media
4:2:0
33
724401
Sample positions with 4:2:0 digitization format
Multimedia
Video Media
4:2:0
Every 4 pixel
Cb
Cr
Y 1, 2,
1 2,
1
1,
3,
1
3,
4,
1
4,
2
1,
3
1,
2
2,
3
2,
2
3,
3
3,
2
4,
3
4,
4
4
4
4
From Source
Cb
Cr
Y 1, 2,
Keep 2 odd
1 2,
1
1,
Keep 0 even
2 2,
2
1,
3 2,
3
1,
Storage size Y+Cr+Cb
4
4
3,
1
3,
4,
1
4,
2
3,
3
3,
2
4,
3
4,
4
4
Storing method
Storage size Y+0.25Cr+0.
34
724401
Sample positions with 4:2:0 digitization format
Cb
Cr
Y 1, 2,
1 2,
1
1,
2
724401
2
Play
Cb
Cr
Y 1,
1
1,
2
4:2:0 playback process
Multimedia
Video Media
4:2:0
2,
1
2,
2
35
Multimedia
Video Media
4:2:0
• To avoid flicker effect with the chrominance
signal
– the receiver uses the same chrominance value
from the sampled lines for the misslines
• Large-screen flicker effects are often reduced
by
– storing the incoming digitized signals of each field
in a memory buffer
– Double the normal rate 100/120 Hz then used
with the stored set of signals used for the 2 field
724401
36
•
•
•
•
•
HDTV
High-Definition Television
Older 4/3 aspect ratio 1440 x 1152 pixels
newer 16/9 aspect ratio 1920 x 1152 pixels
1080 visible lines per frame
4:2:2 digitization for studio application
– Frame rate 50/60 Hz
• 4:2:0 digitization for broadcast application
– Frame rate 25/30 Hz
724401
Multimedia
Video Media
37
SIF
• Source Intermediate Format
• Used in Video Cassette Recorders (VCR)
• Used Half spatial resolution in both
horizontal and vertical in 4:2:0 format
• Frame rate 30 Hz for 525 line, 25 Hz for 625
line
• Progressive (non interlaced) scanning
• The receiver estimated by interpolating
between each pair of value missing line
724401
Multimedia
Video Media
38
Multimedia
Video Media
SIF and CIF
724401 Sample positions for SIF and CIF
39
Multimedia
Video Media
SIF and CIF
Cb
Cr
Y 1, 2,
1 2,
1
1,
3,
1
3,
4,
1
4,
2
1,
3
1,
2
2,
3
2,
2
3,
3
3,
2
4,
3
4,
4
4
4
4
From Source
Storage size Y+Cr+Cb
Cb
Cr 2,
Y 1, 2, 2 3,
1 2
1
1,
3
3,
3
Storing method
Storage size 0.25Y+0.0625Cr+
40
724401
Sample positions with 4:2:0 digitization format
Multimedia
Video Media
SIF and CIF
Cb
Cr 2,
Y 1, 2, 2 3,
1 2
1
1,
3
3,
3
Storing method
Cb All 2,2
Cr All 2,2
Y 1, 1,
1 1,
1
1,
3,
1
3,
3,
1
3,
1
1,
3
1,
1
1,
3
1,
1
3,
3
3,
1
3,
3
3,
3
3
3
3
Playback
41
724401
Sample positions with 4:2:0 digitization format
Multimedia
Video
Media
When Capture from Video Tape
2,
Y 1, 2, 2 3,
1 2
1
1,
3
3,
3
From Video Tape
or Home use Quality Signal
Cb
Cr
Y 1, 3,
1 3,
1
1,
3
3
Capture to Computer
Video
Tape
360x288
Video
Clip
360x288
42
724401
Sample positions with 4:2:0 digitization format
Multimedia
Video Media
CIF
• Common Intermediate Format
• Defined for use in Videoconferencing
applications
• Typical bit rate used is a single 64 kbps ISDN
channel
• Can multiple channel for high bit rate
4CIF: Y= 720 x 576
Cb = Cr = 360 x 288
16CIF: Y= 1440 x 1152
43
Cb = Cr = 720 x 576
724401
360x288
CIF
64 kbps
64 kbps
64 kbps
CIF
64 kbps
360x288
720x576
CIF CIF
CIF CIF
256 kbps
256 kbps
CIF CIF
CIF CIF
720x576
724401 In Videoconference Application
Multimedia
Video Media
CIF
44
Multimedia
Video
Media
Common Digital Video Sizes
•
•
•
•
•
•
CCIR-601720x480 4:2:2, 4:2:0
SIF
360x240 4:2:0
CIF
360x288 4:2:0
4:3 HDTV
1440x1152 4:2:2, 4:2:0
9:16 HDTV
1920x1152 4:2:2, 4:2:0
4CIF, 16CIF, QCIF
724401
45
Multimedia
Video
Media
PC video digitization formats
724401
46
Multimedia
Video
Media
Multimedia Communication Standards
• H.320 Video Teleconferencing Standard
– Visual Telephone System over N-ISDN
• H.324
– low bit rate multimedia communication terminal
for PSTN and Mobile Radio
• H.321, H.310
– high resolution broadband audiovisual
communication systems via B-ISDN
• H.322, H.323
– narrowband visual telephone services on LAN
724401
47
Multimedia
Video Media
Referrence
• Multimedia communication Application, Networks, protocols and
standards; fred halsall. Chapter 2 Multimedia information
representation page 96-113; ISBN 0201398184
• http://www.sce.carleton.ca/courses/96502
• http://www.crs4.it/~luigi/MPEG/ccir601.html
• http://www.broadcastengineering.com/archives/0198/199801be
15.html
• http://www.cs.unc.edu/~kmp/classes/sp01/comp249
724401
48