Joint Technical Symposium - 2010

High Definition in the Archive Domain

May 5, 2010

01

Introduction – HDTV some key points

A quick comparison HD/SD Offer better and more attractive programmes to the viewer. It is done through: A better picture resolution allowing a new viewing distance (3H versus 6H) Image definition A better sound quality : 5.1 versus mono or stereo A 16/9 aspect ratio wide screen versus 4/3 More scanning modes: Progressive or interleaved versus interleaved.

Audio Aspect ratio Scanning SD HD

720 pixels per line 576 Active lines ( from 200 000 to 400 000 pixels) 1280 or 1920 pixels per line 720 or 1080 active lines ( from 900 000 to 2 000 000 pixels)

Mono or Stereo 4/3 or 16/9

Interleaved (i) 50 or 60 Hz

Sound 5.1

Digital Dolby 6 tracks 16/9

Interleaved ( i) Progressive (p) Progressive Segmented Frame (PSF) 50 , 60 ,24 Hz

HD in the Archive Domain | May 5, 2010 3

HDTV formats International formats and standards are well defined and adopted but they are numerous:

Formats are described by:

Number of active pixels per line 1920 1440 1280 Number of active lines per frame 1080 720 Frame rates 60 59,94 30 29,97 25 Scanning mode interleaved progressive psf Picture aspect ratio 16/9 24 23,98 HD in the Archive Domain | May 5, 2010 4

HDTV formats and standards Most popular formats are:

1920x1080i 1280x720p

at

50i,60i,25p,25 psf,30p,30 psf,50p and 60 p) and (24 p and 24 psf) Going from one format to another requires cross conversion.

C

alculation of pixels and lines

F

rame rate conversion

I

nterleave or de-interleave HD in the Archive Domain | May 5, 2010 5

But there are as many practices as televisions…. There is a great variety of formats and compressions used in production postproduction and broadcast.

The production standard for TV programs is not necessarily the same as the broadcast standard Though “labelled HD”, The “real quality” may vary in a wide range. HD in the Archive Domain | May 5, 2010 6

A wide range of shooting solutions and quality HD shooting Low end solutions HDV MPEG2 25Mb/s long GOP 6 or 12 AVCHD H264 21Mb/s long GOP Broadcast solutions Sony’s HDXDCAM MPEG2 422 up to 50Mb/s on 50GBoptical disk Panasonic’s DVCPRO HD AVC intra up to 100Mb/s on 64 GB P2 cards Sony’s’ XDCAM EX MPEG2 up to 35 Mb/s on 32 GB SxS cards Grass Valley Infinity JPEG2000 up to 100 Mb/s on Hard drive High quality capture HDCAM SR up to 880Mb/s in high speed mode on tape HD in the Archive Domain | May 5, 2010 7

Main used compression types

HD compressions MPEG2 HD DV HD

DVC pro HD

H264 HD MJPEG

DNx (AVID) Pro res (Apple)

JPEG2000

HD in the Archive Domain | May 5, 2010 8

Most used compression schemes

Shooting

MPEG2 HD long GOP MPEG2 HD short GOP DV HD AVC long GOP AVC intra

Post Production

Base band 1,5GB/s MPEG2 HD : up to 300Mb/s DV HD up to 100Mb/s

Proprietary formats:

Pro Res (Apple) DNx (Avid) Others...

Play out

MPEG2 HD 20 to 80Mb/s

Broadcast Archiving

MPEG2 HD 15 to 20Mb/s H264 8 to 16Mb/s ?

HD in the Archive Domain | May 5, 2010 9

02

The Challenges

The challenges More and more televisions are producing and broadcasting HDTV.

The ratio of SD programmes versus HD programmes is decreasing rapidly Archivists must face and manage 2 new challenges: How to collect, store and make accessible these new HD digital programmes?

and How could SD archives be re-used in a HD environment?

HD in the Archive Domain | May 5, 2010 11

Archiving HD ?

Standard definition video (uncompressed) High definition video (uncompressed) 720 pixels 576 lines 1- hour programme file size : 72 GB

?

1980 pixels 1080 lines 1- hour programme file size : from 374 GB to 673 GB* according to frame rates

To archive HD, Compression “could” be required

.

?

?

HD in the Archive Domain | May 5, 2010 12 ?

Using SD in HD programs Sometimes, archivists have already digitised their original analogue archives in SD.

Questions … How could these SD preservation masters be used and match the quality requirements of HDTV?

When will we need to reuse original media?

What kind of process do we need,to try to match HD quality requirements? HD in the Archive Domain | May 5, 2010 13

Using SD in HD programs : video and film archives...

SD video program Up conversion HD program Film programs 16/S16/35 mm SD telecine HD telecine Up conversion

?

HD program

HD in the Archive Domain | May 5, 2010 14

Using SD in HD programs : About up conversion...

The quality of the HD output depends very much on the quality of up conversion.

The main functions that an up converter must achieve, are: Calculation of missing pixels and lines Frame rate conversion Resizing Interleaving or de-interleaving Frame rate conversion (cross conversion) could also degrade the picture.

HD in the Archive Domain | May 5, 2010 15

Using SD in HD programs : About resizing...

There are several possibilities to show 4/3 pictures in 16/9 programs

4:3 16:9

Side Panel

16:9 4:3

?

Top/ Bottom Crop

16:9 4:3

Zoom,and stretching

HD in the Archive Domain | May 5, 2010 16

Stretching

03

Current practices

The questionnaire In 2009 a short questionnaire about HDTV current practices has been sent to FIAT/IFTA members.

This questionnaire has 4 chapters: 1-General information and current situation about HD of the company or television.

2-Technical information about formats and standards used in the company for : > > shooting production and post production > Mastering > broadcasting 3-HD programs archiving > Volumes, media ,storage > expected evolutions or plans in the company about HD archiving?

4-Use of SD archives in HD programs .

HD in the Archive Domain | May 5, 2010 18

The questionnaire 12 companies have answered to the questionnaire: > Sound and Vision National Dutch Broadcast archives for Public Broadcast > ORF Austrian Broadcasting Corporation > SBS Korea > TFO French educational channel Toronto (Canada) > Televisio de Catalunya TVC (Spain) > > CBS News TSR Télévision Suisse Romande > SVT > CBC radio Canada > NBC news /NBC universal > NHK > CCTV HD in the Archive Domain | May 5, 2010 19

Production: from shooting to broadcasting It seems that shooting full HD is predominant Almost all televisions use all formats and shooting solutions : Most used media are HDCAM HDXDCAM and DVCPro HD For postproduction, most of the companies use AVID DNx file format either 120 or 185. For mastering HDCAM/HDCAM SR is preferred MPEG2 broadcasting is still far ahead compared to H264.

shooting

Format 1920x 1980 1280x 720p 1440x1080 other HDCAM/HDCAM SR HDXDCAM DVCpro P2 DNX HD D5 ohter

Production

HDCAM HDCAM SR HDXDCAM DnX HD Pro res DVCpro HD

Mastering

HDCAM/HDCAM SR XDCAM HD D10?

D5 DVCpro HD

Broadcasting

MPEG2 H264 5 3 1 1 2 10 2 HD in the Archive Domain | May 5, 2010 2 3 4 1 2 6 2 1 3 5 3 3 1 1 1 20

Archiving Most companies archive original format on the shelves, but most of them intend to go file

Current archiving

On the shelves archiving as files MPEG2 HD seems to be the file format in use (or most expected) H264 HD seems too young to be considered as a file format for archives

intend to archive as files

Yes not yet chosen JPEG2000 that is standardised for digital cinema, is not well known and considered in televisions.

files

MPEG2 and XDCAM DVCPro HD JPEG2000 DNx 8 2 7 3 4 2 1 on film only 1 HD in the Archive Domain | May 5, 2010 21

4/3 use policy Generally televisions perform up conversion indoor while independent archivists prefer to let end users to achieve the transformation.

The use of pillar box presentation has the preference of the televisions and archivists.

When the choice is made by the end user, any kind of transform may happen….

up conversion

indoor end user

resize

Pilar box top bottom crop stretch/zoom choice by end user 9 2 6 no resize 3 0 3 HD in the Archive Domain | May 5, 2010 22

04

Our projects …..

From our archives (SD) ….. We have now 450 000 hours of digitalized videos, mainly on the MPEG2 (8 Mb/s) format.

Fortunatly we went through a phase of dubbing on numeric Betacam, and we store hundreds thousands of numeric tapes .

The goal is to transfert the tape on files : To enable an easy use of archives To enable an easy use of upscaling and restoration for video and film (… with some new HD transfert for the 35 mm film) But we want to forget the tape without regrets … HD in the Archive Domain | May 5, 2010 24

From our archives (SD) ….. A new format We want a new format With complete specifications and documentation Without impact of Patents (preferably) We store the national heritage !

With a very hight quality IntraFrame, 4:2:2, 10 bits, 8 audio channels etc From 50 Mb/s to 100 Mb/s or more This year we build a model to help us make the choice between : Several competitors AVC-Intra, D10, DPX and … JPEG2000 For our SD archives and for the new incoming HD programs.

HD in the Archive Domain | May 5, 2010 25

Model ...

DV, MPEG HD, H264, DNx

On demand !

HDCAM HDCAM SR SDI Encoding in « NewFormat » wrapping in MXF Betacam Numeric Beta SDI Encoding in « NewFormat » wrapping in MXF Files Public TV Encoding or Transcoding in « NewFormat » wrapping in MXF Clipping Transcoding Upscaling Restitution SDI/HDSDI STORAGE Tape Library Scalar 10K LTO 5 HSM Clipping x N Transcoding Upscaling x N Restitution FTP Transcoding H264 Proxy SAN Serveur NAS HD in the Archive Domain | May 5, 2010 26

Thank you for your attention

[email protected]

HD in the Archive Domain | May 5, 2010 27