Applications

Visible Light Video Sequences

Juergen Thiem, Jan Rorive

Sony Business

Emmanuel Cordonnier

ETIAM

DICOM from X-Ray to VL

Visible image / Therapy Radiology / Diagnosis Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 2

Main Visible Light Modalities

Rigid Endoscopy Microsurgery Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video Flexible Endoscopy page 3

The Current Demand • Presentation • Publication • Reporting • Education

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 4

PRE

Surgery and Intra Body Diagnosis

POST

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 5

In Association with Other Images

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 6

From Still Images to Video Clips

• Digital video sequences: – Replacing analogue tapes – For post operation reporting – Carefully selected clips • Archiving on DVD or Server • Without workflow disturbance • Associated to report for referring physicians • Minimizing the retrieval time – Including sound (environment, comments) DICOM 20 th Anniversary Conference / Video page 7 Thiem, Rorive & Cordonnier

Today’s VHS Situation

Safe Area Medical VHS Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 8

Digital Video Evolution

Safe Area DV Thiem, Rorive & Cordonnier MPEG, DVD, VCD, DiVX DICOM 20 th Anniversary Conference / Video page 9

Emerging Proprietary Solutions

Safe Area MPEG Thiem, Rorive & Cordonnier MPEG, DVD, VCD, DiVX DICOM 20 th Anniversary Conference / Video page 10

DICOM Proposition

Safe Area Patient data Hospital Information System <- Worklist DICOM CD PACS Ethernet DICOM Workstations Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 11

Workload PACS

RADIOLOGY PACS WEB ARCHIVE Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 12

The Video Signal

•

PAL

is the analogue TV transmission standard used in

Europe

, and throughout many parts of the world. A uncompressed PAL TV (25 f/s) picture produces a massive 216 Mbit/sec bit stream • The

U.S.

uses an analogue TV system called

NTSC

. This system provides less precise color information, and a different frame rate (30 f/s). An uncompressed NTSC signal requires slightly less transmission capacity at 168 Mbit/sec. • Data rates becomes even higher when one realizes a

High Definition TV

(

HDTV

) picture requires a raw bandwidth exceeding 1 Gbit/sec (1000 Mbit/sec).

DICOM 20 th Anniversary Conference / Video page 13 Thiem, Rorive & Cordonnier

MPEG-2

• 1987 Discussion about compression of video • 1988 ISO/IEC Moving Picture Experts Group • 1992 MPEG-2 (TV) and MPEG-3 (HDTV) combined • 1993 MPEG-2 Main profile defined, compatible with MPEG-1 • 1994 ISO 13818-1 MPEG-2 Systems Definition • 1997 First interactive Digital Video Broadcast service using MPEG-2 • 1998 Digital Versatile Disk (DVD) using MPEG-2 • 2000 Definition of the DVB Multimedia Home Platform (MHP) • 2002 Availability of real time MPEG-2 DVD R writers Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 14

Other MPEG standards

• MPEG-1, a standard for storage and retrieval of moving pictures and audio on storage media • MPEG-2, for digital video • MPEG-4, for multimedia applications (

~

DivX) • MPEG-7, content representation standard for information search • MPEG-21 to define a multimedia framework page 15 Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video

Why MPEG-2

• Open, established standard • Compatibility to DVD and Networks • Low cost technology base • Family inter-operability & flexibility • Scalable bit rates • Industry Support… • and STABLE Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 16

MPEG-2 Dissemination

Systems which now use MPEG-2 is extensive and continuously growing: – Digital TV (cable, satellite and terrestrial broadcast) – Video on Demand – Digital Versatile Disc (DVD) – Personal Computing – Card Payment, test and measurement, etc.

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 17

MPEG-2 Compression

• Video compression which is backwards compatible with MPEG-1 • Full-screen interlaced and/or progressive video (for TV and Computer displays) • Enhanced audio coding (high quality, mono, stereo, and other audio features) • Transport multiplexing (combining different MPEG streams in a single transmission stream) • Other services (GUI, interaction, encryption, data transmission, etc) page 18 Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video

MPEG-2 Group of Pictures (GOP)

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 19

MPEG-2 Compression

MPEG-2 provides a way to compress the digital video signal to a manageable bit rate. Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 20

MPEG-2 Levels & Profiles

• Profile = quality of the video • Level = resolution of the video • The basic system is known as Main Profile Main Level (MP@ML) which covers video compression to 1-15 Mbps. High High-1440 Main Low Level/Profile Simple Thiem, Rorive & Cordonnier

X X X X X

Main

X X X

SNR Spatial DICOM 20 th Anniversary Conference / Video

X X X

High page 21

MainProfile@MainLevel

Profile Table Level Table Compatibility  720 x 576 x 25 fps (PAL CCIR 601)  352 x 576 x 25 fps (PAL Half-D1)  720 x 480 x 30 fps (NTSC CCIR 601)  352 x 480 x 30 fps (NTSC Half-D1) Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 22

MPEG-2 MP 4:2:0 Image format

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 23

DICOM WG13 MPEG2 Work Item

• Several face to face meetings, mainly in Europe, and t-cons • Supplement 42: MPEG2 Video Sequence Transfer Syntax • Supplement 47: Visible Light Video Sequences • Plan to finalize the supplements end 2003, for balloting early in 2004 page 24 Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video

DVD based media exchange profile

• The DVD writers (~350€) and DVD-R media (~2€) are really accessible • CD is more and more accepted and used for image distribution and « portable archive » • DICOM sup 80 will be balloted soon • WG13 proposes to: – Use the sup 80 format with VL SOP + potential Key Object Selection for « key » sequences – Add an informative annex suggesting how to create a « dual format » DVD containing the DICOM data and a Video DVD of the acquired / selected sequences for the distribution to the patient / referring physician Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 25

« Dual Format » DICOM / video DVD

DICOMDIR VIDEO-TS Key Key Object Object Selection Key DICOM Object MPEG2 sequence DICO M data Key directory Object titles, overlays Key MPEG2 Object sequence Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 26

Conclusion

• The demand for digital video recording in Visible Light Imaging is emerging • DICOM will contribute to harmonize the different products • MPEG2 MP@ML is the best compromise • Network transfer and DVD media exchange • To be adopted in VL in a couple of months • Could be applicable elsewhere (US…) DICOM 20 th Anniversary Conference / Video page 27 Thiem, Rorive & Cordonnier