Windows Media Photo A new format for end-to-end digital imaging Bill Crow Principal Program Manager Digital Media Division Microsoft Corporation.

Download Report

Transcript Windows Media Photo A new format for end-to-end digital imaging Bill Crow Principal Program Manager Digital Media Division Microsoft Corporation.

Windows Media Photo
A new format for end-to-end digital
imaging
Bill Crow
Principal Program Manager
Digital Media Division
Microsoft Corporation
Overview
Enabling technology to significantly
improve end-to-end digital imaging
Superior Image Quality
Better Performance
New Opportunities
Overview
Support for the Widest Range of Pixel Formats
8, 16 or 32 bits per channel, multiple packed bit formats
Unsigned integer, fixed point, floating point
RGB, CMYK, Grayscale, n-Channel; planar or interleaved alpha
High Performance, Low Footprint Algorithm
Optimized for device implementation
Small buffer requirements, no complex math
Advanced Decoding and Transformation Operations
Mipmaps (variable frequency decode), region decode
Compressed domain crop, rotate/flip and resolution reduction
2x Compression Improvement Over Today’s Standard
The same image quality in a file that is ½ the size of JPEG
Smaller files encode/decode/transfer faster, with less power
Lossless plus lossy compression with the same algorithm
Preserving All The Content
Today’s unsigned integer formats
discard useful information
12+ bpc
linear RGB
8+ bpc nonLinear RGB
16+ bpc linear HDR scRGB
Camera
Source
Devices
Scanner
Source
Devices
12-16+ bpc
linear RGB
8bpc non-linear RGB
Intermediate
Intermediate
Storage,
Storage,
Editing
and
Editing and Management
Management
Display
Destination
Devices
Printer
Destination
Devices
8+ bpc nonLinear CMYK
Unprocessed Source Data
Processed Source Image
Unsigned Integer RGB Image
Unsigned Integer RGB Image
Fixed Point Or Float RGB Image
Fixed Point Or Float RGB Image
Exposure Adjustment
sRGB Original
sRGB Adjusted -1.5 stops
16bpc unsigned integer
16bpc unsigned integer
scRGB Original
scRGB Adjusted -1.5 stops
16bpc fixed point
16bpc fixed point
Compression Versus Quality
P12 - Full - 8bpc
 WMPhoto
 JPEG-2K
▲ JPEG
55
50
RGB Peak SNR
45
40
WMPhoto
JPEG-2K
JPEG
35
30
25
20
0
1
2
3
4
Bit Rate (Bits/Pixel)
5
6
7
Windows Media Photo
Bill Crow
Principal Program Manager
Digital Media Division
Benefits
An efficient, standardized photo interchange format
that preserves the entire dynamic range
Significantly improved ability to correct poor images
Images look better with more shadow and highlight detail
Exposure and color corrections don’t discard dynamic range
Supports end-to-end acquisition, editing, rendering, printing
Better photos that are ½ the size of JPEG
Faster transfer, less device power consumption
Significant reduction in storage space requirements
25x compression or more is reasonable for typical photos
Allows higher resolution images for email and web
Color And Compression
Flexible color space support
8 or 16 bpc unsigned integer
16 or 32 bpc fixed point, floating point
RGB, CMYK, Grayscale, n-channel
5-5-5, 5-6-5, 10-10-10 packed-bit RGB
1bpc black/white, mask
4:4:4, 4:2:2, 4:2:0 color sampling
Interleaved or planar alpha channel
High performance compression technology
Lossy and lossless compression with a single algorithm
No complex math; can be implemented with low gate counts
Minimal memory requirements, no full frame buffer required
Symmetric algorithm, equal complexity for encode and decode
Advanced Operations
Structured compressed domain organization
Progressive decode – fast previews and thumbnails
Region decode
Compressed domain transforms
Cardinal rotation, flip
Down-sample
Crop
Spatial versus frequency data re-organization
Two optional levels of overlap encoding
Bit stream and decoder support for custom dynamic Q
Per channel
Per macro-block
Very large image dimensions
216 x 216 macro-blocks per tile, 28 x 28 tiles, 268m2 pixels
Container And Metadata
TIFF-like IFD structure
Provides maximum compatibility with existing code
Multiple images supported via linked IFD tables
32-bit internal byte pointers, 4Gb max file size
To be addressed in future version
Flexible Metadata
WMPhoto-defined IFD tags for image format and structure
Pixel Format GUID
Width, Height, Resolution
Transformation
Image and Alpha data pointers, size
Industry-compatible IFD tags for descriptive info
XMP metadata
ICC profile
TIFF-compatible descriptive tags
EXIF metadata
Describing The Bitmap
Multiple current solutions
TIFF uses basic colorimetric info based
on predefined photometric interpretations
TIFF/EP uses ICC Profile
JPEG carries basic RGB colorimetric info
WMPhoto: PixelFormat GUID and ICC Profile
PixelFormat GUID is unambiguous, compact and extensible
ICC Profile for legacy unsigned integer pixel formats
“Default” color context when no ICC profile is present
Unsigned integer RGB: sRGB
Unsigned integer CMYK: SWOP
Signed/float RGB: scRGB (linear, unprofiled)
Gray: Luminance-only component of equivalent RGB context
Windows Imaging Component (WIC)
New imaging infrastructure for Windows
Windows Vista, Windows Presentation Foundation
and WIC-only redistributable
Extensible pixel formats and codecs
Provides an HDR image processing pipeline
Windows Media Photo fully supports WIC API’s
WMPhoto Class
WIC Interface
CWMPCodecInfo
IWICBitmapEncoderInfo
IWICBitmapDecoderInfo
CWMPEncoder
IWICBitmapEncoder
CWMPDecoder
IWICBitmapDecoder
CWMPDecoderFrame
IWICBitmapFrameDecoder
IWICBitmapSourceTransform
IWICMetadataBlockReader
CWMPEncoderFrame
IWICBitmapFrameEncode
IWICBitmapMetadataBlockWriter
IPropertyBag2
WIC Encoder Parameters
Canonical Parameters
Property Name
VARTYPE
Value
ImageQuality
VT_R4
0.0 - 1.0
Lossless
VT_BOOL
True/False
BitmapTransform
VT_UI1
WICBitmapTransformOptions
Windows Media Photo Specific Parameters
Property Name
VARTYPE
Value
Quality
VT_UI1
1 – 255 (Default: 1 - lossless)
Overlap
VT_UI1
0 – 2 (Default: 1)
Subsampling
VT_UI1
0 – 3 (Default: 3 – 4:4:4)
HorizontalTileSlices
VT_UI2
0 – 4095 (Default: 0)
VerticalTileSlices
VT_UI2
0 – 4095 (Default: 0)
FrequencyOrder
VT_Bool
True/False (Default: True)
InterleavedAlpha
VT_Bool
True/False (Default: False)
AlphaQuality
VT_UI1
1 – 255 (Default: 1 - lossless)
CompressedDomainTranscode
VT_Bool
True/False (Default: True)
ImageDataDiscard
VT_UI1
0-3 (Default: 0)
AlphaDataDiscard
VT_UI1
0-4 (Default: 0)
WIC Advanced Decoding
Supports IWICBitmapSourceTransform
for high performance decoding options
Arbitrary rectangular regions
2x mipmaps for nearest size decoding
Native decode at 1x, 4x, 16x
Interpolated decode at 2x, 8x, >16x
Natively supports all rotate/flip transforms
Pixel format conversion during decode
under consideration for future support
Compressed Domain Operations
Specifying a WMPhoto decoder as the source
for a WMPhoto encoder invokes compressed
domain operations, when possible
Rotate/flip transformation
Crop
Resolution reduction
Spatial versus frequency reorganization
Significant benefits by avoiding lossy
compressed decode and re-encode
No additional image quality loss
Dramatically faster operations
Additional Resources
Device Porting Kit RTM 1.0 is available now
http://www.microsoft.com/windows/windowsmedia/wmphoto
Bit stream spec is final
Includes reference ANSI-C source code
Support for both little-endian and big-endian architectures
Windows Imaging Component (WIC) codec available now
Functionally complete in Windows Vista Beta 2
Same codec is also distributed via WinFX and WIC redists
WIC Info: http://windowssdk.msdn.com/library/en-us/wic/wiclh/wiclh.asp
Power Toys (viewer, converter) coming for Windows XP
Related Sessions
Windows Color System / High Dynamic Range Imaging
Developing XPSDrv Printer Drivers
Using XPSDrv Printer Drivers
Technical questions: wmphoto @ microsoft.com
Call To Action
Use WinFX or WIC for Windows imaging
applications, including drivers
Support high dynamic range workflows
Add support for Windows Media Photo
anywhere your device or application
reads or writes image files
Enhance the features and performance of
your device or application with compressed
domain operations
Implement XPS with Windows Media Photo
support for printers, drivers and applications
© 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market
conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.
MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.