Transcript Slide 1

Image-processing
Technologies
for Digital Content Creation
[email protected]
© 2006 Autodesk
1
CORPORATE INFORMATION
REALVIZ: Founded March 98
Exclusive technology from INRIA Sophia-Antipolis

Technology from the Robotvis group
Headquarters and R&D in Sophia Antipolis, Southern
France
90% of revenue outside France, 50% in the USA
Just acquired by Autodesk (PSEB division)
© 2006 Autodesk
2
MISSION
Image-based technologies empower designers and graphic
artists to efficiently create the most effective visual content
based on digital photographs and videos.
Post-production
Multimedia
Digital Imaging
Architecture
CAD
Video Games
Dinotopia - Courtesy of Framestore CFC
Monkey – Courtesy of Quiet Man
© 2006 Autodesk
3
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
© 2006 Autodesk
4
PANORAMIC PHOTOGRAPHY
Panoramic Photography
© 2006 Autodesk
5
IMAGE STITCHING
Creation of panoramic images up to full spheres (360° horizontal by
180° vertical) – fully automatic
Thousands users : professional photographers, digital imaging
hobbyists, multimedia & web designers, architects, post-production
artists
© 2006 Autodesk
6
FULL SPHERICAL PANORAMAS
Click inside to see the full screen, full spherical QuickTime VR Panorama
Courtesy of VR Way
© 2006 Autodesk
7
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
© 2006 Autodesk
8
IMAGE BASED MODELING
Bridging the gap between 2D and 3D
Image Based Modeling
© 2006 Autodesk
9
IMAGE BASED MODELING
Creation of 3D photo-textured objects from photographs
(1 to many)
Applications





© 2006 Autodesk
Virtual reality: 3D Simulation/Storytelling
Urban planning & perspective matching for 3D CAD models
Photogrammetry
Video games
3D animation & special effects
10
IMAGE BASED MODELING
… for photo-realistic
3D models !
From stills…
… calibrated in 3D
from the manual placement
of matching points …
© 2006 Autodesk
11
IMAGE BASED MODELING
… to a photo-realistic
3D environment !
From a panorarma
or a still picture…
… more demos
© 2006 Autodesk
12
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
© 2006 Autodesk
13
SPECIAL EFFECTS
SFX Solutions
© 2006 Autodesk
14
CAMERA TRACKING
Before…
Click inside to see the movie.
… After
Camera
path
& 3D points
extracted
with
MatchMover
3D content
Rendered in
3D
animation
software
Click inside to see the movie.
Courtesy of Platige Image 2005
© 2006 Autodesk
Click inside to see the movie.
Click inside to see the movie.
Courtesy of Platige Image 2005
15
CAPTURING 3D RIGID MOTION
- Feature points are extracted and tracked across sequences
- Based on parallax and rigidity (epipolar geometry), the algorithm extracts:
- Camera path and parameters (zoom, distortion) over time
- 3D point coordinates
- Ready for 2D/3D video-montage… all in one click!
© 2006 Autodesk
16
SOME MOVIES
© 2006 Autodesk
17
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
© 2006 Autodesk
18
MOTION CAPTURE
Motion Capture
© 2006 Autodesk
19
VIDEO-BASED MOCAP
Capture non-rigid 3D
motion from several
videos
© 2006 Autodesk
20
VIDEO-BASED MOCAP
Video-based motion capture solution
Applications: animation, bio-medical, ergonomy…etc
Covering facial, full body, and on-set mocap
Total flexibility

From 2 cameras to as many as needed

Cameras can fixed or moving.

Cameras can be of different frame rate and different definitions.

No need for a motion capture studio
Computed data
© 2006 Autodesk

Tracked 3D points

Camera data
21
VIDEO-BASED MOCAP
© 2006 Autodesk
22
MATCHMOVING
FROM
RIGID MOTION…
One moving camera observing a rigid scene : Parallax (i.e relative 2D
image motion) allows recovering 3D camera motion and scene
structure
N
1
..t..
© 2006 Autodesk
23
… TO NON-RIGID MOTION
- Several synchronous cameras are used
- Same geometric problem as matchmoving at each time
Time 1
Cam3
Cam1
Cam2
Time N
Cam1
Cam3
Cam2
- Bonus: We can handle camera motion as well!
© 2006 Autodesk
24
VIDEO-BASED MOCAP
…Result
© 2006 Autodesk
25
ON-SET MOCAP
-All sequences shot with
-- 2 fixed cameras: HD digital (1920x1080)
- 1 mobile camera (the main shooting cam): film, scanned at 2048x1536
…Result
© 2006 Autodesk
26
Q&A
© 2006 Autodesk
27