Tour Into the Picture Using Relative Depth Calculation

Download Report

Transcript Tour Into the Picture Using Relative Depth Calculation

Tour Into the Picture Using Relative Depth Calculation

Zhiqing Cao State Key Lab of CAD&CG, Zhejiang University 2004-6

Image-Based Rendering

Advantages:

Do not need illumination calculating.

Do note need explicit process of modeling.

Disadvantages:

Complex capturing process.

Enormous sampled data.

Tour Into the Picture (RDC)

• •

Y. Horry, ACM SIGGRAPH 97 Conference Proceedings Facilitating image-based navigation into a single refer ence image.

i nner wi ndow vani shi ng poi nt out er wi ndow

Tour Into the Picture (RDC)

5 3 11 9 l ef t wal l 1 7 cei l i ng 8 f l oor r ear wal l 2 r i ght wal l 10 12 11 4 6 5 3 9 7 1 12 10 2 8 4 6

Relative Depth Calculation (RDC)

• •

Purpose: To determine the depth of animation. RD is t he farthest distance that user can walk into the TIP model.

To get the same novel image of the TIP mod el as the input image at the fixed viewpoint.

Relative Depth Calculation (RDC)

• • •

Assumptions: The left wall, right wall, an d rear wall are orthogonal to the floor.

The image plane is orthog onal to the floor, too.

The input image must be t aken using a camera that i s hold horizontally.

Definition

: i nput i mage r el at i ve dept h r ef er ence i mage model i mage pl ane f l oor

One vanishing point case (RDC)

n

3

L

'

w

1

M

'

w

2

m

2

C R

'

vh m

1

D f E T O B d T

' 45 0

O

' Si de vi ew

B

'

d

m

1

vh

 

f m

1

h

vh

m

2  (

f f

d

)

w

w

1 

w

2  (

p

1 

p

2 )  (

f f

d

)

n

2

d n

1

L M R p

3 Top vi ew

p

1

C

'

p

2

p

4

f

One vanishing point case (RDC)

Details: Incomplete box model. The left wall, the right wall and the top should be shortened respectiv

ely for

n 1

, n

2

, n

3

.

C i mage pl ane d- n1 l ef t wal l h

Two vanishing points case (RDC)

h

Top View

w

2

w

1

p

2

p

1

p

3

m

4

vh m

1

m

2

m

3

f w

3

d

2

d

3

d

1

d

2

d

3 45

o d

1

f

Side View

Slope (RDC)

C P

A

'

B

'

f

O

tg

 

A

'

B

'

f A

B

Virtual Touring System

Lingyin: Lingyin, founded in 328 A.

D, has a history of more t han 1600 years. It is loc ated in the west side of th e West Lake Scenic Spot s in Hangzhou, P. R. Chin a, and it is known as “Bu ddhist Kingdom in the So utheast” with pretty hills, clear springs and stream s as well as beautiful gre en trees, many historical relics and caves.

Virtual Touring System

Former Residence of Hu Xueyan: Hu Xueyan is one of t he most famous merc hants in the late Qing dyn-asty. His former r esidence, which occu pies 7200 square met ers, is the most lux urious residence in th at period.

IBR Techniques in Our Systems

Panorama

IBR Techniques in Our Systems

TIP with RDC

IBR Techniques in Our Systems

Panorama + TIP

T h e F irst S cen e T h e S econ d S cen e D C radius B A O F Relative Depth

IBR Techniques in Our Systems Others:

• Complex Foreground • Two Vanishing Points Case • Slope • Panorama+Foreground TIP+Slope TIP

A Short Video of Our Systems

Future Work

• • •

Use more input images to obtain better vis ual effect.

Push the social application of TIP.

Some research in TIV (Tour Into the Video)

Thank you!

Q&A