Transcript Slide 1
Recent Work on Laplacian Mesh Deformation Speaker: Qianqian Hu Date: Nov. 8, 2006 Mesh Deformation Producing visually pleasing results Preserving surface details Approaches Freeform deformation (FFD) Multi-resolution Gradient domain techniques FFD FFD is defined by uniformly spaced feature points in a parallelepiped lattice. Lattice-based (Sederberg et al, 1986) Curve-based (Singh et al, 1998) Point-based (Hsu et al, 1992) Multi-resolution Gradient domain Techniques Surface details: local differences or derivatives An energy minimization problem Least squares method (Linear) Alexa 03; Lipman 04; Yu 04; Sorkine 04; Zhou 05; Lipman 05; Nealen 05. Iteration (Nonlinear) Huang 06. References Zhou, K, Huang, J., Snyder, J., Liu, X., Bao, H., and Shum, H.Y. 2005. Large Mesh Deformation Using the Volumetric Graph Laplacian. ACM Trans. Graph. 24, 3, 496-503. Huang, J., Shi, X., Liu, X., Zhou, K., Wei, L., Teng, S.H., Bao, H., G, B., Shum, H.Y. 2006. Subspace Gradient Domain Mesh Deformation. In Siggraph’06 Sorkine, O., Lipman, Y., Cohen-or,D., Alexa, M., Rossl, C., Seidel, H.P. 2004. Laplacian surface editing. In Symposium on Geometry Processing, ACM SIGGRAPH/Eurographics, 179-188. Differential Coordinates δi L(vi ) jN ( i ) ij jN ( i ) ij (vi v j ), 1. Invariant only under translation! Geometric meaning Approximating the local shape characteristics The normal direction The mean curvature Laplacian Matrix The transformation from absolute Cartesian coordinates to differential coordinates A sparse matrix Energy function The energy function with position constraints The least squares method Characters Advantages Detail preservation Linear system Sparse matrix Disadvantages No rotation and scale invariants Example Original δi Ti 1) Isotropic scale 2) Rotation Edited Ti (V ) L(vi) Definition of Ti A linear approximation to T s exp( H ) s( I H hT h) where is such that γ=0, i.e., Large Mesh Deformation Using the Volumetric Graph Laplacian Kun Zhou, Jin Huang, John Snyder, Xinguo Liu, Hujun Bao, Baining Guo, Heung-Yeung Shum Microsoft Research Asia, Zhejiang University, Microsoft Research Comparison Contribution Be fit for large deformation No local self-intersection Visually-pleasing deformation results Outline Construct VG (Volumetric Graph) Gin (avoid large volume changes) Gout (avoid local self-intersection) Deform VG based on volumetric graph laplacian Deform from 2D curves Volumetric Graph Step 1: Construct an inner shell Min for the mesh by offsetting each vertex a distance opposite its normal. An iterative method based on simplification envelopes Volumetric Graph Step 2: Embed Min and M in a body-centered cubic lattice. Remove lattice nodes outside Min. Volumetric Graph Step 3:Build edge connections among M, Min, and lattice nodes. Edge connection Volumetric Graph Step 4: Simplify the graph using edge collapse and smooth the graph. Simplification: Smoothing: VG Example Left: Gin (Red); Right: Gout (Green); Original Mesh (Blue) Laplacian Approximation The quadratic minimization problem The deformed laplacian coordinates Ti : a rotation and isotropic scale. Volumetric Graph LA The energy function is Preserving surface details i Ti i Enforcing the userspecified deformation locations Preserving volumetric details i Ti i Weighting Scheme i For mesh laplacian, j+1 βij αij j-1 j For graph laplacian, p1 p2 pi Pj-1 Pj+1 pj Local Transforms Propagating the local transforms over the whole mesh. Deformed neighbor points up p t(u) C(u) Up P’ t’ (u) C’(u) Local Transformation For each point on the control curve Rotation: normal: linear combination of face normals tangent vector Scale: s(up) Propagation Scheme The transform is propagated to all graph points via a deformation strength field f(p) Constant Linear Gaussian The shortest edge path Propagation Scheme A smoother result: computing a weighted average over all the vertices on the control curve. Weight: The reciprocal of distance: A Gaussian function: Transform matrix: Solution By least square method A sparse linear system: Ax=b Precomputing A-1 using LU decomposition Example Deformation from 2D curves 3D 2D Projection Deformation Deformation Back projection 3D 2D Curve Editing Cb C Least square fitting Cd discrete 3 bspline curve Editing Laplacian deformation A rotation and scale mapping Ti C’ N 2 min L( pi) Ti δi pi i 1 C ’b C ’d Example Demo Subspace Gradient Domain Mesh Deformation Jin Huang, Xiaohan Shi, Xinguo Liu, Kun Zhou, Liyi Wei, Shang-Hua Teng, Hujun Bao, Baining Guo, HeungYeung Shum Microsoft Research Asia, Zhejiang University, Boston University Contributions Linear and nonlinear constraints Volume constraint Skeleton constraint Projection constraint Fit for non-manifold surface or objects with multiple disjoint components Example Deformation with nonlinear constraints Example Deformation of multi-component mesh Laplacian Deformation The unconstrained energy minimization problem where f1 ( X ) LX ˆ( X ), fi ( X ), i 1 are various deformation constraints Constraint Classification Soft constraints a nonlinear constraint which is quasi-linear. AX=b(X) A: a constant matrix, b(X): a vector function, ||Jb||<<||A|| Hard constraints those with low-dimensional restriction and nonlinear constraints that are not quasi-linear Deformation with constraints The energy minimization problem where L is a constant matrix and g(X) = 0 represents all hard constraints. Soft constraints: laplacian, skeleton, position constraints Hard constraints: volume, projection constraints Subspace Deformation Build a coarse control mesh Control mesh is related to original mesh X=WP using mean value interpolation The energy minimization problem Example Constraints Laplacian constraint Skeleton constraint Volume constraint Projection constraint Laplacian constraint a) the Laplacian is a discrete approximation of the curvature normal b) the cotangent form Laplacian lies exactly in the linear space spanned by the normals of the incident triangles xi Xi,j-1 Xi,j+1 Xi,j Laplacian coordinate For the original mesh, In matrix form, δi = Ai μi, then μi = Ai+δi For deformed mesh The differential coordinate i ˆ i ( X ) di ( X ) di Skeleton constraint For deforming articulated figures, some parts require unbendable constraint. Eg, human’s arm, leg. Skeleton specificaation A closed mesh: two virtual vertices(c1,c2), the centroids of the boundary curve of the open ends: Line segment ab: approximating the middle of the front and back intersections(blue) Skeleton constraint Preserving both the straightness and the length a si Si+1 b In matrix form, For each point , si j kij x j 1 ()ij (kij ki 1, j ) (krj k0 j ) r () j krj k0 j Volume constraint The total signed volume: The volume constraint vˆ is the total volume of the original mesh Example Notice: volume constraint can also be applied to local body parts Projection constraint Let p=QpX, the projection constraint p Object space (ωx ,ωy ) Eye space Projection plane Projection constraint The projection of p(=QpX) In matrix form, i.e., Example Constrained Nonlinear Least Squares The energy minimization problem Iterative algorithm Following the Gauss-Newton method, f(X) = LX-b(X) is linearized as Iterative algorithm At each iteration, then When Xk =Xk-1 , stop Stability Comparison Example(Skeleton) Example(Volume) Example(non-manifold) Demo Thanks a lot!