3D Gesture-Based View Manipulator for Large Scale Entity Model Review

T. Xiao, L. Zhang, and M. Fei (Eds.): AsiaSim 2012, Part I, CCIS 323, Springer-Verlag Berlin Heidelberg 2012

Introduction

• • Hand gesture-based Human Computer Interaction (HCI) is one of the most natural and intuitive methods of communication between humans and machines because it closely mimics how humans interact with each other.

We developed a 3D gesture interface to manipulate the display of a 3D entity model.

30/04/2020 2

Introduction

• • For gesture recognition – use the Kinect as a depth sensor to acquire depth image frames – track the position of the user’s skeleton in each frame By simple gestures – the user can pan, zoom, rotate, and reset the view and freely navigate inside the 3D entity model in the virtual space 30/04/2020 3

An Overview of the Stereoscopic 3D Model Viewer

•

The system consists of

– the SIMDIS , the stereoscopic 3D model viewer, a plug-in to connect the viewer to the SIMDIS, and the Microsoft Kinect sensor 30/04/2020 4

View Manipulation by Gesture Interface

• The OpenSceneGraph(OSG) Manipulator – The OSG library controls the virtual scene using a manipulator – A manipulator consists of a camera for the user viewpoint and commands (e.g., translation, rotation and zoom) for camera movement that are controlled by the user through input devices – The OSG toolkit offers trackball, flight, drive, terrain, orbit 30/04/2020 and spherical manipulators • • offer different capabilities switch between them according to the characteristic of the virtual 5 scene

View Manipulation by Gesture Interface

• User Tracking Using the Kinect – dynamic gestures characterized by the spatial-temporal motion structures in frame sequences to discriminate between actions – provide an unambiguous method for specifying the start and end points of gestures, both in time and space, the gesture interface adopts the concept of an activation area 30/04/2020 6

View Manipulation by Gesture Interface

• Gesture Interaction for View Manipulation – RightHand ： Rotating – – LeftHand ： Panning TwoHands ： Zooming & Reset 30/04/2020 7

30/04/2020

Conclusions

• • The 3D gesture interface – control the view of the 3D model with hand gestures in real-time and without using special input devices Questions – the issue of rapid onset of fatigue remains a problem when using gesture interactions for precise control – – only four hand gesture interactions allows only a single user to manipulate the view 8

30/04/2020

Thanks for your listing.

9