Transcript Whats New in Kinect for windows v2
Click to add title
in Kinect for
Intro
• Presenter: Dwight Goins – [email protected]
– http://dgoins.wordpress.com
• Agenda – Kinect v1 Introduction and Capabilities – Kinect v2 Introduction and Capabilities – Quick Difference Chart – Demos, Demos, Demos – Potential Usage – Call To Action – Q&A
Kinect for Windows v1
• Color Camera • IR Projector • IR Camera • Depth Camera • Tilt Motor • Microphone Array • SDK - Toolkit
Demos
• Body basics • Color basics • Depth • Speech • Interaction Controls
Kinect for Windows v2
• Color Camera • IR Projector • IR Camera • Depth Camera • Microphone Array • SDK
• Joints • Color • Depth • Audio • Kinect Studio
Demos
Feature Comparison Chart Feature
Color Camera Depth Camera Infra-Red (Spreads Dots) Infra-Red (TOF) Infra-Red Spectrum Max Depth Distance Min Depth Distance Microphone Array
K4W
640x480 @30 fps 320 x 240 Yes No ~827 - 850nm ~4.5M
40cm in near mode 4 mics 4 channels 16bit 16kHz
K4W v2
1920 x1080 @30 fps 512 x 424 No Yes ~827-850nm ~4.5M
50cm – 1cm (near mode)* 4 mics 4Channels 32bit 16kHz IEEE Float * Experimental firmware provided by K4W Team
Feature Comparison Chart Feature
Horizontal Field Of View Vertical Field of View Tilt Motor Body Joints Skeletons Tracked USB version Supported OS Price Types of Applications
K4W
57 degrees 43 degrees Yes 20 2 2 Win 7, Win 8 Desktop $299 Desktop, x86, x64, JavaScript, Web
K4W v2
70 degrees 60 degrees No 26 6 3.0
Win 8 $199 Desktop, x86, x64, Win 8 Store, JavaScript, Web
Programming The Kinect v2
• COM – C++ Powerful • .Net – C#/VB.Net Fast development • WinRT – C#/C++/JavaScript – Sources and Reader Pattern – Events – Collections
Programming The Kinect v2
• Data Sources – Infrared – Color – Depth – Body Index – Body – Audio
Programming The Kinect v2
• InfraRed – Two forms – Single frame or Long Exposure – Frame data 2 bytes per pixel – 16bit Intensity value
Programming The Kinect v2
• Color – Frames have multiple formats (RGBA, BGRA, YUY2) – Buffer is array of pixels • Pixel is multiple bytes per pixel depending on format
Programming The Kinect v2
• Depth – Frames 2 bytes per pixel: 16-bit values are distance in millimeters
Programming The Kinect v2
• Body Index – Frames 1 byte per pixel • Index of body as determined by body tracking
Programming The Kinect v2
• Body (Known as Skeleton in v1) – Frame array of Bodies • More joints
Programming The Kinect v2
• Body (Known as Skeleton in v1) • Hand states (open, closed, “lasso”) • Activities (eye closed, mouth opened, looking away) • Appearance (wearing glasses) • Level of user engagement • Facial expressions (Happy, neutral) • Lean direction (2D vector, “human joystick”)
Programming The Kinect v2
• Audio – Audio Beaming – Audio Body Correlation • Which bodies are in the path of a beam – Raw Frame is 32bit 4 channel IEEE Float per sample
Potential Usage
• Medical – Physical Therapy – Providing Sterile Operating Environments – Aiding Physically Challenged • Robotics • Marketing – Advertising – POS, Kiosk • Conferences
Custom Demos
• Raise Hand Demo – Source Code • Kinect Office Pack Plug-In • Heart Rate Sample
Call To Action
• • • • Kinect For Windows Blog/Forums Coding For Fun: Kinect • YouTube – Kinect Videos • Kinect Hackathon – June 21-22 in NYC Kinect Common Bridge v2 Pre-Order Device Now