Click to add title

in Kinect for

Intro

• Presenter: Dwight Goins – [email protected]

– http://dgoins.wordpress.com

• Agenda – Kinect v1 Introduction and Capabilities – Kinect v2 Introduction and Capabilities – Quick Difference Chart – Demos, Demos, Demos – Potential Usage – Call To Action – Q&A

Kinect for Windows v1

• Color Camera • IR Projector • IR Camera • Depth Camera • Tilt Motor • Microphone Array • SDK - Toolkit

Demos

• Body basics • Color basics • Depth • Speech • Interaction Controls

Kinect for Windows v2

• Color Camera • IR Projector • IR Camera • Depth Camera • Microphone Array • SDK

• Joints • Color • Depth • Audio • Kinect Studio

Demos

Feature Comparison Chart Feature

Color Camera Depth Camera Infra-Red (Spreads Dots) Infra-Red (TOF) Infra-Red Spectrum Max Depth Distance Min Depth Distance Microphone Array

K4W

640x480 @30 fps 320 x 240 Yes No ~827 - 850nm ~4.5M

40cm in near mode 4 mics 4 channels 16bit 16kHz

K4W v2

1920 x1080 @30 fps 512 x 424 No Yes ~827-850nm ~4.5M

50cm – 1cm (near mode)* 4 mics 4Channels 32bit 16kHz IEEE Float * Experimental firmware provided by K4W Team

Feature Comparison Chart Feature

Horizontal Field Of View Vertical Field of View Tilt Motor Body Joints Skeletons Tracked USB version Supported OS Price Types of Applications

K4W

57 degrees 43 degrees Yes 20 2 2 Win 7, Win 8 Desktop $299 Desktop, x86, x64, JavaScript, Web

K4W v2

70 degrees 60 degrees No 26 6 3.0

Win 8 $199 Desktop, x86, x64, Win 8 Store, JavaScript, Web

Programming The Kinect v2

• COM – C++ Powerful • .Net – C#/VB.Net Fast development • WinRT – C#/C++/JavaScript – Sources and Reader Pattern – Events – Collections

Programming The Kinect v2

• Data Sources – Infrared – Color – Depth – Body Index – Body – Audio

Programming The Kinect v2

• InfraRed – Two forms – Single frame or Long Exposure – Frame data 2 bytes per pixel – 16bit Intensity value

Programming The Kinect v2

• Color – Frames have multiple formats (RGBA, BGRA, YUY2) – Buffer is array of pixels • Pixel is multiple bytes per pixel depending on format

Programming The Kinect v2

• Depth – Frames 2 bytes per pixel: 16-bit values are distance in millimeters

Programming The Kinect v2

• Body Index – Frames 1 byte per pixel • Index of body as determined by body tracking

Programming The Kinect v2

• Body (Known as Skeleton in v1) – Frame array of Bodies • More joints

Programming The Kinect v2

• Body (Known as Skeleton in v1) • Hand states (open, closed, “lasso”) • Activities (eye closed, mouth opened, looking away) • Appearance (wearing glasses) • Level of user engagement • Facial expressions (Happy, neutral) • Lean direction (2D vector, “human joystick”)

Programming The Kinect v2

• Audio – Audio Beaming – Audio Body Correlation • Which bodies are in the path of a beam – Raw Frame is 32bit 4 channel IEEE Float per sample

Potential Usage

• Medical – Physical Therapy – Providing Sterile Operating Environments – Aiding Physically Challenged • Robotics • Marketing – Advertising – POS, Kiosk • Conferences

Custom Demos

• Raise Hand Demo – Source Code • Kinect Office Pack Plug-In • Heart Rate Sample

Call To Action

• • • • Kinect For Windows Blog/Forums Coding For Fun: Kinect • YouTube – Kinect Videos • Kinect Hackathon – June 21-22 in NYC Kinect Common Bridge v2 Pre-Order Device Now