Hi, my name is Charley Ho
and I’m Daniel Robbins,
and we are TriClops Labs, and we are here to talk about our in-progress product for the Kinect, head-tracking 3d video chat.
First off, let me explain what I mean by 3d head tracking, just in case you don’t know. Head tracking uses computer vision software to track the position of a person's head in real time. Normally, a computer screen displays the same image, no matter what angle you look at it. However, using 3d head tracking, we can change the image on the screen based on the angle at which the user looks at the screen. By matching the perspective of the user's head, the screen becomes like a "virtual window" into another world. This allows the user to perceive depth, like with 3d glasses, but in a more interactive fashion.
(show head tracking video)

By combining the head positon data we have, with kinect sensor received point cloud data, we can simulate this head tracking effect, with live kinect video.

(show kinect moving in a 3d space)
Over the last few days, we have developed this prototype to show a proof of concept for this idea.  Our current setup has the kinect getting point cloud data, live.  At the same time, we have our webcam running a face detection algorithm, to determine head position.  Here, we will show how this robots arm is clearly 3d, and is moving relative to where our head is.  when the camera is placed next to our head, you can see how it seems to almost reach out to the screen.

I do need to reiterate though, that this is a very early proof of concept prototype, and has a great deal of improvement ahead.

We intend to use this system, for 3d video chat.  We will be developing this as a application for both the xbox and the computer, so that users can seamlessly communicate.  Because the kinect has such a large existing user base, and does not require expensive and unwieldy hardware like 3d TVs with goggles, we believe that this innovative communication system will become a “killer app” for the Kinect on both Xbox and PC.