Tuesday, January 19, 2010

Prototype v 2

Using web cameras to capture users' hand gestures lead to many glitches. Ambient light apart from the Infrared LEDs caused the reference point to jump around causing the virtual camera within the 3D applet to move haphazardly.

To overcome the glitch I have resorted to using two Wii remotes much like web cameras to capture users' hand gestures. A tracking algorithm was not needed to be implemented as the Wiimote comes with blob tracking.

Wiimotes talk to the PC via bluetooth radio operating on the Toshiba stack. With the help of Brian Peek's managed library for the Wiimote, I am able to get the Wiimotes to communicate with a VB.Net application that uses Microsoft's XNA to render a simple 3D world.

Code for the Arduino still remains in C++ but VB.Net is able to communicate with the microcontroller via a serial port.

A demo of the applet will be up soon.

No comments:

Post a Comment