Interactive Cubes – UXCS, Microsoft

Spring 2012.
Student Project with the User Experience and Creative Services team at Microsoft
Platform: Unity3D, Microsoft Kinect, OpenCV
My role: Programmer

This student project titled ‘Wall#’ involved the design and development of an interactive prototype intended to be installed at the Microsoft Store-front. The installation featured multi-planar projection mapping and interaction via the Microsoft Kinect.



The team of 7 spent 3 months with the UXCS team on site at Redmond, Washington and was charged with conceptualizing, designing and implementing the concept. My role involved working on implementing the homographic transform for distorting the video to map it to the physical contours of the cubes.

I wrote a couple of shaders and a UI within Unity3d to enable dynamic mapping of the content to calibrate the camera. The final version of the prototype, however, used an alternative method employing OpenCV for homography.


The Team:

Dev Ghai : Producer
Jason Hsu : Programmer
Chu Hsawn Kuang : Programmer
Nan Jia : Programmer
Chirag Raman : Programmer
Jaewan Park : 3D Artist, Animator
Eren Song : Graphic Designer