Augmented reality projection mapping on an NYC landmark using infrared tracking and openCV.
We undertook the challenge of “seeing” the infamous Alamo - a movable cube at Astor Place in NYC, and projection mapping to it. In order to do so, we designed a system which used a hacked PS3 eye camera and cleverly diffused magnetic infrared LEDs to “see” the cube at night. The idea was to track it with openCV, and then project onto each surface of the cube as it was rotated in real-time.
The most unique aspect of the project was the system I developed for diffusing the IR light. I discovered that styrofoam balls diffuse LED light extremely well, even with extremely directional superbright LEDs. Thanks to GRL for the LED Throwie precedent, which we modified slightly with this diffusion and IR light.