Augmented reality projection mapping on an NYC landmark using infrared tracking and openCV.
For my final project in Zach Lieberman's openFrameworks course, setPixel, I worked on a computer vision and projection mapping project for public space with Joon Moon and Clay Ewing.
We undertook the challenge of “seeing” the infamous Alamo - a movable cube at Astor Place in NYC, and projection mapping to it. In order to do so, we designed a system which used a hacked PS3 eye camera and cleverly diffused magnetic infrared LEDs to “see” the cube at night. The idea was to track it with openCV, and then project onto each surface of the cube as it was rotated in real-time.
The most unique aspect of the project was the system I developed for diffusing the IR light. I discovered that styrofoam balls diffuse LED light extremely well, even with extremely directional superbright LEDs. Thanks to GRL for the LED Throwie precedent, which we modified slightly with this diffusion and IR light.
ROLE
Concept, Software, Production
TEAM
Joon Moon, Clay Ewing, Jen Cotton
TECH
openFrameworks/C++, Custom Infrared Trackers, OpenCV
PRESS
Hackaday
YEAR
2009