Gesture Controlling Dubstep Wobbles – Jan 2011

Custom software was written to detect arm gestures with an Xbox Kinect and translate them into dubstep wobbles.

The Xbox Kinect uses a grid of infrared lasers to detect objects in 3D space. At the time, APIs did not exist to communicate with the Kinect, and hackers had only recently reverse engineered a way to tap into the Kinect’s data and written libraries for detecting and tracking humans. The code for this experiment was based on a set of Openframeworks modules.

Encanti wrote an Ableton Live patch for us to control with the gesture controller which we demonstrated at the Boston Ableton Live Users Group.