This is an example performance of what you can do with Ryan Challinor’s Synapse for Kinect tools combined with Ableton Live and Quartz Composer.

Synapse is an app for Mac and Windows that allows you to use your Kinect to control Ableton Live, Quartz Composer, Max/MSP/Jitter, and any other application that can receive OSC events. It sends joint positions and hit events via OSC, and also sends the depth image into Quartz Composer. This allows you to use your whole body as an instrument.

You can download Synapse for Kinect at Challinor’s site.

See the video below for an in-depth look at how this works.