This is a video showing a prototype of the Lumièrophone, a screen with embedded sensors that create sound in real time based on what is projected on it.

This demo shows it in action using the Walter Ruttman films Opus I and II.