Ever wonder what the New York Times would sound like translated into electronic music?
Hell no! But lucky for us, Bill Orcut did and created a Lily App that he controls with his Monome to “play” web pages:
When the patch starts, the browser enters a DOM inspection mode and mousing over a DOM element highlights the node. Clicking on a node writes the element’s data (its innerHTML value if it’s a text element or the binary data if it’s an image) as a sound file and the file is then loaded in a quicktime player in the patch. The sounds can then be triggered using OSC messages. While a DOM element is “playing”, the browser scrolls to and highlights the element with a thick black border.
In the video, I’m spazzing out on the NY Times homepage using the monome controller, but the demo should work with any OSC enabled controller. Sound conversion code based in part on a javascript port of the baudio project.
via Lily