Sonification Experiments

A scanline moves across the moving image and the pixel values drive banks of tuned oscillators. Signal values are used to drive brightness/contrast/saturation parameters on the video feed. Effect chains on the oscillator banks are likewise altered by the parameters of the sound, which feeds back into the video.

the excellent bathouse fight scene from the Sonny Chiba classic Return of the Street Fighter sonified to a Sarang Raga in F using Max/MSP/Jitter.
everything that’s not obviously a drum is a sonified video of a painting by Eben Bender. Sonification in Max/MSP/Jitter, drums, mixing etc. in Ableton
everything that is not a drum is video of a rag rug some of the drums are logs, some of them are seaweed

Cultivate 2019 – Show report, part 2

After the cookies were baked and the rants were ranted it was time to tear down and relocate to the projection site.

From 9 to midnight I manipulated field recordings taken from various locations around the island – including recordings of the Quinsam, a trip to the grocery store, and a trio of pileated woodpeckers foraging in my yard.

The audio was accompanied by video generated by a Jitter patch I wrote. The patch takes the audio and uses it to generate colour information and deform some simple geometry.