This software reinterprets the idea of a sequencer. By using a camera to capture the average colour and available light of a scene, the role of filter and effects sliders and dials are replaced allowing colour and light to alter the timbre of the produced sounds. The application presents a grid of six rows of eight columns of clickable pads, with each row representing a single instrument.
The colours that appear on each pad are the average colours captured via the video source. The timbre of the sounds can be changed during playback by placing different colours and saturations in front of the video camera. This manipulates various variables that affect the speed of the oscillators, or the values of the ASDR envelope to create constantly changing unique sounds.
There are a two major parts to this program: audio synthesis and video image analysis. For the audio synthesis I use the new UGen framework found in the Minim audio library. This class provides a range of sound generators, envelopes and effects which can be used to create instruments. All of the sounds in this program start with a simple square or sine wave, filters and envelopes are then manipulated by the live video. The video image analysis part of this program captures video from a camera, analysed with the resulting average hue, saturation and brightness information used to manipulate the audio.
Technologies used: Processing, Minim