Created 2013:
The project sees Arduino/Electronics, CSound & Jitter come together creating an audiovisual system to perform with. It enables live video manipulation and live control of CSound synthesis. We created a simple hand held box that contained two buttons, an accelerometer and an Arduino microcontroller. This gave us control over what was heard and seen i.e. the buttons could toggle through different states while tilting the boxed changed specific values in each selected state. We used referenced video loops to manipulate the visuals in Max MSP, we, however, created all the audio components ourselves within CSound through coding. This included the bass, kick and snare you can hear in the demo. How these sounds are triggered is determined within Max MSP based on the gating system I created to filter signals from the Arduino. The videos below give further explanation and you can click here to read our NIME style paper.
Our end product had the ability to:
- Send sensor data from Arduino into Max MSP.
- Enable the manipulation and control of audio and video using sensors through mapping techniques.
- Run CSound in real-time via the Max MSP csound~ object. Audio material for CSOUND:
- Manipulate video loops within our Jitter patch.
Schematic Route
Explanation and Demonstration:
Screenshots:
Max Patch 1
Max Patch 2
Max Patch 4
Max Patch 3
CSound Segment
Stuart Creates 