Ben Halsall & Dave Lynch have embarked on a collaboration where by they communicate through software MaxMSP/Jitter & VVV.
We will be placing a series of data capture devices around the gallery that will be activated by visitors. These cameras and microphones will pick up the movement and sound generating a unique composition from live and pre-recorded video and sound that will be generated live over the course of the exhibition.
By looking at sensory engagement through motion tracking technology investigating audible and visual stimulation through movement. The audio-visual output is simulated by the viewer using their body as a wireless wizard to control time, space and their perception of reality. This output is recorded by a seperate AV device (camera) for archiving purposes.
As these cameras will be recording what is happening within the gallery they will be engaging fully with other activities that are taking place during the arts festival. We hope that by offering an interactive installation that this will work well alongside other proposals.
The final form that this installation will take is as yet unclear. We will be experimenting with different possibilities for compositing the sound and video via Max/MSP & VVVV and are keen to develop different ways in which people can interact with on screen projection.
Some of the possibilities that we are considering for this and future projects are the following: -
Re-constructing a 3 dimensional space with live video & sound.
Recording sound and relaying it to another computer - allowing the computers to form a conversation with each other as well as with the viewer.
Pausing and re-winding video or animation recorded inside the space.
Using image detection to allow users to interact with the installation e.g. providing a grid in which users could place themselves or an object which would in turn trigger the sound or video to change.
Equipment required: -
2 x web-cameras
2 x projectors
1 x back projection screen
VVV - http://vvvv.meso.net/tiki-index.php
Max/MSP & Jitter - http://www.cycling74.com/