Research In Practice 01

My initial concept for RIP and Perf Tech involved a performer entering an enclosed, dark space. They would sit and any sounds they made would spatially be replicated in a visual form ahead of them on a wide angle screen. In effect like Kandinsky's colour as sound. I have spoken to Sean Clarke ( Cuttlefish ) 19/03/09 and Paul Jones ( Sound Tech ) 16/03/09. Both advised me on what problems i may encounter and how i could possibly overcome these. This was the initial exploration into feasibility.

Paul advised me that the audio interpretation in 3d space was extremly hard. He referred me to klipp av. Article written by Olafsson. This documents audiovisual events capturing. A time difference would need to be built in and perhaps ultra sonic sound microphones.

Jitter: frequency amplitude and cv.jit librar were discussed.

Paul also saw another issue - percussive, sharp attacks would work while overlapping, longer sounds would be impossible to differentiate.

A possible solution to simplify the project would be to work on a 2d slice, x/y axis, where the player remains on thias axis. 2d axis, fft analysis in jitter for sound extraction, sound locator to map on this plain, use co-ordinates to map spatially to visuals, visual fx using cv.jit.

Sean confirmed the spatial audio difficulty level. He recommended max/msp/jitter also and cv.jit library and also to work in a 2d axis. In addition to the above Sean suggested working on a more simplified concept.