FOVear, December 2014
The eye movements of the user are processed to work out where they are looking at any given time - where their attention lies. By looking at different coloured balls they are able to trigger different audio and video samples, which begin slowly and then increase to normal speed providing they continue to look at them, if they look away then the clips begin to slow down again. This acts as a game in which the viewer must look from one object to the other as fast as they can in order to keep the clips at a normal speed. This ability to switch our attention in such a dynamic way is a characteristic limited to vision. This system translates this unique characteristic into an audio experience, and, at the same time, provides a visualisation of this unfamiliar (and very subjective) experience of visual-auditory integration for the audience. |
|
|
In this way, the interaction of the user with the environment, and their body itself, becomes a channel for the experience of the audience. This suggests possibilities in terms of a shared sensory system for multiple bodies.
|