This was an early camera input study for my Frame of the Mind project (requires a webcam).
The core of Soundprint is a program that analyzes camera input and translates areas of motion into points on an x/y coordinate system. These points are represented visually as colored dots and aurally as triggered sound samples. Periodically the visual characteristics of the rendered dots change slightly and the modal tonality of the sound samples shifts, offering a subtle variation in the experience.
My intention with the piece was to explore the potential for interactive, visual and aural elements to be experienced as a synchronistic, unified entity. The result seems to fall somewhere between a visualized instrument and an immersive “soundtoy” but offers an interesting foundation for further exploration.
Frame of the Mind reflects the way in which we fracture experience into discrete segments, disturbing the continuity of perception. In the piece fragments of video and audio are captured and re-output discordantly. An ominous drone persists behind the dissonance suggesting the unbroken flow of experience itself.
See this study to experience an early prototype of the camera input application.
