software / live audio-visual media or virtual reality
Program Notes:
Audiovisual Alchemy (2016-17) is a novel method of procedurally generating music and abstract animation with applications for virtual and augmented reality games. It was initially developed as an interactive, multi-modal environment for improvising audiovisual experiences within the context of electroacoustic concert music. Audiovisual Alchemy combines techniques and theories from procedural pattern generation, spatial audio, and musical cognitive science to viscerally induce the experience of the technological sublime in users and audience members.Concerning specific techniques, cellular automata are used in Audiovisual Alchemy to activate an array of sound- and light-producing modules within an explorable, virtual 3D space, rendered within a game engine. In essence, the cellular automata “play” the array of modules as if the array was an instrument. The spatial arrangement of these modules effects the potential musical pitches available to the listener at any moment, through the use of spatial audio techniques. Utilizing musical cognitive science, various arrangements of modules can be generated, enabling anything from consonant, traditional harmonies, to dissonant or even microtonal harmonies. The harmonic and melodic content produced by Audiovisual Alchemy is an emergent feature the activity of the cellular automata, the spatial arrangement of modules, and the guidance of the user.
Read the whitepaper in the Proceedings of 2016 GameSoundCon Research Track
Performance History:
Nov. 16, 2017
Sam Wells & Paul Hembree - Dept. of Electronic Music
Bard College, NY
Premiere: Sept. 23, 2017
Mise-En Place Bushwick Open Studios
Brooklyn, NY
Preview: Sept. 27-28, 2016
GameSoundCon - Research Track
Millennium Biltmore Hotel - Los Angeles, CA
Video