Blue Skies and Yellow Fields

CROSSROADS

Painter Teresa Parod and Composer and Software Developer Bill Parod have been collaborating on multi-media public art. Their work combines garage-door mural paintings with situated 3D sound art using a custom Augmented Reality app for mobile phones. Some video captures of these are shown below. 

Crossroads is a new project to bring this approach into a gallery setting. Crossroads combines a group of Teresa's paintings with Bill's associated 3D sound art, cast into a multichannel gallery space. A proof-of-concept for the spatial audio on visual art was achieved using augmented reality on the large public murals (shown below).  A proof-of-concept for image-triggered spatial audio in a multichannel speaker array was recently achieved in the 16-channel 10x10 sq. meter space at Elastic Arts, Chicago. A finished piece for gallery exhibition is anticipated Spring 2023.

The paintings in the Crossroads exhibit will combine a collection of bird panels from the murals and a collection of oil paintings that portray different notions of a crossroads. Each of the paintings contribute groups of 3D audio characters to the gallery space when activated by viewers, using an AR mobile app. The audio includes animal and musical characters that interact in the 3D space forming an interplay of visual, aural, and viewer/listener participation. 

The AR app is built using the Unity Game Engine, sending OSC messages of audio characters' sound file and position information to a central computer running Max/MSP/Spat5 for multichannel 3D dispersion in the gallery space. Dolby Atmos object-based dispersion will also be explored for commodity audio in smaller galleries.

 

Bird calls from "Midwestern Birds" and musical characters from "Centet" (Ircam Forum @ NYU) will be the primary voices in the piece.

Midwestern Birds by Teresa Parod

This A/R scene is over “Midwestern Birds”, a mural named for content chosen by the owners of the garage. The bird sound and model are from the "Temperate Forest" model described in "Earful | Ecologies

Trianon by Teresa Parod

This A/R scene is over “Trianon”, a mural named for a cafe in Alexandria, Egypt and reminiscent of one in New Orleans. Crowd sounds, passing motorbikes, restaurant sounds of plates and cutlery and New Orleans music are part of the soundtrack. The music was recorded in a Bywater vacant lot after an unofficial parade in New Orleans during Carnival season. The combination of its "New Orleans Sound" and Arabic scales makes it a perfect music for this New Orleans / Alexandria mural.  If anyone recognizes or participated in the music, please contact me. I would love to seek your permission and know who to credit. 

Solar System by Teresa Parod

The owners of this garage wanted a space theme and liked the proposed image. The A/R was looking for a universal message and it is translated here into 8 languages by Google Translate and spoken in various voices from AWS Poly.

Bali by Teresa Parod

This mural patron wanted a scene with palms.  The mural, "Bali" by Teresa Parod depicts a Balinese landscape. The soundscape is made from various sounds recorded in Bali, including geckos, motorbikes, cremation procession, and bats.

Slides from Unity for Spatial Audio Architecture Talk