Objects augmented with virtual reality create a hybrid musical experience in Out There – San Francisco Chronicle

Out There is an augmented reality animated short with a musical score by Bay Area-based Pollen Music Group. Photo: Wilkins-Avenue

The virtual reality revolution is being led by little girls.

The latest cutting-edge project by Pollen Music Group, Out There, is an augmented-reality animated short film about a shut-in girl who escapes her room through the power of her unleashed imagination. Making its U.S. premiere Thursday-Sunday, March 5-8, at San Joses Cinequest Film & Creativity Festival, Thibault Mathieus mini-musical features San Francisco songwriter Rachel Garlins score and vocals by Emmy- and Grammy Award-nominated Vanessa Williams and Berkeley teenager Mia Harte. But its the spatialized sound design by the San Francisco music and sound design collective that makes the piece the latest example of whats on the next virtual and sonic frontier.

The work in progress premiered in October at Comic Con Paris, where Pollen built a set for Out There that served as a vessel for the experience. Theyve expanded the score for Cinequest with In There, an introductory Garlin song, because in Paris we found that people wanted more context, says composer Alexis Harte, Pollens creative director. For some people its the first time theyve put on any AR/VR gear, and they spend the first minute just getting comfortable.

6 events not to miss at 2020 Cinequest film festival

Part of Cinequests extensive VR programming, this version of Out There also unfolds within a set in the Kaleid Gallery that includes physical objects built into the score. The feedback that Pollen garners from all-access pass holders, who can sign up for a slot on line instead of waiting in line, will likely lead to further tweaks when Out There returns to Silicon Valley in May for the spatial computing conference AWE in Santa Clara.

Rather than conjuring an entirely virtual realm with goggles and a headset, Out There unfolds in augmented reality, so that half of what youre seeing is actually there, explains producer, engineer and musician JJ Wiesler, one of Pollens three founding partners.

Some elements are real, and theres sound emanating from some things in the room. But its mostly a virtual audio experience, so as you move around, the sound behaves as if its emanating from a real object. We found a vintage gramophone, and when youre staring at it, the song will be spatialized and mixed to sound like its coming out of it.

What makes Pollen-ated projects so potent is that VR and AR are tools used to tell a story, rather than being the main attraction. The company gained international attention in 2017 when the animated short Pearl became the first VR film ever nominated for an Academy Award. Set to a poignant, acoustic-guitar driven score by Harte, the Patrick Osborne-directed piece tells the story of young Sara as she travels across the decades on an immersive visual and sonic road trip, accompanied by her father and various friends she gathers along the way.

Beyond the Oscar nomination, the Emmy Award, the Annie and the Peabody, theres no better measure of Pearls singular accomplishment than its ability to melt even the most iron-hardened hearts.Pollens third founding partner, composer and sound designer Scot Stafford, was in Los Angeles to consult with writers for The Simpsons on VR shortly after Google Spotlight Stories and Evil Eye Pictures released Pearl in 2016.

They had no interest in VR, Stafford recalls. They just wanted to make fun of it in the opening couch gag for the 600th episode, which was good, because VR needed to be made fun of. But in the writers room, Jim Brooks looked over and said, I saw Pearl, and I wept.

What started as a minute-long couch gag riff on VR spoofing Planet of the Apes turned into a veritable three-minute concerto of satire.

Its no coincidence that Brooks, the producer of The Simpsons, is the father of daughters, as are the three Pollen founders. But thats not to say the Pollen partners work only on girl-centric pieces while straining against technologys tether. The company is in the midst of scoring, sound designing and mixing a 30-episode Netflix childrens series, Trash Truck, which starts airing in November. Its a traditional 2-D animated production about a 6-year-old boys adventures with his best buddy, the titular sanitation vehicle, executive produced by Academy Award-winning Disney animation maestro Glen Keane (The Little Mermaid, Aladdin, Beauty and the Beast).

But Pollens reputation is built on fearlessly plunging into pioneering projects using technology in the process of being invented. VR and AR encourages viewers to seize control of the directors traditional purview, the picture frame. That means sound takes on even more importance as both a narrative guide and a tool for orienting audiences in space.

Held together by Garlins songwriting craft, Out There pushes the boundaries of whats possible with sound, so we do something and wait for it to be debugged, Wiesler says.

The same process happened with Pearl too, though now people are calling that traditional VR. Were trying to get the technology to fulfill a creative idea while working in tandem, half with software developers and half as songwriters.

The end results are enthralling for kids of any age.

Out There: Noon-6 p.m. Thursday-Sunday, March 5-8. Kaleid Gallery, 320 S. First St., San Jose. Requires Cinequest all-access pass. 408-995-5033. http://www.cinequest.org/hyper-reality

6 events not to miss at 2020 Cinequest film festival

Pixars best deep cuts on Disney Plus are short and sweet

Pixars Oscar-nominated Kitbull is a love letter to San Francisco

Oscars 2020: Pixar wins for Toy Story 4

Read more:

Objects augmented with virtual reality create a hybrid musical experience in Out There - San Francisco Chronicle

Related Posts

Comments are closed.