Björk & Unity Team Up For First Live 3D Mocap Stream @ Björk Digital Exhibition
The Iceland singer Björk, who’d released one of the world’s first 360 music video for her hit single Stonemilker in 2015, has announced on her Facebook page today, just ahead of the September 1st European debut of the Björk Digital exhibit at Somerset House, the artist herself conducted the world’s first live motion capture streamed press conference.
“I am so excited to invite you all to björk digital exhibition at somerset house . we are showing the virtual reality videos from vulnicura on dozens of headsets and premiering in london some pleasant surprises …. this is a further step into completing the full vulnicura vr album which will come out soon. I feel the chronological narrative of the album is ideal for the private circus virtual reality is.” Said Björk
After previewing the new exhibit — an interactive, immersive VR experience that spans her career and portfolio of VR and films — press attendees engaged in a live Q&A with Björk, who was motion captured and rendered in real-time as an avatar via the Unity 3D engine.
Björk has long supported the convergence of music, art, and technology, embracing VR early as new medium and means for engaging fans. But, canned VR experiences just scratch the surface of the platform’s true potential. Today’s live motion capture stream, where Bjork heard, saw and responded to an audience in immediate, fluid render represents a major leap forward toward the near future where individuals can be placed at the center of real, live performances and entertainment experiences, from concerts to speeches and sports events, via VR.
Unity’s platform and 3D engine has been at the core of some of the earliest and best VR experiences to date, from Google’s Tilt Brush to BBC’s We Wait and the Ghostbusters: Dimension exhibit from The Void VR. For today’s presentation, Björk wore an XSens inertial motion capture suit in Reykjavik, from which the data was streamed to a computer running MotionBuilder in London. MotionBuilder was used to apply the mocap data to a skeleton, the bone transforms were then streamed into a character running in Unity to render and provide the final output. Check out the video from the Bjork’s page!