Source: YouTube Screengrab
Although Augmented Reality (AR) and Virtual Reality (VR) for the masses were once considered science fiction. Today, this is changing as Mixed Reality (MR) is rapidly finding its way into the mainstream media, whether through social media, within the political landscape, or as a replacement for live entertainment. In recent weeks we’ve seen some incredible productions, like Travis Scott’s thrilling Fortnite astronomical concert which drew a live audience of 12.3 million players and Katy Perry’s American Idol Daises performance, with over 2 million YouTube views.
Source: YouTube Epic Games
Talk shows like The Late Show with Stephen Colbert and Ellen DeGeneres as well as news broadcasters have gone to impressive lengths to film from home. Last year there were twice as many movies being released compared to this period. We’re physical distancing and that has made remote productions the standard and slowed down new TV and movie productions.
YouTube — The Late Show with Stephen Colbert
The pandemic has driven us to be more creative in the way we create and distribute content. Tech companies are collaborating in new and interesting ways to bring audiences content that inspires and engages.
Remote MR collaboration
Volumetric video capture, a system that creates realistic 3D holograms, is gaining popularity as it provides productions with the ability to integrate authentic real-action talent and not just CG content.
1. Designing for a modern 3D world: A UX design guide for VR
2. Scripting Javascript Promise In Spark AR For Beginners
3. Build your first HoloLens 2 Application with Unity and MRTK 2.3.0
4. Virtual Reality: Do We Live In Our Brain’s Simulation Of The World?
While sheltering in place, four hi-tech companies, located in 2 continents, worked together to create a historical AR experience for Israel President Reuven Rivlin, that was accessible to anyone with a smart phone or tablet.
YouTube-TetaVi
Using TetaVi’s 4-camera volumetric capture system in Tel Aviv the Israeli president was documented and immortalized as a fully authentic 3D hologram. Nim Shapira, the creative director, was in the safety of his home in New York City, Omnivor and 8th Wall are based in California.
TetaVi’s Brooklyn-based Roi Lev talks about his role producing this major milestone in AR, remotely. “The situation made me rethink about how I went about preparing for the shoot day. Who could have imagined producing a live shoot while people are sitting in their homes around the world, connected in real time!? If anybody didn’t get the importance of virtual productions up until recently, it must be clear by now. Virtual productions involving volumetric capture are here to stay, and has changed the way we produce content.”
Source: TetaVi capture session during COVID-19
In other scenarios, TetaVi’s equipment is sent to the talent’s place and the studio or producer walks them through the set-up and process remotely. Depending on government guidelines, the system can adapt to the needs of the studio and the crew — though several people can be present in the capture studio, due to COVID-19 physical distancing, the filming crew can consist of one technician.
Bridging the gap
TetaVi hologram at CES2019 — integrating our digital content with our physical location
Even with the country starting to open up, a whopping 70% of consumers would rather play it safe and watch shows and movies from their home. Before COVID-19, we were asking the question how do we keep consumers engaged with our content. Now there is yet another layer of complexity — in addition to the technical aspect of remote filming, brands will need to reinvent themselves and figure out how to reach consumers.
Companies like TetaVi can help broadcast, brands, and live music performances transform, integrate and monetize their digital content with our physical environment in 2020 and beyond.
