VOLUMETRIC CAPTURE TECHNOLOGIES FOR INTERACTIVE NARRATIVES

Submitted on 18/10/2022

The world of animation, the art of visually moving motionless objects, has come a long way since the first animated films were produced over 100 years ago. Today, avatars have become omnipresent. These digital representations of real humans have entered the scene in modern video games, and are now being used in movies as well as in virtual and augmented reality entertainment.

In the VirtUS team, Marc Christie, Associate professor at the Université de Rennes 1, coordinates the European project INVICTUS*, which aims to create avatars for video games, films and virtual and augmented reality productions

Given the huge market for avatar-based digital entertainment, the Horizon 2020 INVICTUS project (Grant Agreement number 952147) is working to develop digital design tools based on volumetric capture. Its goal is to help authors capture actors' performances in 3D, by capturing their movements and facial expressions, to create realistic digital avatars that can be modified and adapted to narrative needs, reducing manual adjustment work, speeding up development and stimulating innovation, all at reduced costs.

To achieve this goal, the INVICTUS project proposes to exploit recent volumetric motion capture technologies, consisting of simultaneously capturing the appearance (shape and texture) and movement of actors using multiple cameras to make increasingly realistic volumetric avatars using deep learning techniques.

Image
Démonstration et visiteurs lors de la présenttaion du projet

In order to discuss the results achieved so far and demonstrate the technologies emerged from the project, the project partners gathered in Rennes on October 5th and 6th. The event was a unique opportunity for twenty scientists, researchers and engineers to discuss the project research results, while testing the INVICTUS technologies:

  • VR authoring tool for storytelling – VRtist
  • Gepeto tool for capturing and editing high-fidelity avatars
  • Volu app to capture, play and share volograms

This is a research project funded by the European Union under the ‘Horizon 2020 Research and Innovation’ program involving Université de Rennes 1, InterDigital (France), Fraunhofer Heinrich Hertz Institute HHI (Germany), and Volograms (Ireland). To evaluate the project technologies, INVICTUS has established collaboration with Dada! Animation, 3D real-time animation studio.

The project generates new perspectives, demonstrating and communicating how these technologies can be immediately exploited in traditional (film/animation) and emerging media. It unlocks opportunities in the European market for more compelling, immersive and customized virtual experiences at the intersection of film and games. To disseminate the current results, the project has taken part in many relevant events such as: 3DV, IBC, Annecy International Film Festival, FMX, Laval Virtual...

 


Image
projet européen INVICTUS

The European project INVICTUS aims to create avatars for video games, films and virtual and augmented reality productions. It is coordinated by Université de Rennes 1 and implemented within the VirtUS Team at IRISA by Associated Professor Marc Christie.

To learn more about the project: