VR-Together

VR-Together

VR-Together

Social VR experiences

Project Info

Start date:
October 2017

End date:
September 2020

Funding:
EU H2020

Coordinator:
Fundació i2CAT

Website:
http://vrtogether.eu/

Summary

VR-Together offers new ground-breaking virtual reality (VR) experiences based on social photorealistic immersive content. For this purpose, this project develops and assembles an end-to-end pipeline integrating state-of-the-art technologies and off-the-shelf components. The challenge of VR-Together is to create photorealistic truly social VR experiences in a cost effective manner. Immersive media production and delivery through innovative capture, encoding, delivery and rendering technologies. The project will demonstrate the scalability of its approach for production and delivery of immersive content across 3 pilots. It will introduce new methods for social VR evaluation and quantitative platform benchmarking for both live and interactive content production, thus providing production and delivery solutions with significant commercial value.

In this project, Artanim works on content production for the 3 pilots combining VR and offline/real time motion capture and develops new tools for immersive media production. We also participate in the evaluation of the developed social VR experiences.

Partners

Fundació i2CAT (Spain)

Nederlandse Organisatie voor toegepast-natuurwetenschappelijk Onderzoek (The Netherlands)

Centrum Wiskunde & Informatica (The Netherlands)

Centre for Research & Technology Hellas (Greece)

Viaccess-Orca (France)

Entropy (Spain)

Motion Spell (France)

Artanim

Real Virtuality

Real Virtuality

Real Virtuality

Immersive platform

Project Info

Start date:
April 2015

End date:
August 2019

Funding:

Coordinator:
Artanim

Summary

The objective of this project is to develop a multi-user immersive platform combining a 3D environment – which can be seen and heard through a virtual reality (VR) headset – with a real life stage set. Users are tracked by a motion capture system allowing them to see their own bodies, move physically in the virtual environment and interact with physical objects.

The solution developed tackles the following technical challenges: 1) we generate a full body animation using inverse kinematics from a minimal number of markers to keep the user’s setup time as short as possible, while ensuring a good tracking accuracy; 2) the platform is multi-user and the VR headset interfaces wirelessly with the motion capture system; 3) the interaction with the objects is flawless and retargeted correctly; 4) the position and orientation of the user’s head is adequately handled to minimize latency (which would result in possible discomfort with the VR headset) and to maximize positioning accuracy.

This platform can be used in numerous applications, such as for virtual visits (e.g., long lost historical sites, architectural places, telepresence), entertainment (e.g., games, theme-park attractions, story-telling experiences) or medical projects (e.g., phobia treatment, rehabilitation). Our solution offers a “matrix-like” degree of immersion over a large area, up to hundreds of square meters.

Download the white paper here.

This platform is commercialized by Dreamscape Immersive. More information here.

Related Publications

Chagué S, Charbonnier C. Real Virtuality: A Multi-User Immersive Platform Connecting Real and Virtual Worlds, VRIC 2016 Virtual Reality International Conference – Laval Virtual, Laval, France, ACM New York, NY, USA, March 2016.
PDF

Chagué S, Charbonnier C. Digital Cloning for an Increased Feeling of Presence in Collaborative Virtual Reality Environments, Proc. of 6th Int. Conf. on 3D Body Scanning Technologies, Lugano, Switzerland, October 2015.
PDF

HoloMed

HoloMed

HoloMed

AR tools for medicine

Project Info

Start date:
September 2016

End date:
February 2018

Funding:
La Tour Hospital / Hirslanden Clinique La Colline

Coordinator:
Artanim

Summary

In medicine, augmented reality (AR) technology can offer added value over traditional education, assessment and interventional approaches. By combining our expertise in motion capture, 3D anatomical modelling and AR technology, new solutions can be proposed to improve medical treatment.

In this project, we develop an anatomical see-through tool to visualize and analyze patient’s anatomy in real time and in motion for applications in sports medicine and rehabilitation. This tool will allow healthcare professionals to visualize joint kinematics, where the bones are accurately rendered as a holographic overlay on the subject (like an X-ray vision) and in real-time as the subject performs the movement.

Partners

Artanim
Development of AR solutions

La Tour Hospital – Division of Orthopedic and Trauma Surgery
Clinical tests

Hirslanden Clinique La Colline – Division of Orthopedic and Trauma Surgery
Clinical tests

Related Publications

Galvan Debarba H, Elias de Oliveira M, Lädermann A, Chagué S, Charbonnier C. Augmented Reality Visualization of Joint Movements for Rehabilitation and Sports Medicine, 20th Symposium on Virtual and Augmented Reality (SVR), Foz Do Iguaçu, Brazil, October 2018.
PDF

Galvan Debarba H, Elias de Oliveira M, Lädermann A, Chagué S, Charbonnier C. Augmented Reality Visualization of Joint Movements for Physical Examination and Rehabilitation, Proc. 2018 IEEE Virtual Reality, IEEE Comput. Soc, March 2018.
PDF

Galvan Debarba H, Elias de Oliveira M, Lädermann A, Chagué S, Charbonnier C. Tracking a Consumer HMD with a Third Party Motion Capture System, Proc. 2018 IEEE Virtual Reality, IEEE Comput. Soc, March 2018.
PDF

Elias de Oliveira M, Galvan Debarba H, Lädermann A, Chagué S, Charbonnier C. Development of a Hand-Eye Calibration Method for Augmented Reality Applied to Computer-Assisted Orthopedic Surgery, 32nd International Congress of Computer Assisted Radiology and Surgery, Heidelberg, Germany, Int J CARS, June 2018.
PDF

Here you can create the content that will be used within the module.

Taylormatic

Taylormatic

Taylormatic

A multi-platform solution

Project Info

Start date:
December 2012

End date:
October 2014

Funding:
NoBrandSolution

Coordinator:
NoBrandSolution

Website:
http://www.nobrandsolution.com/

Summary

The goal of this project is to provide a multi-platform product presentation and customization solution. The Taylormatic platform allows designers and producers to present their customizable products in a virtual yet visually realistic manner to potential clients, allowing them to manufacture products as required. At the same time it provides users with the freedom to configure products to their liking, while presenting them with a visually convincing result.

As part of this project, we worked on the research and development of a Kinect-based gesture recognition solution, as well as a multi-Kinect body scanning solution. The body scanner allows for the accurate size-estimation of fully dressed customers, for products where a size recommendation needs to be made.

Taking into account the full 3D asset production pipeline from initial design to final 3D content, we furthermore designed and developed asset management plugins for Unity which allow for the management and export of 3D assets and their meta data. Based on this data, the applications we developed ranging from a full in-store virtual mirror to optimized iOS and Android solutions, can be fully customized to support a wide variety of product types and visual identities.

Partners

NoBrandSolution
Concept creation, commercialization, asset design and creation

Artanim
Body scanning solution, gesture recognition, application development and asset management