HoloMed

HoloMed

HoloMed

AR tools for medicine

Project Info

Start date:
September 2016

End date:
February 2018

Funding:
La Tour Hospital / Hirslanden Clinique La Colline

Coordinator:
Artanim

Summary

In medicine, augmented reality (AR) technology can offer added value over traditional education, assessment and interventional approaches. By combining our expertise in motion capture, 3D anatomical modelling and AR technology, new solutions can be proposed to improve medical treatment.

In this project, we developed an anatomical see-through tool to visualize and analyze patient’s anatomy in real time and in motion for applications in sports medicine and rehabilitation. This tool allows healthcare professionals to visualize joint kinematics, where the bones are accurately rendered as a holographic overlay on the subject (like an X-ray vision) and in real-time as the subject performs the movement.

Partners

Artanim
Development of AR solutions

La Tour Hospital – Division of Orthopedic and Trauma Surgery
Clinical tests

Hirslanden Clinique La Colline – Division of Orthopedic and Trauma Surgery
Clinical tests

Related Publications

Elias de Oliveira M, Galvan Debarba H, Lädermann A, Chagué S, Charbonnier C. A Hand-Eye Calibration Method for Augmented Reality Applied to Computer-Assisted Orthopedic Surgery, Int J Med Robot Comput Assist Surg, 15(2):e1969, 2019.
PDF

Elias de Oliveira M, Galvan Debarba H, Lädermann A, Chagué S, Charbonnier C. Réalité augmentée en chirurgie orthopédique. Mythe ou réalité ?, Congrès de la Société Francophone d’Arthroscopie 2018, Paris, France, Revue de chirurgie orthopédique et traumatologique, 104(8):S110, November 2018.
PDF

Galvan Debarba H, Elias de Oliveira M, Lädermann A, Chagué S, Charbonnier C. Augmented Reality Visualization of Joint Movements for Rehabilitation and Sports Medicine, 20th Symposium on Virtual and Augmented Reality (SVR), Foz Do Iguaçu, Brazil, October 2018.
PDF

Galvan Debarba H, Elias de Oliveira M, Lädermann A, Chagué S, Charbonnier C. Augmented Reality Visualization of Joint Movements for Physical Examination and Rehabilitation, Proc. 2018 IEEE Virtual Reality, IEEE Comput. Soc, March 2018.
PDF

Galvan Debarba H, Elias de Oliveira M, Lädermann A, Chagué S, Charbonnier C. Tracking a Consumer HMD with a Third Party Motion Capture System, Proc. 2018 IEEE Virtual Reality, IEEE Comput. Soc, March 2018.
PDF

Elias de Oliveira M, Galvan Debarba H, Lädermann A, Chagué S, Charbonnier C. Development of a Hand-Eye Calibration Method for Augmented Reality Applied to Computer-Assisted Orthopedic Surgery, 32nd International Congress of Computer Assisted Radiology and Surgery, Heidelberg, Germany, Int J CARS, June 2018.
PDF

Taylormatic

Taylormatic

Taylormatic

A multi-platform solution

Project Info

Start date:
December 2012

End date:
October 2014

Funding:
NoBrandSolution

Coordinator:
NoBrandSolution 

Summary

The goal of this project was to provide a multi-platform product presentation and customization solution. The Taylormatic platform allows designers and producers to present their customizable products in a virtual yet visually realistic manner to potential clients, allowing them to manufacture products as required. At the same time it provides users with the freedom to configure products to their liking, while presenting them with a visually convincing result.

As part of this project, we worked on the research and development of a Kinect-based gesture recognition solution, as well as a multi-Kinect body scanning solution. The body scanner allows for the accurate size-estimation of fully dressed customers, for products where a size recommendation needs to be made.

Taking into account the full 3D asset production pipeline from initial design to final 3D content, we furthermore designed and developed asset management plugins for Unity which allow for the management and export of 3D assets and their meta data. Based on this data, the applications we developed ranging from a full in-store virtual mirror to optimized iOS and Android solutions, can be fully customized to support a wide variety of product types and visual identities.

Partners

NoBrandSolution
Concept creation, commercialization, asset design and creation

Artanim
Body scanning solution, gesture recognition, application development and asset management