XRay

XRay

by | Jun 25, 2026

XRay

An AR testbed combining real-time markerless motion capture with in-situ movement visualization.

Project Info

Start date

June 2026

End date

–

Funding

Artanim

Coordinator

Artanim

Back to Projects

Summary

Beyond entertainment, motion capture has become a valuable tool in fields such as sports science, robotics, ergonomics and healthcare. In clinical settings, however, marker-based motion capture can remain cumbersome: preparing a patient with markers takes time and may limit its practical use for routine assessment.

This is where real-time markerless motion capture offers significant advantages. Patients can be tracked with minimal preparation and, in many cases, in their everyday clothing, making movement assessment faster and easier to integrate into clinical workflows.

XRay explores how this motion data can be visualized directly in the examination space rather than only displayed on a conventional monitor. The project develops an augmented reality application that combines the video passthrough capabilities of modern XR headsets with real-time markerless tracking of one or more subjects, overlaying the reconstructed skeleton directly onto the live view of the patient.

Building on ideas first explored in the earlier HoloMed project, XRay takes advantage of recent advances in markerless motion capture, XR hardware and real-time visualization to investigate new approaches to movement assessment.

The application allows users to select relevant joints directly in space and visualize parameters such as joint angles and movement trajectories in real time. These tools can support the observation of specific regions of interest, for example during physical rehabilitation or functional movement assessment.

Throughout the project, Artanim is expanding the available visualization and analysis tools to investigate how the combination of markerless motion capture and augmented reality can support healthcare applications, with particular attention to education, evaluation and rehabilitation.

MoRehab XR

MoRehab XR

by | Oct 3, 2021

MoRehab XR

A motion-tracked rehabilitation platform combining immersive exergames with objective movement assessment.

Project Info

Start date

August 2020

End date

2030 (expected)

Funding

Artanim & FORE Foundation / La Tour Hospital

Coordinator

Artanim

Back to Projects

Summary

After stabilization surgery or a traumatic injury, physical rehabilitation is often required to restore joint function. Successful recovery depends on regular and repetitive training, but maintaining patient motivation over time can be challenging. Conventional rehabilitation can also make it difficult to objectively measure small improvements or identify a lack of progress.

MoRehab XR explores how the engaging qualities of video games can support rehabilitation through a series of exercise-based games, or exergames. Patients progress through the games by performing movements that form part of their rehabilitation program.

Using motion tracking, the platform objectively monitors recovery from session to session, adapts exercises to each patient’s abilities and needs, and helps identify persistent difficulties or insufficient progress. The resulting data also provides clinicians with quantitative information that is not readily available during conventional physical therapy.

Artanim develops the exergame platform, designs and implements the games, and creates tools for standardized assessment of patient performance. The clinical team at La Tour Hospital evaluates the usability and clinical validity of the platform.

A three-year clinical study is planned to begin following Swissmedic approval, with recruitment expected to start in early 2027. The study will evaluate the platform with patients and help assess its clinical value for rehabilitation, movement assessment and recovery monitoring.

Partners

Artanim
Design of the exergames and development of a platform to support them, along with medical assessment scores that take advantage of the motion tracking system’s extended capabilities.

La Tour Hospital – Elbow & Shoulder Orthopedics and Traumatology
Clinical testing and co-design of new physical assessment metrics adapted to the capabilities of the motion tracking system.

Related Publications

Mancuso M, Lädermann A, Schmid Dornbierer Y, Seurot A, Charbonnier C. Can the Combination of Motion Tracking and Virtual Reality Make Shoulder Rehabilitation Entertaining?, Multidiscip Biomech J, 3:47–49, 2026.
PDF · DOI

Mancuso M, Charbonnier C. Technical evaluation of the fidelity of the HTC Vive for upper limb tracking, 42nd International Conference on Biomechanics in Sports, Salzburg, Austria, July, 2024.
PDF

Mocap RSA

Mocap RSA

by | Mar 27, 2021

Mocap RSA

A motion capture study of shoulder kinematics after reverse shoulder arthroplasty.

Project Info

Start date

January 2022

End date

June 2023

Funding

FORE Foundation / La Tour Hospital

Coordinator

Artanim

Back to Projects

Summary

Mocap RSA investigates postoperative shoulder motion after reverse shoulder arthroplasty (RSA), with the aim of quantifying range of motion during activities of daily living and better understanding the resulting glenohumeral and scapulothoracic kinematics.

A major technical challenge is the accurate reconstruction of the postoperative anatomy and prosthetic components. Metallic implants can generate substantial artifacts in conventional CT imaging, making 3D reconstruction difficult. To address this, patients were scanned postoperatively using a dedicated low-dose cone-beam CT protocol, and a registration method was developed to align preoperative 3D bone models of the scapula and humerus, together with implant CAD models, onto the postoperative images.

Artanim was responsible for the segmentation and 3D reconstruction of the preoperative and postoperative bone and implant models, as well as for the dynamic simulation of reverse shoulder prostheses driven by motion capture data. The Haute École de Santé (HEdS) was responsible for the postoperative registration methodology, while La Tour Hospital handled patient recruitment and the clinical aspects of the study.

Partners

Artanim
Motion capture, 3D reconstruction and dynamic simulation of reverse shoulder prostheses.

Haute École de Santé (HEdS)
3D registration of postoperative RSA models.

La Tour Hospital – Elbow & Shoulder Orthopedics and Traumatology
Patient recruitment, clinical testing and medical supervision.

Related Publications

Levy G, Charbonnier C, Collin P, Pernoud A, Gaillard J, Lädermann A. Exploratory analysis of shoulder motion strategies for achieving functional hand behind the back in controls and after reverse shoulder arthroplasty. A study from the LaTour group, Int Orthop, 2026.
PDF · DOI

Levy G, Charbonnier C, Martinho T, Collin P, Bothorel H, Pernoud A, Lädermann A. Reverse Shoulder Arthroplasty: How to reach the back? A motion capture study to analyse glenohumeral strategies to perform functional internal rotation after RSA and in control cases, JSES Int, 10(2):101515, 2026.
PDF · DOI

Levy G, Charbonnier C, Martinho T, Collin P, Bothorel H, Pernoud A, Lädermann A. Analysis of the glenohumeral and scapula-thoracic motions ratio in controls and after reverse shoulder arthroplasty, Swiss Med Wkly, 2025.
PDF

Levy G, Charbonnier C, Martinho T, Collin P, Bothorel H, Pernoud A, Lädermann A. Reverse Shoulder Arthroplasty: How to reach the back? A motion capture study to analyse glenohumeral strategies to perform functional internal rotation after RSA and in control cases, 35th Annual Congress of the European Shoulder and Elbow Society (SECEC), Rotterdam, The Netherlands, September, 2025.
PDF

Scapulo-Thoracic Alignment in B2 Glenoids

Scapulo-Thoracic Alignment in B2 Glenoids

by | Apr 25, 2019

Scapulo-Thoracic Alignment in B2 Glenoids

A 3D motion analysis study investigating scapulothoracic alignment in shoulder osteoarthritis.

Project Info

Start date

April 2019

End date

December 2019

Funding

FORE Foundation / La Tour Hospital

Coordinator

Artanim

Back to Projects

Summary

Scapulo-Thoracic Alignment in B2 Glenoids investigates whether altered scapulothoracic alignment may contribute to the development of Walch type B2 glenoid osteoarthritis and its characteristic posterior erosion pattern.

The study uses a patient-specific 3D analysis combining medical imaging and optical motion capture to evaluate scapulothoracic alignment and compare pathological shoulders with the contralateral healthy side.

By characterizing the relationship between scapular orientation, glenohumeral mechanics and posterior glenoid erosion, the project aims to improve the understanding of shoulder pathoanatomy and the mechanisms involved in the development of osteoarthritis.

Within the project, Artanim was responsible for the dynamic simulation and analysis of shoulder kinematics using motion capture data.

Partners

Artanim
3D modeling and dynamic simulation of the shoulder.

La Tour Hospital – Elbow & Shoulder Orthopedics and Traumatology
Patient recruitment, clinical testing and medical supervision.

Imaging Center Rive Droite SA
Radiological imaging acquisitions.

Related Publications

Lädermann A, Athwal GS, Bothorel H, Collin P, Mazzolari A, Raiss P, Charbonnier C. Scapulothoracic Alignment Alterations in Patients with Walch Type B Osteoarthritis: An In Vivo Dynamic Analysis and Prospective Comparative Study, J Clin Med, 10(1):66, 2021.
PDF · DOI

HoloMed

HoloMed

by | Feb 12, 2018

HoloMed

An AR visualization tool for real-time analysis of patient-specific joint anatomy and motion.

Project Info

Start date

September 2016

End date

February 2018

Funding

FORE Foundation / La Tour Hospital & Hirslanden Clinique La Colline

Coordinator

Artanim

Back to Projects

Summary

HoloMed explores how augmented reality can support medical education, assessment and rehabilitation by combining motion capture, patient-specific 3D anatomical models and real-time visualization.

The project develops an anatomical see-through tool that allows healthcare professionals to visualize joint anatomy and kinematics directly on the patient while they move. Bone models are rendered as holographic overlays aligned with the subject’s body, creating an X-ray-like view of the underlying anatomy in real time.

The approach is designed to support applications in sports medicine and rehabilitation by making patient-specific movement and joint mechanics easier to observe and interpret during functional tasks.

Partners

Artanim
Development of augmented reality visualization tools.

La Tour Hospital – Elbow & Shoulder Orthopedics and Traumatology
Clinical testing and medical supervision.

Hirslanden Clinique La Colline – Center for Orthopaedic Surgery and Musculoskeletal Traumatology
Clinical testing and medical supervision.

Related Publications

Elias de Oliveira M, Galvan Debarba H, Lädermann A, Chagué S, Charbonnier C. A Hand-Eye Calibration Method for Augmented Reality Applied to Computer-Assisted Orthopedic Surgery, Int J Med Robot Comput Assist Surg, 15(2):e1969, 2019.
PDF · DOI

Elias de Oliveira M, Galvan Debarba H, Lädermann A, Chagué S, Charbonnier C. Réalité augmentée en chirurgie orthopédique. Mythe ou réalité ?, Congrès de la Société Francophone d’Arthroscopie 2018, Paris, France, Rev Chir Orthop Traumatol, 104(8):S110, December, 2018.
PDF · DOI

Galvan Debarba H, Elias de Oliveira M, Lädermann A, Chagué S, Charbonnier C. Augmented Reality Visualization of Joint Movements for Rehabilitation and Sports Medicine, 20th Symposium on Virtual and Augmented Reality (SVR), Foz Do Iguaçu, Brazil, October, 2018.
PDF · DOI

Galvan Debarba H, Elias de Oliveira M, Lädermann A, Chagué S, Charbonnier C. Augmented Reality Visualization of Joint Movements for Physical Examination and Rehabilitation, Proc. 2018 IEEE Virtual Reality, IEEE Comput. Soc, March, 2018.
PDF · DOI

Galvan Debarba H, Elias de Oliveira M, Lädermann A, Chagué S, Charbonnier C. Tracking a Consumer HMD with a Third Party Motion Capture System, Proc. 2018 IEEE Virtual Reality, IEEE Comput. Soc, March, 2018.
PDF · DOI

Elias de Oliveira M, Galvan Debarba H, Lädermann A, Chagué S, Charbonnier C. Development of a Hand-Eye Calibration Method for Augmented Reality Applied to Computer-Assisted Orthopedic Surgery, 32nd International Congress of Computer Assisted Radiology and Surgery, Heidelberg, Germany, Int J CARS, June, 2018.
PDF · DOI