Virtual Test Env for 3D Reconstruction and Drone Navigation

15.03.2025, Diplomarbeiten, Bachelor- und Masterarbeiten

The Human-Centered Computing and Extended Reality Lab of the Professorship for Machine Intelligence in Orthopedics seeks applicants for Bachelor/Master Thesis for the Summer Semester 2025.

Overview

This project aims to provide a virtual test environment enabling a monitoring center for first responder guidance in medical 3D teleconsultation.

Project Description

The aim of XR teleguidance in medical scenarios is to address the shortage of specialists and to be able to act more quickly in emergency situations without the physical presence of the emergency personnel, i.e. the physician [5,6]. However, the real emergency begins before interacting with the patient. Not only do operations often have to be planned for patients, but their rescue is a crucial point which happens before the interaction with the physician. By using drones with built-in sensors, a mapping of the surroundings can be carried out before the rescuers reach the scene of the accident. Based on this mapping, a 3D reconstruction can be created that can be evaluated by the operations center and rescue strategies can be planned before the rescue personnel arrive on the scene. The student should build a 3D interface for region-of-interest selection and integrate a digital twin of one or multiple drones which can be guided by the operator. Locomotion techniques and exploration of the environment should be integrated. Students should use NVIDIA OMNIVERSE.

Technical Prerequisites

The student should have some experience in coding. Experience in Unity/Unreal or Omniverse are beneficial.

Please send your transcript of records, CV and motivation to: Hannah Schieber (hannah.schieber@tum.de) with CC to hex-thesis.ortho@mh.tum.de

Literatur

Roth, D., Yu, K., Pankratz, F., Gorbachev, G., Keller, A., Lazarovici, M., ... & Eck, U. (2021, March). Real-time mixed reality teleconsultation for intensive care units in pandemic situations. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 693-694). IEEE.
Yu, K., Roth, D., Strak, R., Pankratz, F., Reichling, J., Kraetsch, C., ... & Eck, U. (2023, October). Mixed Reality 3D Teleconsultation for Emergency Decompressive Craniotomy: An Evaluation with Medical Residents. In 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 662-671). IEEE.

Kontakt: hex-thesis.ortho@mh.tum.de, hannah.schieber@tum.de