Development of an Interactive Operating Theatre in Omniverse

11.03.2025, Abschlussarbeiten, Bachelor- und Masterarbeiten

The Human-Centered Computing and Extended Reality Lab of the Professorship for Machine Intelligence in Orthopedics seeks applicants for Bachelor/Master Thesis for the Summer Semester 2025.

Abstract

This project aims to develop an interactive twin of an operating theatre for robotic training purposes in Omniverse. The resulting environment will be used to train human-robot-interaction in.

Project Description

The objective of this student thesis is to develop model an existing operating theatre in Omniverse/Isaac Lab so that it can be used for human-robot-interaction simulations. In order to be able to simulate different experiments and setups, the items within the OR like operating lamps and the patient bed, should be modelled as separate items, that can be removed, if necessary. Lamps, patient bed, and all other items should preserve their functions and should be interactable in the simulation. This project is not being offered as a master thesis. Key research areas include:

• Creation of an interactive environment of an existing OR
• Development within simulations environments for robotic learning

Technical Prerequisites

• Experience with simulation tools like Mujoco and ideally Omniverse/Isaac Sim
• Experience with Python and C/C++
• Experience with game engines helpful
• Experience with CAD software helpful

Please send your transcript of records, CV and motivation to: Victor Schaack (vic.schaack@tum.de) with CC to hex-thesis.ortho@mh.tum.de

Literatur
Ahmed, N., Afyouni, I., Dabool, H., & Al Aghbari, Z. (2024). A systemic survey of the Omniverse platform and its applications in data generation, simulation and metaverse. Frontiers in Computer Science, 6. https://doi.org/10.3389/fcomp.2024.1423129
Hummel, M., van Kooten, K. (2019). Leveraging NVIDIA Omniverse for In Situ Visualization. In: Weiland, M., Juckeland, G., Alam, S., Jagode, H. (eds) High Performance Computing. ISC High Performance 2019. Lecture Notes in Computer Science(), vol 11887. Springer, Cham. https://doi.org/10.1007/978-3-030-34356-9_48
Kleinbeck, C., Zhang, H., Killeen, B.D. et al. Neural digital twins: reconstructing complex medical environments for spatial planning in virtual reality. Int J CARS 19, 1301–1312 (2024). https://doi.org/10.1007/s11548-024-03143-w

Possible Resources:
https://developer.nvidia.com/isaac/sim
https://developer.nvidia.com/isaac/lab
https://docs.isaacsim.omniverse.nvidia.com/latest/index.html
https://docs.omniverse.nvidia.com/isaacsim/latest/features/warehouse_logistics/ext_omni_anim_people.html

Kontakt: hex-thesis.ortho@mh.tum.de, vic.schaack@tum.de