MSc Project: Temporal Landmark Tracking on Medical Imaging

25.07.2024, Abschlussarbeiten, Bachelor- und Masterarbeiten

Even though various learning-based computer vision methods have been developed for pixel tracking, motion estimation in video data depicts a challenging task. Part of the problem arises from the 3D-to-2D projection process that can lead to out-of-plane motion, which impedes long-range pixel trajectory estimation. In the medical domain, video data, i.e. fast magnetic resonance imaging (MRI) sequences, can be used for guidance during treatment. Specifically, in radiation therapy, contouring algorithms are used for tracking of the target volume supposed to receive the main radiation dose during treatment [2]. Delineation can, for example, be performed with a U-Net architecture. However, such an approach only allows for identification of larger structures, while irregular movement can be subtle and localized. Landmark detection models are able to identify such localized regions between different representations of the same object. Furthermore, they are faster than semantic segmentation models, and therefore, allow for computer aided intervention during treatment.In this thesis, different state-of-the-art landmark and pixel tracking algorithms will be tested and further enhanced to identify movement on temporal imaging data of the lungs, i.e. 4D CT. Furthermore, ability of such landmarks to identify movement differing from a normal state, i.e. allowing for identification of anomalies, will be studied.

Requirements:
• Prior experience and good understanding in deep learning and computer vision
• Very good programming skills in Python and PyTorch
• Interest in medical imaging

Affiliation:
Prof. Dr. Julia Schnabel
Informatik 32 - Lehrstuhl für Computational Imaging and AI in Medicine
Supervision: Dr. Daniel Lang, Anna Reithmeir

Application:
Please send a mail, involving a CV, a current transcript of records and a brief statement on
why you are interested in the project, to daniel.lang@tum.de or anna.reithmeir@tum.de.

Kontakt: daniel.lang@tum.de