Master Thesis: Large Language Models in Medicine

16.07.2024, Abschlussarbeiten, Bachelor- und Masterarbeiten

By leveraging LLMs, we can enhance diagnostic accuracy, streamline administrative tasks, and provide personalized patient care. However, the integration of these models into medical practice poses unique challenges and opportunities that warrant thorough investigation.

Objective

The primary objective of this thesis is to develop and evaluate AI systems powered by Large Language Models that aid medical professionals in their work. Specific research topics and applications will be agreed upon with the student, allowing for a tailored approach that aligns with the student's interests and expertise. Potential areas of focus include (but are not limited to):

• LLMs and Knowledge Graphs: Integrating LLMs with medical knowledge graphs to improve information retrieval and decision support.
• Retrieval-Augmented Generation: Enhancing the generation capabilities of LLMs by incorporating external data sources.
• Explainability: Developing methods to interpret and explain the outputs of LLMs to ensure transparency and trustworthiness in medical applications.
• Uncertainty Quantification: Quantifying and communicating the uncertainty in LLM predictions to assist medical professionals in making informed decisions.

Methodology

1. Literature Review: A comprehensive literature review will be conducted to understand the current state of LLMs in medicine from the chosen perspective.
2. Data Collection and Preprocessing: Utilizing real clinical data in German, provided by the institution. The data will be preprocessed and anonymized to ensure compliance with privacy regulations. If needed, this will be extended with public data.
3. Explore, Implement, and Compare Different Approaches: Train and fine-tune LLMs.
4. Evaluation: Assessing the performance of the developed systems through quantitative metrics and qualitative feedback from medical experts.
5. Discussion and Presentation of Results

What We Offer

• Access to Real Clinical Data: The thesis will provide access to unique clinical data with high potential for publication and impactful research.
• Interdisciplinary Environment: Students will work in a highly educated and interdisciplinary team, fostering collaboration between computer science and medical experts.
• Advanced Computing Resources: The institution offers top-level hardware for scientific computing, ensuring efficient and effective model training and experimentation.
• Expert Feedback: Continuous feedback from both medical professionals and computer science experts will guide the research process, ensuring the development of relevant and high-quality solutions.

Prerequisites

• Language Skills: Good English and at least intermediate German language skills are necessary for working with clinical data.
• Technical Skills: Advanced knowledge of deep learning, proficiency in Python, and experience with PyTorch is essential. Familiarity with the HuggingFace ecosystem is a plus.
• Medical Data Experience: Previous experience with medical data is beneficial.

Preferred start date: The preferred start date for this thesis is September 2024, with flexibility to accommodate the selected candidate's schedule.

Advisor: Márton Szép and Florian Hinterwimmer

Supervisor: Prof. Dr. Daniel Rückert

If you are interested, please send your CV, transcript of records, and project idea to marton.szep@tum.de.

Kontakt: marton.szep@tum.de