Master Thesis / IDP: Evaluation and Optimization for LLM Inferences on RISC-V based Tenstorrent AI Accelerators

19.09.2025, Diplomarbeiten, Bachelor- und Masterarbeiten

We are looking for motivated computer science students with research interests in LLM inference and computer systems.

This thesis examines the performance of Large Language Model (LLM) inferences on next-generation AI accelerators beyond GPUs, focusing on Tenstorrent's RISC-V-based AI hardware. The study aims to evaluate various performance aspects, including factors such as inference latency, memory access pattern, and power consumption, to understand how these accelerators compare to traditional AI hardware.

Different LLM architectures will be analyzed to explore how their computational characteristics impact performance on specialized AI accelerators. The research will provide insights into the effectiveness of these accelerators in handling diverse AI workloads and identify potential optimizations for improving inference efficiency.

By benchmarking multiple models and assessing key performance trade-offs, this thesis aims to contribute to the broader understanding of AI hardware acceleration and guide future developments in efficient LLM deployment on emerging AI architectures.

Applicants should have basic knowledge of

- LLMs

- Computer architecture and systems

- ML compilers

- Solid programming background

Please send your application email with CV and transcripts (in English) to binqi.sun@tum.de.

(Students from CIT are welcome to apply for this topic as an IDP or Master's thesis)

Kontakt: binqi.sun@tum.de

More Information

https://rtsl.cps.mw.tum.de/