DLS: Ion Stoica — An AI Stack: From Scaling AI Workloads to LLM Evaluation

Monday, November 4, 2024 10:00 am - 11:30 am EST (GMT -05:00)

Please note: This distinguished lecture will take place in DC 1302 and online.

Ion Stoica
Professor, EECS Department, University of California at Berkeley
Director, Sky Computing Lab

Professor Ion Stoica

With the release of ChatGPT, just over one year ago, large language models (LLMs) have taken the world by storm: they have enabled new applications, have exacerbated GPU shortage, and raised new questions about their answers’ veracity.

In this talk, I will present several projects I have been working on over the past three years, which are now part of an open-source stack for training, fine tuning, serving and evaluating LLMs. In this talk, I will focus on three projects: (i) Ray, a distributed framework for scaling ML workload, (ii) vLLM, a high-throughput inference engine for LLMs, and (iii) Chatbot Arena, a system to accurately benchmark LLMs.


Bio: Ion Stoica is a Professor in the EECS Department at the University of California at Berkeley, and the Director of Sky Computing Lab. He is currently doing research on cloud computing and AI systems. Past work includes Ray, Apache Spark, Apache Mesos, Tachyon, Chord DHT, and Dynamic Packet State (DPS).

He is a Member of NAE, an Honorary Member of the Romanian Academy, an ACM Fellow and has received numerous awards, including the Mark Weiser Award (2019), SIGOPS Hall of Fame Award (2015), and several “Test of Time” awards. He also co-founded three companies, Anyscale (2019), Databricks (2013) and Conviva (2006).


To attend this distinguished lecture in person, please go to DC 1302. You can also attend online using Zoom.

Please email Izabela Rutkowski for the passcode.