Building an LLM from scratch in 60 minutes - with Bart De Smet
Building an LLM from scratch in 60 minutes
Armed with nothing but C# and the .NET libraries, we'll endeavor on a whirlwind tour to build a toy GPT-like LLM from scratch.
Expect a hardcore deep dive coding session that demystifies the essential building blocks of LLMs, including tokenization, embeddings, layers, self-attention, transformers, auto-differentiation, gradient descent, and more.
By the end of the session, we'll train our LLM on a corpus of text and attempt to have a meaningful - or gibberish - conversation with it.
MAS - Room Eighty, Antwerpen
Begin:
End:
Admission:
Add to Calendar