Topics

Pretraining, Data & Scaling

What a model learns depends on what it is trained on, and in what order. These conversations look at pretraining dynamics, how training data shapes model abilities, data mixtures and scaling laws, and when domain data belongs in pretraining rather than fine-tuning.

4 conference interviews

From conferences and workshops

Interviews recorded on site

All topics