Researchers · Interviewed at COLM 2026

Emmy Liu

Carnegie Mellon University

COLM 2026 in San Francisco. Do All LLMs Learn in the Same Order?

COLM 2026 · October 5, 2026 · 32 min

COLM 2026 in San Francisco. Do All LLMs Learn in the Same Order?

Do all language models learn things in the same order - even when they are trained on different data? Emmy Liu (CMU) tracked 91 skills across four model families through the first trillion tokens of pre-training, and the answer is: largely, yes.

Work is presented at COLM 2026, the Third Annual Conference on Language Modeling.

More from COLM 2026

All event interviews →