Learn it from scratch, one idea at a time.
↓ what we do
We write notebooks that build models from scratch, one idea at a time.
Open a notebook ↓We read papers together and talk through research ideas as we go.
Read our notes →Next on the board: turning what we learn and research into things people use.
↓ pick one up
Write a working language model, line by line.
Open notebook →How attention and transformers really work.
Open notebook →Found one useful? Support the work behind it →