Puro-2B: How Can a Poor Lab Pretrain a Model from Scratch?
Puro-2B：普通实验室也能做预训练？
A practical account of pretraining on RTX 5090 GPUs, with the data recipe, optimizer choices, and interactive experiments.
Read articleBlog
Research notes and pretraining in practice.