@percyliang
Assignment 3 (scaling laws): fit scaling laws using IsoFLOP. To simulate the high-stakes of a training run, students got a training API [hyperparameters -> loss] and a fixed compute budget, and had to choose which runs to submit to gather data points. Behind the scenes, the training API was backed by interpolating between a bunch of precomputed runs. https://t.co/JpaDT8wIoE