@percyliang
If you use Pythia and like it, we're making an updated version. Tell us what you want. Here's a question for y'all: would you rather have a scaling suite trained on Nemotron-CC (very high quality, some distilled) or CommonPile (public domain, permissively licensed, more crunchy)?