@WilliamBarrHeld
Inspired by @karpathy’s NanoChat, I created a simple experiment for running a full pre-mid-post-training run using Marin! The whole thing runs on a single v5p-8, so researchers can reproduce the whole thing at extremely low cost on the TPU Research Cloud! https://t.co/IXt6zXv5H2