@Muennighoff
new paper: Prefix Sliding for efficient test-time scaling vanilla full attention OOMs on long tasks & compaction loses important details -- prefix sliding is a simple & fast alternative that can outperform both 📜https://t.co/fUw7yJAN5D https://t.co/PgcyrsfIZb