@HuggingPapers
EfficientRollout A system-aware self-speculative decoding framework for RL rollouts from FuriosaAI & UC Berkeley that induces a quantized self-drafter to cut rollout latency by up to 19.6% and end-to-end training time by 12.7% without sacrificing model quality. https://t.co/GasdO9Jfz5