@dair_ai
A huge claim from this paper on the end of reward engineering. Reward engineering remains a persistent bottleneck in multi-agent RL. This paper argues that LLMs enable a fundamental shift: from hand-crafted reward functions to natural language objectives. If language can specify what we want and LLMs can translate that into working rewards, the end of reward engineering may mark the beginning of truly scalable multi-agent coordination. Instead of translating human intent into numbers, a lossy and error-prone process, we can describe it in the same language we use with each other. EUREKA demonstrates GPT-4 can generate reward functions achieving human-level performance from language descriptions alone, It outperforms human-designed rewards on 83% of robotics tasks. CARD enables autonomous reward refinement without human intervention. RLVR (as in DeepSeek-R1) shows that language-based training produces emergent reasoning capabilities. What enables all of this? First, semantic reward specification: language preserves intent that numerical functions lose. "Collaborate efficiently" carries rich meaning about task division, smooth handoffs, and failure recovery that no weighted sum captures. Second, dynamic adaptation: when reward hacking occurs, an LLM can observe trajectories, generate feedback in natural language, and refine rewards automatically. No more weeks of manual debugging. Third, inherent human alignment: language objectives are interpretable. Debugging "minimize delivery time while avoiding collisions" is far easier than debugging opaque weight vectors. A few challenges remain: computational cost of LLM inference, hallucination risks in safety-critical systems, language ambiguity, and scaling to hundreds of agents. Paper: https://t.co/czW7QPVML1 Learn to build effective AI Agents in our academy: https://t.co/Y5kVy5iKiQ
