@dair_ai
// Self-play with a pinch of human data // Really cool paper combining human demonstrations and self-play RL. 30 minutes of human data, 2500x less than imitation learning, is enough to make self-play policies coordinate with real people. Pure self-play learns effective but alien conventions that humans cannot drive alongside. The usual fix is brittle reward engineering and domain randomization. This work instead treats a small set of human demonstrations as a regularization objective on top of a minimal safe goal-reaching reward. Why does it matter? The resulting policies coordinate with held-out human trajectories and finish training in 15 hours on a single consumer GPU. The lesson travels well past driving. A small demonstration regularizer may be the cheapest alignment knob we have for self-play. Paper: https://t.co/nLrVwRFEW9 Learn to build effective AI agents in our academy: https://t.co/LRnpZN7L4c