@dawnsongtweets
Introducing CUA-Lite 🧵 — an open platform for computer-use agents. Training and benchmarking CUAs (Computer-Use Agents) requires four core pieces: 1️⃣ Agents — the models and the scaffolding that drives them 2️⃣ Environments — runtime/sandboxes for agents to interact with, tasks & verifiers/graders 3️⃣ Traces — records of agent trajectories 4️⃣ Frameworks — to evaluate, SFT & RL-train agents Today, all four are fragmented. Every agent ships with its own implementation, often in a separate repo — there is no unified way to run them all. Every environment exposes its own interface and action space, often requiring an expensive VM sandbox for each verifiable task. Traces come in incompatible formats. And without common standards across the stack, every project ends up rebuilding its own tooling/framework for eval, SFT, and RL. CUA-Lite unifies the stack: → One standardized interface & action space for agents and environments → One standardized format for agent traces → One framework for evaluation, SFT & RL → Across desktop, browser & mobile And open resources plug straight in, creating the largest open collection of CUA agents, environments and traces, all in a unified format: 🤖 10+ CUAs, including GPT, Claude, Gemini, Qwen, Muse-Glimmer, UI-TARS 🌐 15+ benchmarks, including OSWorld, WebArena & AndroidWorld ⚡ Optional VM-free sandboxes with 30K+ verifiable tasks for training 📚 10+ trace datasets, freely available on Hugging Face, including public datasets converted into the standardized format and fresh rollouts from frontier open-weight CUAs Led by @BerkeleyRDI , our goal is for CUA-Lite to become a community-driven, open-source ecosystem for computer-use agents. Join the community and contribute today: bring an environment (runtime/sandbox + tasks + verifier), traces, or an agent, and plug it into CUA-Lite!
