One eval API – real robots, sim included. Public or private.
We do the eval – the robots, the runs, the statistics – so you can focus on the research.
Real, as easily as sim. Run your model on a real arm through the same API as sim – one set of metrics, one comparable number.
One catalog, growing. Real rigs plus the sim benchmarks you already run (LIBERO, RoboCasa, ManiSkill) in the same harness – so you stop rebuilding eval infrastructure for every model and robot.
Numbers you can cite. Blinded, randomized, enough trials to mean something – every run saved with multi-view video and telemetry.
Private or public. Keep results to your lab, or put them on the leaderboard alongside π0.5, GR00T, FLUX 3 Action, Cosmos3 Nano, MolmoAct2, G0.5, SmolVLA, and ACT.
We’re opening this to early users. Leave your email and what you’d run through it.
Thanks – we’ll be in touch.
See it live: the leaderboard, every run, the protocol and data, and the methodology.