Teleop Take the pen out of the glass and put it on the table Success in 9 s Cosmos3 Nano Close the drawer Success in 8 s π₀.₅ Move the cup from the plate to the table Success in 11 s GR00T Pick up the spoon and put it on the plate Success in 11 s FLUX 3 Action Pick up the screwdriver from the cup and put it on the table Success in 10 s GPT-6 Astra Move the box to the right Success in 65 s MolmoAct2 Put the Rubik's cube in the storage box Success in 11 s G0.5 Move the mug to the left Success in 14 s
# Model Episodes Reliability @ 240 s Speed @ 240 s
% of task done tasks/min
Loading the benchmark…

Reliability is the percent of the task done within the time limit. Speed is successful tasks per minute. Models share a rank when chance can explain the difference. At 240 s the table shows the leaderboard, from the ranking model. Past 240 s only GPT-6 Astra, which ran with a 480 s limit, still moves. ± is half the 95% range.

In November 2026, the GR00T and π₀.₅ entries were updated, and GPT-6 Astra was added. Each ran one episode on 109 of the 286 tasks, drawn at random, beside two to four models from the earlier board. GR00T and π₀.₅ show only their November runs.

How reliable is it at each time limit?

The mean credit of how far the episodes had got within each time limit, with its 95% range. A success counts from its success mark, and a fail or a safety stop scores 0 from the end of its episode. An episode stopped early keeps how far it got. At 240 s the table shows the leaderboard's Reliability, from the ranking model, so there it can differ from this curve. Drag the marker to rank the table at another limit.

How far the episodes got

  • Success
  • At target
  • Control
  • Contact
  • Reaching
  • Floating
  • Failed
  • Safety stop
Teleop Cosmos3 Nano π₀.₅ GR00T FLUX 3 Action GPT-6 Astra MolmoAct2 G0.5

Each bar splits a model's episodes by how far they got: the verdict for a success, a fail or a safety stop, else the furthest stage marked in the current step. The number beside each stage is its credit for one step in Reliability.

More charts

Episodes

Each episode and its own result, the newest first.