Benchmarks
Progress through an episode
Each band shows how many episodes of GPT-6 Astra were in that band at each second. On a task of one step, an episode is in the band of the furthest stage it reached. On a task of several steps, an episode is in the band its credit has reached, and each band starts at its stage's credit for one step. The dashed line shows the mean Reliability.
Episodes
Each episode of GPT-6 Astra on DROID: Everyday tasks, the newest first.
Progress through an episode
Each band shows how many episodes of GPT-6 Astra had succeeded, partly succeeded (some subtask score) or had no success at each second of simulated time. An episode that has ended stays in its band. The dashed line shows the mean Reliability, the mean subtask score.
Episodes
Each episode of GPT-6 Astra on RoboLab-120, the newest first.