PhAIL
PhAIL Physical AI Leaderboard by Positronic Robotics
Leaderboard › Model

Model card

Made by
Black Forest Labs
Size
7B parameters
Published
22 Sep 2026
More about the model
Publication
Technical report
Code
github.com/black-forest-labs/flux-action
Weights licence
FLUX Kommunity License v1.0, non-commercial source
Actions per chunk
32, at 15 Hz source
Smallest GPU
RTX 5090, the smallest GPU in Black Forest Labs' timing table source
Inference time
136 ms per chunk on a B200 (BF16, guidance-distilled) source
Architecture
Diffusion transformer that denoises video frames and actions together, with a frozen video VAE and a Qwen3-VL-4B text encoder source
Training data
Video, image and audio pretraining; action training on games, human-hand video, handheld grippers and teleoperation from 14 embodiments; fine-tuned on DROID source

Run with Positronic

Start the server source

docker run --gpus all -p 8000:8000 positro/flux3-action

Drive a DROID robot from a positronic checkout guide

uv run --extra hardware positronic-inference real \
  --policy=.remote \
  --policy.address.host=localhost --policy.address.port=8000 \
  --next_task.instruction="Put the marker on the plate"

Progress through an episode

Each band shows how many episodes of FLUX 3 Action had got as far as that stage at each second. The dashed line shows the mean Reliability.

Episodes

Each episode of FLUX 3 Action on DROID: Everyday tasks, the newest first.

176 episodes
Task Task difficulty How far it got % of task done Time to success, s
Remove the yellow block from the bowl Easy Success 100 13.1
Put the book in the box Hard Success 100 46.6
Pick up the screwdriver from the cup and put it on the table Easy Success 100 12.3
Remove the marker from the cup and put it on the book Very hard Failed 0 -
Put the cloth in the bag Very hard Failed 0 -
Pick up the spoon and put it on the plate Easy Success 100 21.8
Put the knife in the drawer Very hard Failed 0 -
Put the towel in the basket Medium Failed 0 -
Put the plush on the table Easy Success 100 21.8
Pick up the pen from the cup and put it on the table, then move the cup Hard Success 100 45.4
Remove the marker from the glass and put it on the table Hard Success 100 18.8
Put the marker in the glass Hard Failed 0 -
Put the marker beside the mug Hard Success 100 53.0
Put the wrench in the bowl Hard Failed 0 -
Put the screwdriver on the tray Very hard Failed 0 -
Put the lid on the pan Easy Success 100 15.4
Pick up the toy and put it in the bowl Hard Failed 0 -
Put the marker on the cloth, then fold the cloth and put it in the box Very hard Failed 0 -
Pick up the bottle and put it on the right side of the table Hard Failed 0 -
Put the bottle in the bag Very hard Failed 0 -
Remove the bottle from the tray and put it on the table Very hard Failed 0 -
Put the marker inside the container Hard Failed 0 -
Remove the bottle from the bowl and put it on the table Easy Success 100 14.6
Put the bottle on the tray Hard Success 100 16.0
Pick up the cup and put it on the left side of the table Medium Success 100 13.9
Remove the lid from the bottle and put it on the table Very hard Failed 0 -
Put the blocks in the cup Very hard Failed 0 -
Pick up the bottle from the box and put it on the table Hard Failed 0 -
Put the bottle in the bowl Medium Failed 0 -
Put the lid on the bottle Very hard Failed 0 -
Put the bottle on the table Easy Success 100 11.1
Put the orange cup in the yellow cup then put the yellow cup in the blue cup Very hard Failed 0 -
Pick up the spoon and put it in the cup Very hard At target 40 -
Put the blue cup on the table Easy Success 100 12.9
Put the yellow block on the table Very hard Success 100 38.9
Put the blocks in the bowl Very hard Failed 0 -
Pick up the bottle and put it in the box Very hard Control 30 -
Put the pen in the mug Hard Failed 0 -
Put the pen in the bowl Easy Success 100 109.3
Put the green block in the bowl Easy Success 100 32.8
Pick the marker from the bowl and put it on the table Easy Success 100 10.7
Take the marker out of the mug and put it on the table Easy Failed 0 -
Close the box Very hard Failed 0 -
Put the marker on the table Medium Success 100 25.4
Put the yellow block in the cup Easy Success 100 15.8
Put the cup in the bowl Easy Success 100 12.8
Put the spoon in the bowl Very hard Failed 0 -
Put the marker in the bowl Medium Failed 0 -
Put the marker in the cup Hard Failed 0 -
Move the wooden block to the left Very hard Control 30 -
Flip over the plate Hard Success 100 35.7
Put the sponge in the bowl Easy Failed 0 -
Put the marker in the mug Hard Failed 0 -
Put the banana on the plate on the left Easy Failed 0 -
Put the orange block on top of the green block Hard Success 100 16.9
Put the yellow block in the blue cup Medium Success 100 14.7
Put the fork on the plate Medium Success 100 107.5
Put the cube in the bowl Medium Success 100 9.8
Put the spoon in the mug Hard Success 100 49.6
Put the pen in the cup Very hard Success 100 27.1
Use the towel to wipe the table Hard Success 100 140.8
Fold the towel Hard Failed 0 -
Move the cup to the right Easy Success 100 15.1
Move the cup to the left Easy Success 100 13.0
Close the box Very hard Failed 0 -
Put the marker on the table Medium Success 100 13.0
Put the cup in the bowl Easy Failed 0 -
Put the spoon in the bowl Very hard Failed 0 -
Put the marker in the bowl Medium Success 100 24.5
Put the marker in the cup Hard Failed 0 -
Move the wooden block to the left Very hard Failed 0 -
Flip over the plate Hard Success 100 38.0
Put the sponge in the bowl Easy Success 100 12.6
Put the marker in the mug Hard Success 100 19.8
Put the banana on the plate on the left Easy Success 100 12.7
Turn the box right side up Very hard Failed 0 -
Turn the spoon Hard Failed 0 -
Turn the lid upside down Very hard Safety stop 0 -
Rotate the mug Easy Success 100 22.0
Turn the marker to the right Hard Success 100 18.1
Unstack the boxes on the table Medium Success 100 26.2
Stack the cups inside the bowl Hard At target 40 -
Stack the wooden blocks on the table Very hard Failed 0 -
Use the towel to wipe the plate Medium Success 100 139.3
Wipe the table with the cloth Medium Success 100 72.1
Move the banana to the left Easy Success 100 11.8
Move the plate to the left Hard Failed 0 -
Move the fork to the right Easy Success 100 179.9
Move the rubik's cube to the left Easy Success 100 52.0
Move the spoon to the right Easy Success 100 24.5
Move the pen to the right Medium Success 100 30.3
Move the box to the right Very hard Failed 0 -
Move the cloth to the right Medium At target 40 -
Move the marker to the left Easy Success 100 113.0
Move the towel to the right Hard Failed 0 -
Put the green block in the box Easy Success 100 18.3
Put the pen in the storage box Medium Success 100 9.9
Put the Rubik's cube in the storage box Easy Success 100 12.7
Put the pen in the drawer Easy Success 100 35.3
Put the screwdriver in the bowl Very hard Failed 0 -
Put the cube in the drawer and close the drawer Very hard Failed 0 -
Put the spoon in the box Medium Success 100 16.4
Put the wooden spoon in the drawer Medium Success 100 22.8
Put the sponge in the open drawer Hard Failed 0 -
Put the cup in the drawer Hard Success 100 11.6
Put the cube in the cup Hard Success 100 12.9
Put the marker on the towel Hard Success 100 12.1
Put the yellow block on the plate Easy Success 100 29.8
Put the screwdriver on the table Medium Success 100 23.0
Put the shirt on the table Very hard Failed 0 -
Put the marker on the plate Easy Success 100 23.0
Place the cube on the table Easy Success 100 14.1
Place the bowl on the plate Easy Success 100 12.1
Place the mug at the center of the table Hard Success 100 32.6
Put the towel inside the box Easy Success 100 13.0
Put the fork inside the open drawer Hard Safety stop 0 -
Put the blue block inside the open drawer then close the drawer Hard At target 40 -
Take the cloth and put it on the bowl Easy Success 100 109.6
Remove the towel from the middle drawer Hard Success 100 13.0
Remove the banana from the bowl Easy Success 100 10.8
Remove the red cup from the box Easy Success 100 12.5
Remove the fork from the bowl Easy Success 100 15.9
Take the mug off the plate and put it on the table Easy Success 100 13.7
Pick up the spoon from the bowl and put it in the box Hard Failed 0 -
Pick up the spoon from the bowl and put it in the cup Hard Control 30 -
Pick up the cup and put it on the plate Easy Success 100 10.7
Pick the fork and put it on the table Easy Success 100 15.3
Pick up the towel and place it on the table Hard Failed 0 -
Pick up the spoon and put it on the table Easy Success 100 11.8
Pick up the pen and put it on the table Hard Success 100 14.7
Pick up the cloth and put it on the drawer Hard Control 30 -
Pick up the blue cup and put it in the orange cup Easy Success 100 12.7
Pick up the cloth from the table and put it in the box Medium Success 100 237.8
Pick up the cloth and put it on the table Hard Success 100 58.9
Remove the marker from the cup and put it on the box Medium Success 100 29.7
Remove the lid from the storage box and put it on the table Medium Success 100 143.6
Take the spoon from the plate and put it on the table Easy Success 100 17.0
Remove the blocks from the bowl and put them on the table Easy Success 100 37.1
Remove the mug from the box and put it on the table Easy Success 100 21.3
Take the screwdriver from the box and put it on the table Medium Failed 0 -
Remove the marker from the box and place it on the table Medium Success 100 12.7
Remove the spoon from the bowl and put it on the table Medium Success 100 11.0
Remove the spoon from the cup and put it on the table Hard Control 30 -
Take the pen out of the bowl and put it on the table Easy Success 100 14.3
Take the pen out of the mug and put it on the table Hard Success 100 11.4
Put the marker on the towel, fold the towel, and then put the folded towel in the box Very hard Failed 0 -
Put the screwdriver in the drawer and close it Very hard Failed 0 -
Unfold the shirt Hard Contact 10 -
Fold the cloth Hard Control 30 -
Flip the cup over Medium Success 100 85.1
Close the drawer Hard Success 100 6.4
Move the bowl to the right Easy Success 100 13.0
Move the mug to the left Easy Success 100 19.4
Stack the cups Medium Control 30 -
Put the orange block on top of the green block Hard Success 100 42.8
Put the yellow block in the blue cup Medium Success 100 84.7
Put the fork on the plate Medium Failed 0 -
Put the cube in the bowl Medium Success 100 10.4
Put the spoon in the mug Hard At target 40 -
Put the pen in the cup Very hard Failed 0 -
Use the towel to wipe the table Hard Success 100 97.8
Fold the towel Hard Success 100 15.9
Move the cup to the right Easy Success 100 13.4
Move the cup to the left Easy Success 100 12.2
Close the box Very hard Failed 0 -
Put the marker on the table Medium Success 100 46.1
Put the yellow block in the cup Easy Success 100 14.5
Put the cup in the bowl Easy Success 100 12.6
Put the spoon in the bowl Very hard Failed 0 -
Put the marker in the bowl Medium Success 100 12.2
Put the marker in the cup Hard Success 100 23.1
Move the wooden block to the left Very hard Failed 0 -
Flip over the plate Hard Success 100 15.9
Put the sponge in the bowl Easy Success 100 10.9
Put the marker in the mug Hard Failed 0 -
Put the banana on the plate on the left Easy Success 100 13.0