Three-bucket tube sorting: fallen pile, stable sim, scripted expert

Updated 2026-09-18. Tubes start as a random heap of lying cylinders in the centre basket; the scripted expert sorts red to the left basket and blue to the right using physical grasps only (no teleporting or pinning of tubes). Every number below is read from the run's results.json.

Scripted expert, four-tube piles

4 of 4 worlds fully sorted, 4 of 4 physically valid (no wall contact above 0.05 N, pad penetration under 3 mm).

episode_001_world0.mp4

episode_002_world2.mp4

episode_003_world3.mp4

episode_004_world1.mp4

worldtubessortedtimevalidmax pad penetrationwall contact
044/448 syes0.4 mmno
144/454 syes0.5 mmno
244/450 syes0.4 mmno
344/453 syes0.4 mmno

Scripted expert, ten-tube piles

40 of 40 tubes sorted across 4 worlds; 4 of 4 worlds fully sorted; 1 of 4 pass the strict validity gate. Wall-hugging tubes are first nudged off the wall with the closed pads, then grasped.

episode_001_world0.mp4

episode_002_world1.mp4

episode_003_world3.mp4

episode_004_world2.mp4

worldtubessortedtimevalidmax pad penetrationwall contact
01010/10146 sno3.5 mmyes
11010/10150 sno3.0 mmno
21010/10166 sno3.2 mmyes
31010/10153 syes2.7 mmno

Starting-state stability

A world counts as settled when, with the arm still for 5 s, in the last second no tube leaves the basket, none moves faster than 20 mm/s or drifts more than 3 mm, and no tube contact penetrates more than 3 mm. Baseline (previous physics): 22/72 worlds settled with tube penetration up to 5 cm. Current physics and layout: 66/72 worlds settled, 0 tubes ejected during the drop.

casesettledejectedtail speed maxtail penetration max
nominal-48/800.2 mm/s0.1 mm
nominal-108/801.9 mm/s0.2 mm
dr-46/8033.3 mm/s0.8 mm
dr-78/807.1 mm/s0.2 mm
dr-107/80244.7 mm/s0.4 mm
fat-long-heavy-106/80271.4 mm/s0.7 mm
thin-short-light-108/802.8 mm/s0.2 mm
small-basket-78/8013.3 mm/s0.2 mm
wide-basket-107/8071.9 mm/s0.2 mm

Settling clip (ten tubes, full randomization):

What changed: capsule colliders instead of cylinders (cylinder pairs get one contact point in MuJoCo Warp and rock), contact time constant 0.04 s to 0.01 s (steady-state penetration under gravity fell from ~1.6 cm to ~1 mm), zero collision margin, zero free-joint damping and armature (the old values froze the tubes' rotation), rolling friction, non-overlapping layered spawn, and a 380×128 mm centre basket so the RG2 fingers have room. Full report: stability README, matrix JSON.

Earlier material (superseded)

The ACT policy videos and the earlier "fallen pile" clips previously on this page were produced with the unstable physics and, in one case, a scripted grasp lock. They are kept for provenance only: ACT world 0, tipped-pile 4/4 (small tilt), 90° pile (0/4, unstable). The ACT policy has not been retrained on the new task yet.

Export README · Control contract · Manifest · Old ACT evaluation summary