Shot‑5.1.1 · MuJoCo · causal live captioning · LeRobot episodes

robot learning arcade

Choose a seeded robot game, teleoperate the main character, and watch grounded captions and a goal-conditioned coach respond while you play.

connecting locally
Select a task family

Choose your mission

Every game shares the same teleoperation, temporal evidence, live-caption, recording, and replay interfaces.

why this toy exists

make the boring middle of robot learning hurt less.

turn game runs into comparable episodes and candidate stability flags before another physical iteration—a tiny crack at making progress together.

  1. 01gameplay + record
  2. 02comparable dataharmonize
  3. 03candidate flagsscreen together
  4. 04owner decisionhand back
methods + limits

preserve provenance; map schema, missingness, units, timing, frames, and action meaning; compare matched state/action traces; cluster correlated anomalies; keep uncertainty and abstention visible. this is hypothesis-generating decision support—not retraining, hardware approval, or a stability promise. the experienced owner judges any staged physical test.

Choose a playable mission to begin locally.

Live robot game arena

World—
Seed—
Time0.0s
Score1000
G1 PILOTshot-1 avatar · input-linked
MUJOCO · LIVE FORCES
SEEDED PROCEDURAL TASK
JIMINY · LIVEgoal + observation → local response
I’ll watch the goal and help you choose the next small move.

Goal critic: waiting for grounded simulator evidence.

OBSERVE
Waiting for the local simulation… Caption evidence will appear here.
Teleop View
Deterministic local instruction router—not a trained policy.
W ASD

Drag the humanoid, click a destination, or steer with WASD. Every game records the same bounded [x, y, rotate, gripper] action. Use Q/E to rotate and Space to grasp or release. A gamepad also works. Press R to replay the seed, N for the next one, P to pause, and Esc for a safe stop.