MODEL
Genie3
Google DeepMind
PLAYER-GUIDED EVALUATION FOR INTERACTIVE WORLD MODELS
PlayWorld
Benchmarking World Models with Agent Players over Long-Horizon Objectives
171Cases
1,417Videos
10–60sRollouts
9+Models
01 / CURATED MODEL ROLLOUTS
Model demos.
Geometry Consistency60.1s
02 / FULL PLAYER PROCESS
Full Player process.
Complete recordings from world creation to adaptive action execution and final result preservation.
MODEL
HappyOyster
Alibaba
MODEL
HY-World2
Tencent
03 / PIPELINE
Pipeline.
NO HUMAN OPERATIONFULLY AUTOMATED EVALUATION
The Engine enters the initial-world condition, waits for the generated world to become interactive, dispatches controls and captures observations for the Player’s online decisions, then terminates the episode while preserving the final video and execution record.
Comparison of world-model evaluation benchmarks
✓ full coverage · ✕ no coverage · ~ partial coverage
| Benchmark | Input | Closed-loop adaptation | Long-horizon revisit | Geometry consistency | State evolution | Interaction fidelity | Time scale / video |
|---|---|---|---|---|---|---|---|
| WorldScore | Text + Image + Camera | ✕ | ✕ | ✓ | ✕ | ✕ | ~2–10 s |
| WorldMark | Image + Action | ✕ | ~ | ✓ | ✕ | ✕ | 20 / 40 / 60 s |
| WBench | Text + Image + Camera / Action | ✕ | ~ | ✓ | ~ | ✓ | 10–45 s |
| WorldRoamBench | Image + Action | ✕ | ~ | ✓ | ~ | ✓ | 10–60 s |
| MemoBench | Text + Image + Camera | ✕ | ✕ | ✓ | ✓ | ✕ | 4–6 s |
| Omni-WorldBench | Text + Image + Camera | ✕ | ✕ | ~ | ✓ | ✓ | 3–6 s |
| PlayWorld (Ours) | Text + Image + Objective | ✓ | ✓ | ✓ | ✓ | ✓ | 10–60 s |