pith. sign in

arxiv: 2602.15922 · v1 · submitted 2026-02-17 · 💻 cs.RO · cs.CV· cs.LG

World Action Models are Zero-shot Policies

Seonghyeon Ye , Yunhao Ge , Kaiyuan Zheng , Shenyuan Gao , Sihyun Yu , George Kurian , Suneel Indupuru , You Liang Tan
show 28 more authors
Chuning Zhu Jiannan Xiang Ayaan Malik Kyungmin Lee William Liang Nadun Ranawaka Jiasheng Gu Yinzhen Xu Guanzhi Wang Fengyuan Hu Avnish Narayan Johan Bjorck Jing Wang Gwanghyun Kim Dantong Niu Ruijie Zheng Yuqi Xie Jimmy Wu Qi Wang Ryan Julian Danfei Xu Yilun Du Yevgen Chebotar Scott Reed Jan Kautz Yuke Zhu Linxi "Jim" Fan Joel Jang
This is my paper

Pith reviewed 2026-05-11 16:10 UTC · model grok-4.3

classification 💻 cs.RO cs.CVcs.LG
keywords World Action Modelsvideo diffusionzero-shot robot policiesvision-language-action modelscross-embodiment transferphysical dynamicsreal-time robot controlheterogeneous robot data
0
0 comments X

The pith

World Action Models serve as zero-shot policies by jointly predicting future video states and actions from heterogeneous data.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper presents DreamZero as a World Action Model that learns physical dynamics directly from video and action pairs instead of relying on language instructions or repetitive demonstrations. By building on a pretrained video diffusion model, it treats video as a dense signal of how the world changes under actions, allowing the system to generalize across new tasks, environments, and even robot bodies. This produces more than double the success rate on unseen scenarios compared with prior vision-language-action approaches while still running closed-loop control in real time. The same model further supports rapid transfer: video demonstrations from other robots or humans boost performance on new tasks, and only thirty minutes of play data suffice to adapt to an entirely new embodiment without losing zero-shot capability. The central insight is that modeling the visual evolution of the world supplies the physical knowledge needed for policies that work without task-specific retraining.

Core claim

World Action Models are zero-shot policies because they learn physical dynamics by predicting future world states, represented densely as video, together with the corresponding actions, trained jointly on heterogeneous robot datasets without requiring repetitive demonstrations of individual skills.

What carries the argument

DreamZero, a World Action Model built on a pretrained video diffusion backbone that jointly autoregressively models future video frames and actions to produce closed-loop robot control.

If this is right

  • Yields more than twice the generalization success rate on new tasks and environments versus state-of-the-art vision-language-action models in real-robot trials.
  • Enables real-time closed-loop control at 7 Hz from a 14-billion-parameter autoregressive video diffusion model after targeted optimizations.
  • Video-only demonstrations from other robots or humans deliver over 42 percent relative improvement on unseen tasks using only 10-20 minutes of additional data.
  • Supports few-shot embodiment adaptation: 30 minutes of play data on a new robot body suffices for transfer while zero-shot generalization to new tasks is retained.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Treating future video as the primary training signal may reduce dependence on curated action labels across many robotics domains.
  • The approach could extend to settings like autonomous navigation where scene evolution is more important than discrete commands.
  • Rapid embodiment transfer with minimal data suggests that large video models can serve as reusable physical priors for many hardware platforms.
  • Performance gains arise from dense visual supervision rather than from language or sparse reward signals.

Load-bearing premise

The assumption that video and action pairs drawn from mixed robot sources already contain enough information about physical dynamics to generalize to motions and environments never seen in training.

What would settle it

A controlled test showing that the model cannot produce correct actions or accurate future video predictions for a physically novel interaction, such as manipulating an object type or surface never present in the training videos.

read the original abstract

State-of-the-art Vision-Language-Action (VLA) models excel at semantic generalization but struggle to generalize to unseen physical motions in novel environments. We introduce DreamZero, a World Action Model (WAM) built upon a pretrained video diffusion backbone. Unlike VLAs, WAMs learn physical dynamics by predicting future world states and actions, using video as a dense representation of how the world evolves. By jointly modeling video and action, DreamZero learns diverse skills effectively from heterogeneous robot data without relying on repetitive demonstrations. This results in over 2x improvement in generalization to new tasks and environments compared to state-of-the-art VLAs in real robot experiments. Crucially, through model and system optimizations, we enable a 14B autoregressive video diffusion model to perform real-time closed-loop control at 7Hz. Finally, we demonstrate two forms of cross-embodiment transfer: video-only demonstrations from other robots or humans yield a relative improvement of over 42% on unseen task performance with just 10-20 minutes of data. More surprisingly, DreamZero enables few-shot embodiment adaptation, transferring to a new embodiment with only 30 minutes of play data while retaining zero-shot generalization.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

3 major / 1 minor

Summary. The manuscript introduces DreamZero, a World Action Model (WAM) built upon a pretrained 14B autoregressive video diffusion backbone. Unlike Vision-Language-Action (VLA) models, it jointly predicts future video states and actions to learn physical dynamics from heterogeneous robot data without repetitive demonstrations. The paper claims over 2x improvement in generalization to new tasks and environments versus SOTA VLAs in real-robot experiments, real-time closed-loop control at 7 Hz, and two forms of cross-embodiment transfer (video-only demos yielding >42% relative improvement with 10-20 minutes of data; few-shot adaptation to new embodiments with 30 minutes of play data while retaining zero-shot performance).

Significance. If the empirical results hold under rigorous controls, this would be a notable contribution to robot learning by showing that video-based world modeling can deliver substantially better zero-shot generalization and embodiment transfer than current VLAs, while achieving practical real-time inference speeds. The concrete real-robot numbers and cross-embodiment results provide tangible evidence of impact for reducing data requirements in robotics.

major comments (3)
  1. [Abstract] Abstract: The headline claim of 'over 2x improvement in generalization to new tasks and environments' is load-bearing for the central thesis but provides no details on evaluation metrics, exact baselines, number of trials, statistical significance, or how test environments isolate novel physical dynamics (e.g., changed mass/friction) from visual or semantic changes. This prevents verification that gains arise from the WAM dynamics modeling rather than other factors.
  2. [Abstract] Abstract: The statement that the model 'learns physical dynamics' and generalizes to 'unseen motions and environments' from heterogeneous data 'without relying on repetitive demonstrations' requires supporting evidence such as dataset statistics on motion diversity, ablations removing repetitive patterns, or explicit tests with altered dynamics parameters; without these, the weakest assumption identified in the stress-test remains unaddressed.
  3. [Abstract] Abstract: The practicality claim that 'model and system optimizations' enable a 14B model to run real-time closed-loop control at 7 Hz is central to the contribution but does not specify the optimizations (e.g., distillation, caching, hardware acceleration), making it impossible to assess reproducibility or the extent to which the result depends on engineering rather than the WAM formulation.
minor comments (1)
  1. [Abstract] The introduction of the term 'World Action Model (WAM)' would benefit from a clearer positioning against prior video-prediction or world-model literature to highlight novelty.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for the constructive feedback. We address each major comment below and agree that the abstract can be strengthened for clarity while the full manuscript already contains the supporting details. We will revise the abstract accordingly.

read point-by-point responses

  1. Referee: The headline claim of 'over 2x improvement in generalization to new tasks and environments' is load-bearing for the central thesis but provides no details on evaluation metrics, exact baselines, number of trials, statistical significance, or how test environments isolate novel physical dynamics (e.g., changed mass/friction) from visual or semantic changes. This prevents verification that gains arise from the WAM dynamics modeling rather than other factors.

    Authors: We agree the abstract would benefit from added context on these points. The full manuscript (Experiments section) details the metrics (task success rates), baselines (state-of-the-art VLAs), trial counts, statistical tests, and environment designs that vary physical parameters such as mass and friction while controlling for visual and semantic factors. We will revise the abstract to briefly reference these evaluation controls. revision: yes

  2. Referee: The statement that the model 'learns physical dynamics' and generalizes to 'unseen motions and environments' from heterogeneous data 'without relying on repetitive demonstrations' requires supporting evidence such as dataset statistics on motion diversity, ablations removing repetitive patterns, or explicit tests with altered dynamics parameters; without these, the weakest assumption identified in the stress-test remains unaddressed.

    Authors: The manuscript provides dataset statistics on motion diversity across heterogeneous sources, ablations demonstrating the value of non-repetitive data, and explicit tests with altered dynamics parameters. We will add a concise reference to these supporting analyses in the abstract. revision: yes

  3. Referee: The practicality claim that 'model and system optimizations' enable a 14B model to run real-time closed-loop control at 7 Hz is central to the contribution but does not specify the optimizations (e.g., distillation, caching, hardware acceleration), making it impossible to assess reproducibility or the extent to which the result depends on engineering rather than the WAM formulation.

    Authors: We agree that specifying the optimizations would improve the abstract. The full paper describes the model and system optimizations (including distillation, caching, and hardware acceleration) that enable 7 Hz inference. We will update the abstract to name the primary optimizations for reproducibility. revision: yes

Circularity Check

0 steps flagged

No circularity; empirical claims rest on robot experiments

full rationale

The paper introduces DreamZero as a World Action Model trained on heterogeneous robot data to predict video and actions, with all headline results (2x generalization, 7Hz control, cross-embodiment transfer) presented as outcomes of real-robot experiments rather than any mathematical derivation. No equations, fitted parameters renamed as predictions, self-definitional loops, or load-bearing self-citations appear in the provided text. The central premise that joint video-action modeling yields transferable physical dynamics is tested externally via held-out tasks and embodiments, making the evaluation chain self-contained and falsifiable outside the paper's own definitions.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 1 invented entities

The central claim rests on the premise that video serves as a sufficient dense representation of physical dynamics and that heterogeneous data can be used without task-specific repetition. No explicit free parameters are named in the abstract, but the 14B model size and diffusion backbone choice function as implicit design decisions.

axioms (1)
  • domain assumption Video is a dense representation of how the world evolves under actions.
    Stated directly in the abstract as the basis for learning physical dynamics.
invented entities (1)
  • World Action Model (WAM) no independent evidence
    purpose: A model that jointly predicts future video states and actions to serve as a zero-shot policy.
    New framing introduced in the paper; no independent evidence provided beyond the reported experiments.

pith-pipeline@v0.9.0 · 5661 in / 1466 out tokens · 49135 ms · 2026-05-11T16:10:07.831346+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 60 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. HABIT: Human-Aware Behavior and Interaction Training Dataset for Robot Manipulation

    cs.RO 2026-06 unverdicted novelty 8.0

    HABIT is a large-scale robot demonstration dataset for human-present environments that elicits spatiotemporal synchronization, yielding, and gesture grounding behaviors absent from robot-only training data.

  2. Open-H-Embodiment: A Large-Scale Dataset for Enabling Foundation Models in Medical Robotics

    cs.RO 2026-04 conditional novelty 8.0

    Open-H-Embodiment is the largest open multi-embodiment medical robotics dataset, used to train GR00T-H, the first open vision-language-action model that achieves end-to-end suturing completion where prior models fail.

  3. Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots

    cs.RO 2026-07 unverdicted novelty 7.0

    Embodied.cpp introduces a portable C++ inference runtime with modular layers for deploying VLA and WAM models on heterogeneous robots, reporting 100% and 91% task success on two models plus memory reduction on a WAM b...

  4. DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulation

    cs.RO 2026-06 unverdicted novelty 7.0

    DVG-WM disentangles dynamics learning and visual synthesis in video world models using flow matching and latent degradation to achieve faster inference up to 3.97 times with improved quality on LIBERO and real-world r...

  5. Pondering the Way: Spatial-perceiving World Action Model for Embodied Navigation

    cs.RO 2026-06 unverdicted novelty 7.0

    SWAM jointly generates intermediate RGB-D sequences and action trajectories from monocular RGB start/goal observations for embodied navigation.

  6. The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks

    cs.RO 2026-06 unverdicted novelty 7.0

    TISED framework reveals paradoxical effects where inference optimizations can lengthen task completion time on static tasks or raise success rates on dynamic tasks in embodied AI.

  7. World Action Models Enable Continual Imitation Learning with Recurrent Generative Replays

    cs.RO 2026-06 unverdicted novelty 7.0

    REGEN uses recurrent generative replays from World Action Models to cut catastrophic forgetting by up to 50% in continual imitation learning compared to sequential fine-tuning.

  8. HumanScale: Egocentric Human Video Can Outperform Real-Robot Data for Embodied Pretraining

    cs.CV 2026-06 unverdicted novelty 7.0

    Processed egocentric human video outperforms teleoperated real-robot trajectories as pretraining data for embodied foundation models, delivering 24% lower validation loss and 52.5-90% higher task success rates under m...

  9. Improving Robotic Generalist Policies via Flow Reversal Steering

    cs.RO 2026-06 unverdicted novelty 7.0

    Flow Reversal Steering steers flow matching generalist policies by reversing suboptimal actions to nearby better modes, enabling improved zero-shot control, quick distillation, and RL bootstrapping in robotic manipulation.

  10. FTP-1: A Generalist Foundation Tactile Policy Across Tactile Sensors for Contact-Rich Manipulation

    cs.RO 2026-06 unverdicted novelty 7.0

    FTP-1 is the first foundation tactile policy pretrained on ~3000 hours of data from 26 sources across 21 sensors that improves performance on seen setups by 17.2% and transfers to unseen sensors with 31% success rate gain.

  11. UMI-Bench 1.0: An Open and Reproducible Real-World Benchmark for Tabletop Robotic Manipulation with UMI Data

    cs.RO 2026-06 unverdicted novelty 7.0

    UMI-Bench 1.0 is presented as the first open benchmark dedicated to reproducible real-world evaluation of Universal Manipulation Interface policies.

  12. ActProbe: Action-Space Probe for Early Failure Detection of Generative Robot Policies

    cs.RO 2026-06 unverdicted novelty 7.0

    ActProbe is an action-space detector that uses temporal consistency error and action chunk magnitude from policy outputs, mapped via LSTM-MLP, to predict failures earlier than baselines across policies and real-robot tasks.

  13. VoLo: A Physical Orchestrator for Open-Vocabulary Long-Horizon Manipulation

    cs.RO 2026-06 unverdicted novelty 7.0

    VoLoAgent uses a VLM to steer heterogeneous robot capabilities as interruptible tools for long-horizon manipulation and introduces the RoboVoLo benchmark, claiming substantial outperformance over single VLA/VLM or too...

  14. ActionMap: Robot Policy Learning via Voxel Action Heatmap

    cs.RO 2026-06 unverdicted novelty 7.0

    ActionMap introduces a voxel heatmap action head for VLA models that improves policy learning by exploiting geometric structure in the action space.

  15. Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation?

    cs.CV 2026-06 unverdicted novelty 7.0

    Dream.exe evaluates 8 video generation models on 101 manipulation tasks by converting generated videos into executable robot trajectories in a simulator, finding measurable success rates that visual metrics do not predict.

  16. World Models as Group Actions

    cs.CV 2026-05 unverdicted novelty 7.0

    Formalizes video world models as group actions on states and uses latent regularization with synthesized supervision to enforce consistency, introducing GAC and GAR metrics that improve structural correctness in SOTA models.

  17. Point Tracking Improves World Action Models

    cs.RO 2026-05 unverdicted novelty 7.0

    JOPAT jointly models pixels, point tracks, and actions in a diffusion transformer and reports gains over pixel-only baselines on long-horizon robot tasks with occlusion and off-screen motion.

  18. GaussianDream: A Feed-Forward 3D Gaussian World Model for Robotic Manipulation

    cs.RO 2026-05 unverdicted novelty 7.0

    GaussianDream is a feed-forward 3D Gaussian world model that provides structured spatial-temporal supervision for VLA-based robotic manipulation by predicting future Gaussian states during training.

  19. WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigation

    cs.RO 2026-05 unverdicted novelty 7.0

    WorldVLN proposes the first autoregressive world action model for aerial vision-language navigation that predicts short-horizon latent world states, decodes them to waypoints in closed loop, and uses two-stage trainin...

  20. CreFlow: Corrective Reflow for Sparse-Reward Embodied Video Diffusion RL

    cs.CV 2026-05 conditional novelty 7.0

    CreFlow combines LTL compositional rewards with credit-aware NFT and corrective reflow losses in online RL to improve embodied video diffusion models, raising downstream task success by 23.8 percentage points on eight...

  21. From Imagined Futures to Executable Actions: Mixture of Latent Actions for Robot Manipulation

    cs.RO 2026-05 unverdicted novelty 7.0

    MoLA infers a mixture of latent actions from generated future videos via modality-aware inverse dynamics models to improve robot manipulation policies.

  22. ALAM: Algebraically Consistent Latent Action Model for Vision-Language-Action Models

    cs.RO 2026-05 unverdicted novelty 7.0

    ALAM creates algebraically consistent latent action transitions from videos to act as auxiliary generative targets, raising robot policy success rates from 47.9% to 85.0% on MetaWorld MT50 and 94.1% to 98.1% on LIBERO.

  23. ACWM-Phys: Investigating Generalized Physical Interaction in Action-Conditioned Video World Models

    cs.CV 2026-05 unverdicted novelty 7.0

    ACWM-Phys is a controllable simulator benchmark with in- and out-of-distribution protocols for evaluating action-conditioned world models across rigid, kinematic, deformable, and particle dynamics.

  24. NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models

    cs.RO 2026-05 unverdicted novelty 7.0

    NoiseGate learns per-latent timestep schedules as an information-gating policy in diffusion-based world action models, yielding consistent gains on RoboTwin manipulation tasks.

  25. OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation

    cs.RO 2026-05 unverdicted novelty 7.0

    OA-WAM uses persistent address vectors and dynamic content vectors in object slots to enable addressable world-action prediction, improving robustness on manipulation benchmarks under scene changes.

  26. EA-WM: Event-Aware Generative World Model with Structured Kinematic-to-Visual Action Fields

    cs.CV 2026-05 unverdicted novelty 7.0

    EA-WM generates more accurate robot world rollouts by projecting actions as structured visual fields in camera space and using event-aware bidirectional fusion to better capture interaction dynamics.

  27. Being-H0.7: A Latent World-Action Model from Egocentric Videos

    cs.RO 2026-04 unverdicted novelty 7.0

    Being-H0.7 adds future-aware latent reasoning to direct VLA policies via dual-branch alignment on latent queries, matching world-model benefits at VLA efficiency.

  28. Open-H-Embodiment: A Large-Scale Dataset for Enabling Foundation Models in Medical Robotics

    cs.RO 2026-04 unverdicted novelty 7.0

    A consortium released the largest open medical robotics dataset spanning 50+ institutions and used it to train an open VLA model achieving 25% full suturing completion and a multi-embodiment surgical world model.

  29. ${\pi}_{0.7}$: a Steerable Generalist Robotic Foundation Model with Emergent Capabilities

    cs.LG 2026-04 unverdicted novelty 7.0

    π₀.₇ is a steerable generalist robotic model that uses rich multimodal prompts including language, subgoal images, and performance metadata to achieve out-of-the-box generalization across tasks and robot bodies.

  30. ViVa: A Video-Generative Value Model for Robot Reinforcement Learning

    cs.RO 2026-04 unverdicted novelty 7.0

    ViVa turns a video generator into a value model for robot RL that jointly forecasts future states and task value, yielding better performance on real-world box assembly when integrated with RECAP.

  31. MoRight: Motion Control Done Right

    cs.CV 2026-04 unverdicted novelty 7.0

    MoRight disentangles object and camera motion via canonical-view specification and temporal cross-view attention, while decomposing motion into active user-driven and passive consequence components to learn and apply ...

  32. Action Images: End-to-End Policy Learning via Multiview Video Generation

    cs.CV 2026-04 unverdicted novelty 7.0

    Action Images turn robot arm motions into interpretable multiview pixel videos, letting video backbones serve as zero-shot policies for end-to-end robot learning.

  33. VT-WAM: Visual-Tactile World Action Model for Contact-Rich Manipulation

    cs.RO 2026-07 unverdicted novelty 6.0

    VT-WAM jointly predicts visual futures, tactile deformation, and actions via flow matching with Asymmetric MoT attention and contact-gated AVTAG, reporting 71.67% success on six real-world contact-rich tasks.

  34. ACID: Action Consistency via Inverse Dynamics for Planning with World Models

    cs.RO 2026-07 unverdicted novelty 6.0

    ACID improves decision-time planning in world models by adding per-step action consistency residuals from an inverse dynamics model to the planning cost via an adaptive weight, yielding better performance with less co...

  35. VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment

    cs.CV 2026-07 unverdicted novelty 6.0

    VLAFlow shows that combining language-supervised co-training with future latent alignment produces the most stable transfer performance for vision-language-action models trained on mixed robot data.

  36. ROSA: A Robotics Foundation Model Serving System for Robot Factories

    cs.RO 2026-07 unverdicted novelty 6.0

    ROSA introduces shared GPU-pool serving, robotics-aware abstractions for multi-model pipelines, and factory-productivity scheduling that improves output by up to 12.06x over dedicated per-robot systems.

  37. RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluation

    cs.RO 2026-07 unverdicted novelty 6.0

    RoboWorld introduces an automated pipeline using autoregressive video world models and task-progress VLM scoring, plus Step Forcing for long-horizon stability, to achieve high correlation with real robot policy evaluation.

  38. ABot-M0.5: Unified Mobility-and-Manipulation World Action Model

    cs.CV 2026-07 unverdicted novelty 6.0

    ABot-M0.5 proposes a unified mobility-and-manipulation world action model using three alignment strategies that achieves state-of-the-art performance on mobile and fine-grained manipulation benchmarks.

  39. The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks

    cs.RO 2026-06 unverdicted novelty 6.0

    TISED decomposes inference optimization effects on embodied tasks and identifies paradoxical outcomes where faster per-step inference can increase task completion time on static tasks or raise success rates on dynamic tasks.

  40. SimFoundry: Modular and Automated Scene Generation for Policy Learning and Evaluation

    cs.RO 2026-06 unverdicted novelty 6.0

    SimFoundry automates zero-shot real-to-sim scene generation from video, producing digital twins and cousins that enable policy training with 0.911 mean Pearson correlation to real-world results and 17-40% success gain...

  41. Translation as a Bridging Action: Transferring Manipulation Skills from Humans to Robots

    cs.RO 2026-06 unverdicted novelty 6.0

    A relative wrist translation bridging action with a vision-language-action model using interleaved tokens and attention masking transfers human manipulation skills to robots more effectively than 6DoF actions.

  42. LocalNav: Distilling Frontier VLMs and Embodied RL for On-Device Object Goal Navigation

    cs.RO 2026-06 unverdicted novelty 6.0

    Distillation from frontier VLMs plus E-RLVR regularization produces a 4B local model that achieves 34.5% SR on OVON while cutting inference latency by 82.8%.

  43. DIM-WAM: World-Action Modeling with Diverse Historical Event Memory

    cs.RO 2026-06 unverdicted novelty 6.0

    DiM-WAM is a memory-augmented world-action model that integrates multi-scale historical events and global task progress to improve long-horizon robot manipulation performance.

  44. Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention

    cs.RO 2026-06 unverdicted novelty 6.0

    Tactile-WAM with TAAM improves mean success rate by 38.9% overall and 86% on contact-rich tasks on ManiFeel by using VideoClean mask and touch-aware bias to prevent tactile pollution in world action models.

  45. Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priors

    cs.LG 2026-06 unverdicted novelty 6.0

    Argues for shifting to diagnosis-driven tension management of offline priors in online RL, supported by a framework on prior roles, experiments showing help-or-hurt reversals, and cross-domain evidence.

  46. Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models

    cs.CV 2026-06 unverdicted novelty 6.0

    Causal-rCM unifies teacher-forcing and self-forcing distillation for autoregressive video diffusion, delivering a 2-step model with VBench-T2V score 84.63 and enabling interactive world models on Cosmos 3 using only s...

  47. SPACE: Enabling Learning from Cross-Robot Data Toward Generalist Policies

    cs.RO 2026-06 unverdicted novelty 6.0

    SPACE trains a Cartesian state-delta policy plus an Action Adapter to learn generalist robot policies from cross-embodiment and cross-hardware data while remaining robust to dynamics changes.

  48. A Watermark for Vision-Language-Action and World Action Models

    cs.CR 2026-06 unverdicted novelty 6.0

    A method to fingerprint VLA and WAM policies by keyed Gaussian noise seeds enables reliable ownership verification from partial outputs with minimal performance impact.

  49. Wh0: Generative World Models as Scalable Sources of Egocentric Human Hand Manipulation Data

    cs.RO 2026-06 unverdicted novelty 6.0

    Wh0 generates scalable egocentric human manipulation videos with world models and converts them to boost pretrained VLA models' zero-shot dexterous task success from 8.3% to 38.9% on 18 real-world tasks.

  50. Vesta: A Generalist Embodied Reasoning Model

    cs.RO 2026-06 unverdicted novelty 6.0

    Vesta is a unified embodied generalist model that outperforms specialist baselines by over 20% on average and improves real-world robotic task success by over 35%.

  51. ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?

    cs.CV 2026-06 unverdicted novelty 6.0

    ImageWAM shows image editing models can replace video generation in world action models, delivering better performance with 6x lower FLOPs and 4x lower latency by using edit-derived KV caches as compact context.

  52. Mem-World: Memory-Augmented Action-Conditioned World Models for Persistent Robot Manipulation

    cs.CV 2026-06 unverdicted novelty 6.0

    Mem-World augments world models with W-VMem, a wrist-view-centered surfel memory, to generate persistent action-conditioned video rollouts that improve policy evaluation correlation by 14.5% and raise task success fro...

  53. SC3-Eval: Evaluating Robot Foundation Models via Self-Consistent Video Generation

    cs.RO 2026-06 unverdicted novelty 6.0

    SC3-Eval enforces three consistencies on a video model to produce policy rollouts that correlate 0.929 with real-world performance across seven vision-language-action policies and reproduce observed failure modes.

  54. SC3-Eval: Evaluating Robot Foundation Models via Self-Consistent Video Generation

    cs.RO 2026-06 unverdicted novelty 6.0

    SC3-Eval enforces three consistency constraints on video world models to evaluate robot manipulation policies, achieving 0.929 Pearson correlation with real-world rollouts across seven policies.

  55. AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulation

    cs.RO 2026-06 unverdicted novelty 6.0

    AnnotateAnything converts passive 3D assets into manipulation-ready assets by combining vision-language reasoning for semantics with parallel physics pipelines for executable action annotations such as grasps and arti...

  56. T-Rex: Tactile-Reactive Dexterous Manipulation

    cs.RO 2026-06 unverdicted novelty 6.0

    T-Rex introduces a large tactile dataset and MoT architecture that achieves over 30% higher success rates than baselines on 12 tasks requiring force control and deformable object handling.

  57. Geometric Action Model for Robot Policy Learning

    cs.RO 2026-06 unverdicted novelty 6.0

    GAM splits a geometric foundation model to enable language-conditioned future geometry prediction and action decoding for robot policies, claiming superior performance on manipulation benchmarks.

  58. RepWAM: World Action Modeling with Representation Visual-Action Tokenizers

    cs.CV 2026-06 unverdicted novelty 6.0

    RepWAM introduces representation visual-action tokenizers to pretrain world action models that jointly model future visual states and latent actions under instructions for improved robot manipulation.

  59. MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models

    cs.CV 2026-06 unverdicted novelty 6.0

    MaskWAM unifies mask prompting and prediction in world-action models via Mixture of Transformers to improve robotic policy generalization on language-ambiguous tasks.

  60. Learning to Assist: Collaborative VLAs for Implicit Human-Robot Collaboration

    cs.RO 2026-06 conditional novelty 6.0

    VLA models with inference-time steering mitigate action leakage in implicit human-robot collaboration, supporting longer horizons and yielding faster, more reliable assembly than shorter-horizon baselines in a 16-pers...

Reference graph

Works this paper leans on

91 extracted references · 91 canonical work pages · cited by 156 Pith papers · 46 internal anchors

  1. [1]

    Stochastic Interpolants: A Unifying Framework for Flows and Diffusions

    Michael S Albergo, Nicholas M Boffi, and Eric Vanden-Eijnden. Stochastic interpolants: A unifying framework for flows and diffusions.arXiv preprint arXiv:2303.08797, 2023. 7

    work page internal anchor Pith review arXiv 2023

  2. [2]

    World Simulation with Video Foundation Models for Physical AI

    Arslan Ali, Junjie Bai, Maciej Bala, Yogesh Balaji, Aaron Blakeman, Tiffany Cai, Jiaxin Cao, Tianshi Cao, Elizabeth Cha, Yu-Wei Chao, et al. World simulation with video foundation models for physical ai.arXiv preprint arXiv:2511.00062, 2025. 7

    work page internal anchor Pith review arXiv 2025

  3. [3]

    Self-supervised learning from images with a joint-embedding predictive architecture

    Mahmoud Assran, Quentin Duval, Ishan Misra, Piotr Bojanowski, Pascal Vincent, Michael Rabbat, Yann LeCun, and Nicolas Ballas. Self-supervised learning from images with a joint-embedding predictive architecture. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023. 20

    work page 2023

  4. [4]

    V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning

    Mido Assran, Adrien Bardes, David Fan, Quentin Garrido, Russell Howes, Mojtaba Komeili, Matthew Muckley, Ammar Rizvi, Claire Roberts, Koustuv Sinha, et al. V-JEPA 2: Self-supervised video models enable understanding, prediction and planning.arXiv preprint arXiv:2506.09985, 2025. 5, 20

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  5. [5]

    Philip J. Ball, Jakob Bauer, Frank Belletti, Bethanie Brownfield, Ariel Ephrat, Shlomi Fruchter, Agrim Gupta, Kristian Holsheimer, Aleksander Holynski, Jiri Hron, Christos Kaplanis, Marjorie Limont, Matt McGill, Yanko Oliveira, Jack Parker-Holder, Frank Perbet, Guy Scully, Jeremy Shar, Stephen Spencer, Omer Tov, Ruben Villegas, Emma Wang, Jessica Yung, Ci...

    work page 2025

  6. [6]

    V-JEPA: Video joint embedding predictive architecture.arXiv preprint arXiv:2402.05065, 2024

    Adrien Bardes, Quentin Garrido, Jean Ponce, Michael Rabbat, Yann LeCun, Mahmoud Assran, and Nicolas Ballas. V-JEPA: Video joint embedding predictive architecture.arXiv preprint arXiv:2402.05065, 2024. 20

    work page arXiv 2024

  7. [7]

    A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulation

    Jose Barreiros, Andrew Beaulieu, Aditya Bhat, Rick Cory, Eric Cousineau, Hongkai Dai, Ching-Hsin Fang, Kunimatsu Hashimoto, Muhammad Zubair Irshad, Masha Itkina, et al. A careful examination of large behavior models for multitask dexterous manipulation.arXiv preprint arXiv:2507.05331, 2025. 13

    work page internal anchor Pith review arXiv 2025

  8. [8]

    Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulation

    Homanga Bharadhwaj, Debidatta Dwibedi, Abhinav Gupta, Shubham Tulsiani, Carl Doersch, Ted Xiao, Dhruv Shah, Fei Xia, Dorsa Sadigh, and Sean Kirmani. Gen2act: Human video generation in novel scenarios enables generalizable robot manipulation.arXiv preprint arXiv:2409.16283, 2024. 5

    work page internal anchor Pith review arXiv 2024

  9. [9]

    GR00T N1: An Open Foundation Model for Generalist Humanoid Robots

    Johan Bjorck, Fernando Castañeda, Nikita Cherniadev, Xingye Da, Runyu Ding, Linxi Fan, Yu Fang, Dieter Fox, Fengyuan Hu, Spencer Huang, et al. Gr00t n1: An open foundation model for generalist humanoid robots.arXiv preprint arXiv:2503.14734, 2025. 2, 4, 10, 18

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  10. [11]

    $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control

    Kevin Black, Noah Brown, Danny Driess, Adnan Esmail, Michael Equi, Chelsea Finn, Niccolo Fusai, Lachy Groom, Karol Hausman, Brian Ichter, et al.𝜋0: A vision-language-action flow model for general robot control.URL https://arxiv. org/abs/2410.24164, 2024. 2 30 World Action Models are Zero-shot Policies

    work page internal anchor Pith review Pith/arXiv arXiv 2024

  11. [12]

    On the Opportunities and Risks of Foundation Models

    Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. On the opportunities and risks of foundation models.arXiv preprint arXiv:2108.07258, 2021. 4

    work page internal anchor Pith review Pith/arXiv arXiv 2021

  12. [13]

    RT-1: Robotics Transformer for Real-World Control at Scale

    Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Joseph Dabis, Chelsea Finn, Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Jasmine Hsu, Julian Ibarz, Brian Ichter, Alex Irpan, Tomas Jackson, Sally Jesmonth, Nikhil Joshi, Ryan Julian, Dmitry Kalashnikov, Yuheng Kuang, Isabel Leal, Kuang-Huei Lee, Sergey Levine, Yao Lu, Utsav Malla, De...

    work page internal anchor Pith review Pith/arXiv arXiv 2022

  13. [14]

    RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control

    Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Xi Chen, Krzysztof Choromanski, Tianli Ding, Danny Driess, Avinava Dubey, Chelsea Finn, Pete Florence, Chuyuan Fu, Montse Gonzalez Arenas, Keerthana Gopalakrishnan, Kehang Han, Karol Hausman, Alex Herzog, Jasmine Hsu, Brian Ichter, Alex Irpan, Nikhil Joshi, Ryan Julian, Dmitry Kalashnikov, Yuh...

    work page internal anchor Pith review Pith/arXiv arXiv

  14. [15]

    Do as i can, not as i say: Grounding language in robotic affordances

    Anthony Brohan, Yevgen Chebotar, Chelsea Finn, Karol Hausman, Alexander Herzog, Daniel Ho, Julian Ibarz, Alex Irpan, Eric Jang, Ryan Julian, et al. Do as i can, not as i say: Grounding language in robotic affordances. InConference on robot learning, pages 287–318. PMLR, 2023. 4

    work page 2023

  15. [16]

    UniVLA: Learning to Act Anywhere with Task-centric Latent Actions

    Qingwen Bu, Yanting Yang, Jisong Cai, Shenyuan Gao, Guanghui Ren, Maoqing Yao, Ping Luo, and Hongyang Li. Univla: Learning to act anywhere with task-centric latent actions.arXiv preprint arXiv:2505.06111, 2025. 4

    work page internal anchor Pith review arXiv 2025

  16. [17]

    GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulation

    Chi-Lam Cheang, Guangzeng Chen, Ya Jing, Tao Kong, Hang Li, Yifeng Li, Yuxiao Liu, Hongtao Wu, Jiafeng Xu, Yichu Yang, et al. Gr-2: A generative video-language-action model with web-scale knowledge for robot manipulation.arXiv preprint arXiv:2410.06158, 2024. 5

    work page internal anchor Pith review arXiv 2024

  17. [18]

    Spa- tialvlm: Endowing vision-language models with spatial reasoning capabilities

    Boyuan Chen, Zhuo Xu, Sean Kirmani, Brain Ichter, Dorsa Sadigh, Leonidas Guibas, and Fei Xia. Spa- tialvlm: Endowing vision-language models with spatial reasoning capabilities. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14455–14465, 2024. 2

    work page 2024

  18. [19]

    Large Video Planner Enables Generalizable Robot Control

    Boyuan Chen, Tianyuan Zhang, Haoran Geng, Kiwhan Song, Caiyi Zhang, Peihao Li, William T Freeman, Jitendra Malik, Pieter Abbeel, Russ Tedrake, et al. Large video planner enables generalizable robot control. arXiv preprint arXiv:2512.15840, 2025. 5

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  19. [20]

    arXiv preprint arXiv:2601.10592 (2026) 4

    Delong Chen, Tejaswi Kasarla, Yejin Bang, Mustafa Shukor, Willy Chung, Jade Yu, Allen Bolourchi, Theo Moutakanni, and Pascale Fung. Action100m: A large-scale video action dataset.arXiv preprint arXiv:2601.10592, 2026. 18

    work page arXiv 2026

  20. [21]

    Emerging Properties in Unified Multimodal Pretraining

    Chaorui Deng, Deyao Zhu, Kunchang Li, Chenhui Gou, Feng Li, Zeyu Wang, Shu Zhong, Weihao Yu, Xiaonan Nie, Ziang Song, et al. Emerging properties in unified multimodal pretraining.arXiv preprint arXiv:2505.14683, 2025. 19 31 World Action Models are Zero-shot Policies

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  21. [22]

    Learning a thousand tasks in a day.Science Robotics, 10(108):eadv7594, 2025

    Kamil Dreczkowski, Pietro Vitiello, Vitalis Vosylius, and Edward Johns. Learning a thousand tasks in a day.Science Robotics, 10(108):eadv7594, 2025. 4

    work page 2025

  22. [23]

    PaLM-E: An Embodied Multimodal Language Model

    Danny Driess, Fei Xia, Mehdi SM Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, et al. Palm-e: An embodied multimodal language model.arXiv preprint arXiv:2303.03378, 2023. 4

    work page internal anchor Pith review Pith/arXiv arXiv 2023

  23. [24]

    Learning universal policies via text-guided video generation.Advances in neural information processing systems, 36:9156–9172, 2023

    Yilun Du, Sherry Yang, Bo Dai, Hanjun Dai, Ofir Nachum, Josh Tenenbaum, Dale Schuurmans, and Pieter Abbeel. Learning universal policies via text-guided video generation.Advances in neural information processing systems, 36:9156–9172, 2023. 5

    work page 2023

  24. [25]

    Tenenbaum, Leslie Pack Kaelbling, Andy Zeng, and Jonathan Tompson

    Yilun Du, Sherry Yang, Pete Florence, Fei Xia, Ayzaan Wahid, brian ichter, Pierre Sermanet, Tianhe Yu, Pieter Abbeel, Joshua B. Tenenbaum, Leslie Pack Kaelbling, Andy Zeng, and Jonathan Tompson. Video language planning. InThe Twelfth International Conference on Learning Representations, 2024. URL https://openreview.net/forum?id=9pKtcJcMP3. 5

    work page 2024

  25. [26]

    Xingyu Fu, Yushi Hu, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A

    Zhiyuan Feng, Zhaolu Kang, Qijie Wang, Zhiying Du, Jiongrui Yan, Shubin Shi, Chengbo Yuan, Huizhi Liang, Yu Deng, Qixiu Li, et al. Seeing across views: Benchmarking spatial reasoning of vision-language models in robotic scenes.arXiv preprint arXiv:2510.19400, 2025. 2

    work page arXiv 2025

  26. [27]

    A taxonomy for evaluating generalist robot policies.arXiv preprint arXiv:2503.01238, 2025

    Jensen Gao, Suneel Belkhale, Sudeep Dasari, Ashwin Balakrishna, Dhruv Shah, and Dorsa Sadigh. A taxonomy for evaluating generalist robot policies.arXiv preprint arXiv:2503.01238, 2025. 4

    work page arXiv 2025

  27. [28]

    Ca2-vdm: Efficient autoregressive video diffusion model with causal generation and cache sharing.arXiv preprint arXiv:2411.16375,

    Kaifeng Gao, Jiaxin Shi, Hanwang Zhang, Chunping Wang, Jun Xiao, and Long Chen. Ca2-vdm: Ef- ficient autoregressive video diffusion model with causal generation and cache sharing.arXiv preprint arXiv:2411.16375, 2024. 7

    work page arXiv 2024

  28. [29]

    Gemini Robotics: Bringing AI into the Physical World

    Gemini Robotics Team. Gemini robotics: Bringing ai into the physical world.arXiv preprint arXiv:2503.20020, 2025. 2, 4, 5

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  29. [30]

    Ego4d: Around the world in 3,000 hours of egocentric video

    Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, Hao Jiang, Miao Liu, Xingyu Liu, et al. Ego4d: Around the world in 3,000 hours of egocentric video. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,

    work page

  30. [31]

    2025 , note =

    Pranav Guruprasad, Yangyue Wang, Sudipta Chowdhury, Harshvardhan Sikka, and Paul Pu Liang. Bench- marking vision, language, & action models in procedurally generated, open ended action environments. arXiv preprint arXiv:2505.05540, 2025. 2

    work page arXiv 2025

  31. [32]

    Dream to Control: Learning Behaviors by Latent Imagination

    Danijar Hafner, Timothy Lillicrap, Jimmy Ba, and Mohammad Norouzi. Dream to control: Learning behaviors by latent imagination.arXiv preprint arXiv:1912.01603, 2019. 5, 20

    work page internal anchor Pith review arXiv 1912

  32. [33]

    Mastering Atari with Discrete World Models

    Danijar Hafner, Timothy Lillicrap, Mohammad Norouzi, and Jimmy Ba. Mastering atari with discrete world models.arXiv preprint arXiv:2010.02193, 2020. 5, 20

    work page internal anchor Pith review arXiv 2010

  33. [34]

    Mastering Diverse Domains through World Models

    Danijar Hafner, Jurgis Pasukonis, Jimmy Ba, and Timothy Lillicrap. Mastering diverse domains through world models.arXiv preprint arXiv:2301.04104, 2023. 5, 20

    work page internal anchor Pith review Pith/arXiv arXiv 2023

  34. [35]

    Training Agents Inside of Scalable World Models

    Danijar Hafner, Wilson Yan, and Timothy Lillicrap. Training agents inside of scalable world models, 2025. URLhttps://arxiv.org/abs/2509.24527. 20

    work page internal anchor Pith review arXiv 2025

  35. [36]

    Classifier-Free Diffusion Guidance

    Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance.arXiv preprint arXiv:2207.12598,

    work page internal anchor Pith review Pith/arXiv arXiv

  36. [37]

    EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Video

    Ryan Hoque, Peide Huang, David J Yoon, Mouli Sivapurapu, and Jian Zhang. Egodex: Learning dexterous manipulation from large-scale egocentric video.arXiv preprint arXiv:2505.11709, 2025. 18 32 World Action Models are Zero-shot Policies

    work page internal anchor Pith review arXiv 2025

  37. [38]

    Lora: Low-rank adaptation of large language models.ICLR, 1(2):3, 2022

    Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al. Lora: Low-rank adaptation of large language models.ICLR, 1(2):3, 2022. 11

    work page 2022

  38. [39]

    Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representations

    Yucheng Hu, Yanjiang Guo, Pengchao Wang, Xiaoyu Chen, Yen-Jen Wang, Jianke Zhang, Koushil Sreenath, Chaochao Lu, and Jianyu Chen. Video prediction policy: A generalist robot policy with predictive visual representations.arXiv preprint arXiv:2412.14803, 2024. 5

    work page internal anchor Pith review arXiv 2024

  39. [40]

    Inner monologue: Embodied reasoning through planning with language models

    Wenlong Huang, Fei Xia, Ted Xiao, Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tompson, Igor Mordatch, Yevgen Chebotar, et al. Inner monologue: Embodied reasoning through planning with language models. In6th Annual Conference on Robot Learning. 4

    work page

  40. [41]

    VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

    Wenlong Huang, Chen Wang, Ruohan Zhang, Yunzhu Li, Jiajun Wu, and Li Fei-Fei. Voxposer: Composable 3d value maps for robotic manipulation with language models.arXiv preprint arXiv:2307.05973, 2023. 4

    work page internal anchor Pith review arXiv 2023

  41. [42]

    Huang, Y.-W

    Wenlong Huang, Yu-Wei Chao, Arsalan Mousavian, Ming-Yu Liu, Dieter Fox, Kaichun Mo, and Li Fei- Fei. Pointworld: Scaling 3d world models for in-the-wild robotic manipulation.arXiv preprint arXiv:2601.03782, 2025. 20

    work page arXiv 2025

  42. [43]

    Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion

    Xun Huang, Zhengqi Li, Guande He, Mingyuan Zhou, and Eli Shechtman. Self forcing: Bridging the train-test gap in autoregressive video diffusion.arXiv preprint arXiv:2506.08009, 2025. 8

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  43. [44]

    Hy-world 1.5: A systematic framework for interactive world modeling with real-time latency and geometric consistency.arXiv preprint, 2025

    Team HunyuanWorld. Hy-world 1.5: A systematic framework for interactive world modeling with real-time latency and geometric consistency.arXiv preprint, 2025. 19

    work page 2025

  44. [45]

    Polaris: Scalable real-to-sim evaluations for generalist robot policies, 2025

    Arhan Jain, Mingtong Zhang, Kanav Arora, William Chen, Marcel Torne, Muhammad Zubair Irshad, Sergey Zakharov, Yue Wang, Sergey Levine, Chelsea Finn, et al. Polaris: Scalable real-to-sim evaluations for generalist robot policies.arXiv preprint arXiv:2512.16881, 2025. 11

    work page arXiv 2025

  45. [46]

    Dreamgen: Unlocking generalization in robot learning through video world models

    Joel Jang, Seonghyeon Ye, Zongyu Lin, Jiannan Xiang, Johan Bjorck, Yu Fang, Fengyuan Hu, Spencer Huang, Kaushil Kundalia, Yen-Chen Lin, Loïc Magne, Ajay Mandlekar, Avnish Narayan, You Liang Tan, Guanzhi Wang, Jing Wang, Qi Wang, Yinzhen Xu, Xiaohui Zeng, Kaiyuan Zheng, Ruijie Zheng, Ming-Yu Liu, Luke Zettlemoyer, Dieter Fox, Jan Kautz, Scott Reed, Yuke Zh...

    work page

  46. [47]

    URLhttps://openreview.net/forum?id=3CnxNqmklv. 5

    work page

  47. [48]

    Pyramidal flow matching for efficient video generative modeling.arXiv preprint arXiv:2410.05954, 2024

    Yang Jin, Zhicheng Sun, Ningyuan Li, Kun Xu, Hao Jiang, Nan Zhuang, Quzhe Huang, Yang Song, Yadong Mu, and Zhouchen Lin. Pyramidal flow matching for efficient video generative modeling.arXiv preprint arXiv:2410.05954, 2024. 7

    work page arXiv 2024

  48. [49]

    1 rationally engineering rational robots

    Leslie Pack Kaelbling and Tomás Lozano-Pérez. 1 rationally engineering rational robots. 4

    work page

  49. [50]

    Scaling Laws for Neural Language Models

    Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei. Scaling laws for neural language models.arXiv preprint arXiv:2001.08361, 2020. 18

    work page internal anchor Pith review Pith/arXiv arXiv 2001

  50. [51]

    Kareer, K

    Simar Kareer, Karl Pertsch, James Darpinian, Judy Hoffman, Danfei Xu, Sergey Levine, Chelsea Finn, and Suraj Nair. Emergence of human to robot transfer in vision-language-action models.arXiv preprint arXiv:2512.22414, 2025. 16

    work page arXiv 2025

  51. [52]

    DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset

    Alexander Khazatsky, Karl Pertsch, Suraj Nair, Ashwin Balakrishna, Sudeep Dasari, Siddharth Karamcheti, SoroushNasiriany, MohanKumarSrirama, LawrenceYunliangChen, KirstyEllis, etal. Droid: Alarge-scale in-the-wild robot manipulation dataset.arXiv preprint arXiv:2403.12945, 2024. 10, 11 33 World Action Models are Zero-shot Policies

    work page internal anchor Pith review Pith/arXiv arXiv 2024

  52. [54]

    OpenVLA: An Open-Source Vision-Language-Action Model

    Moo Jin Kim, Karl Pertsch, Siddharth Karamcheti, Ted Xiao, Ashwin Balakrishna, Suraj Nair, Rafael Rafailov, Ethan Foster, Grace Lam, Pannag Sanketi, et al. Openvla: An open-source vision-language-action model.arXiv preprint arXiv:2406.09246, 2024. 2

    work page internal anchor Pith review Pith/arXiv arXiv 2024

  53. [55]

    Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning

    Moo Jin Kim, Yihuai Gao, Tsung-Yi Lin, Yen-Chen Lin, Yunhao Ge, Grace Lam, Percy Liang, Shuran Song, Ming-Yu Liu, Chelsea Finn, et al. Cosmos policy: Fine-tuning video models for visuomotor control and planning.arXiv preprint arXiv:2601.16163, 2026. 2, 5, 7, 19

    work page internal anchor Pith review arXiv 2026

  54. [56]

    Tenenbaum

    Po-Chen Ko, Jiayuan Mao, Yilun Du, Shao-Hua Sun, and Joshua B. Tenenbaum. Learning to act from actionless videos through dense correspondences. InThe Twelfth International Conference on Learning Representations, 2024. URLhttps://openreview.net/forum?id=Mhb5fpA1T0. 5

    work page 2024

  55. [57]

    Open-world task and motion planning via vision-language model generated constraints.IEEE Robotics and Automation Letters, pages 1–8, 2026

    Nishanth Kumar, William Shen, Fabio Ramos, Dieter Fox, Tomás Lozano-Pérez, Leslie Pack Kaelbling, and Caelan Reed Garrett. Open-world task and motion planning via vision-language model generated constraints.IEEE Robotics and Automation Letters, pages 1–8, 2026. doi: 10.1109/LRA.2026.3656799. 4

    work page doi:10.1109/lra.2026.3656799 2026

  56. [58]

    A path towards autonomous machine intelligence.Open Review, 2022

    Yann LeCun. A path towards autonomous machine intelligence.Open Review, 2022. 20

    work page 2022

  57. [59]

    MolmoAct: Action Reasoning Models that can Reason in Space

    Jason Lee, Jiafei Duan, Haoquan Fang, Yuquan Deng, Shuo Liu, Boyang Li, Bohan Fang, Jieyu Zhang, Yi Ru Wang, Sangho Lee, et al. Molmoact: Action reasoning models that can reason in space.arXiv preprint arXiv:2508.07917, 2025. 4

    work page internal anchor Pith review arXiv 2025

  58. [60]

    Causal World Modeling for Robot Control

    Lin Li, Qihang Zhang, Yiming Luo, Shuai Yang, Ruilin Wang, Fei Han, Mingrui Yu, Zelin Gao, Nan Xue, Xing Zhu, Yujun Shen, and Yinghao Xu. Causal world modeling for robot control.arXiv preprint arXiv:2601.21998, 2026. 7

    work page internal anchor Pith review arXiv 2026

  59. [61]

    Unified Video Action Model

    Shuang Li, Yihuai Gao, Dorsa Sadigh, and Shuran Song. Unified video action model.arXiv preprint arXiv:2503.00200, 2025. 5, 7

    work page internal anchor Pith review arXiv 2025

  60. [62]

    arXiv preprint arXiv:2502.05485 (2025) 6

    Yi Li, Yuquan Deng, Jesse Zhang, Joel Jang, Marius Memmel, Raymond Yu, Caelan Reed Garrett, Fabio Ramos, Dieter Fox, Anqi Li, et al. Hamster: Hierarchical action models for open-world robot manipulation. arXiv preprint arXiv:2502.05485, 2025. 4

    work page arXiv 2025

  61. [63]

    Dreamitate: Real-world visuomotor policy learning via video generation

    Junbang Liang, Ruoshi Liu, Ege Ozguroglu, Sruthi Sudhakar, Achal Dave, Pavel Tokmakov, Shuran Song, and Carl Vondrick. Dreamitate: Real-world visuomotor policy learning via video generation. In8th Annual Conference on Robot Learning, 2024. URLhttps://openreview.net/forum?id=InT87E5sr4. 5

    work page 2024

  62. [64]

    Video Generators are Robot Policies

    Junbang Liang, Pavel Tokmakov, Ruoshi Liu, Sruthi Sudhakar, Paarth Shah, Rares Ambrus, and Carl Vondrick. Video generators are robot policies.arXiv preprint arXiv:2508.00795, 2025. 2, 5

    work page internal anchor Pith review arXiv 2025

  63. [65]

    Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulation

    Yue Liao, Pengfei Zhou, Siyuan Huang, Donglin Yang, Shengcong Chen, Yuxin Jiang, Yue Hu, Jingbin Cai, Si Liu, Jianlan Luo, et al. Genie envisioner: A unified world foundation platform for robotic manipulation. arXiv preprint arXiv:2508.05635, 2025. 3, 5, 7

    work page internal anchor Pith review arXiv 2025

  64. [66]

    Flow Matching for Generative Modeling

    Yaron Lipman, Ricky TQ Chen, Heli Ben-Hamu, Maximilian Nickel, and Matt Le. Flow matching for generative modeling.arXiv preprint arXiv:2210.02747, 2022. 7

    work page internal anchor Pith review Pith/arXiv arXiv 2022

  65. [67]

    Timestep embedding tells: It’s time to cache for video diffusion model.arXiv preprint arXiv:2411.19108, 2024

    Feng Liu, Shiwei Zhang, Xiaofeng Wang, Yujie Wei, Haonan Qiu, Yuzhong Zhao, Yingya Zhang, Qixiang Ye, and Fang Wan. Timestep embedding tells: It’s time to cache for video diffusion model.arXiv preprint arXiv:2411.19108, 2024. 23 34 World Action Models are Zero-shot Policies

    work page arXiv 2024

  66. [68]

    arXiv preprint arXiv:2503.06923 , year=

    Jiacheng Liu, Chang Zou, Yuanhuiyi Lyu, Junjie Chen, and Linfeng Zhang. From reusing to forecasting: Accelerating diffusion models with taylorseers.arXiv preprint arXiv:2503.06923, 2025. 23

    work page arXiv 2025

  67. [69]

    Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow

    Xingchao Liu, Chengyue Gong, and Qiang Liu. Flow straight and fast: Learning to generate and transfer data with rectified flow.arXiv preprint arXiv:2209.03003, 2022. 7

    work page internal anchor Pith review Pith/arXiv arXiv 2022

  68. [70]

    Solving new tasks by adapting internet video knowledge

    Calvin Luo, Zilai Zeng, Yilun Du, and Chen Sun. Solving new tasks by adapting internet video knowledge. InThe Thirteenth International Conference on Learning Representations, 2025. 5

    work page 2025

  69. [71]

    Nvidia model-optimizer, 2024

    NVIDIA Corporation. Nvidia model-optimizer, 2024. URL https://github.com/NVIDIA/ Model-Optimizer. 23

    work page 2024

  70. [72]

    mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs

    Jonas Pai, Liam Achenbach, Victoriano Montesinos, Benedek Forrai, Oier Mees, and Elvis Nava. mimic- video: Video-action models for generalizable robot control beyond vlas.arXiv preprint arXiv:2512.15692,

    work page internal anchor Pith review arXiv

  71. [73]

    $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization

    Physical Intelligence.𝜋0.5: a vision-language-action model with open-world generalization.arXiv preprint arXiv:2504.16054, 2025. 4, 5, 10

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  72. [74]

    Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models

    Lucy Xiaoyang Shi, Brian Ichter, Michael Equi, Liyiming Ke, Karl Pertsch, Quan Vuong, James Tanner, Anna Walling, Haohuan Wang, Niccolo Fusai, et al. Hi robot: Open-ended instruction following with hierarchical vision-language-action models.arXiv preprint arXiv:2502.19417, 2025. 19

    work page internal anchor Pith review arXiv 2025

  73. [75]

    Progprompt: Generating situated robot task plans using large language models

    Ishika Singh, Valts Blukis, Arsalan Mousavian, Ankit Goyal, Danfei Xu, Jonathan Tremblay, Dieter Fox, Jesse Thomason, and Animesh Garg. Progprompt: Generating situated robot task plans using large language models. In2023 IEEE International Conference on Robotics and Automation (ICRA), 2023. 4

    work page 2023

  74. [76]

    Gen-0: Embodied foundation models that scale with physical interaction.Generalist AI Blog, 2025

    Generalist AI Team. Gen-0: Embodied foundation models that scale with physical interaction.Generalist AI Blog, 2025. https://generalistai.com/blog/preview-uqlxvb-bb.html. 16

    work page 2025

  75. [77]

    Wan: Open and advanced large-scale video generative models

    Team Wan. Wan: Open and advanced large-scale video generative models. 2025. 2, 7, 11

    work page 2025

  76. [78]

    MAGI-1: Autoregressive Video Generation at Scale

    Hansi Teng, Hongyu Jia, Lei Sun, Lingzhi Li, Maolin Li, Mingqiu Tang, Shuai Han, Tianning Zhang, WQ Zhang, Weifeng Luo, et al. Magi-1: Autoregressive video generation at scale.arXiv preprint arXiv:2505.13211, 2025. 7, 8

    work page internal anchor Pith review arXiv 2025

  77. [79]

    Bridgedata v2: A dataset for robot learning at scale

    Homer Walke, Kevin Black, Abraham Lee, Moo Jin Kim, Max Du, Chongyi Zheng, Tony Zhao, Philippe Hansen-Estruch, Quan Vuong, Andre He, Vivek Myers, Kuan Fang, Chelsea Finn, and Sergey Levine. Bridgedata v2: A dataset for robot learning at scale. InConference on Robot Learning (CoRL), 2023. 10

    work page 2023

  78. [80]

    Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Model

    John Won, Kyungmin Lee, Huiwon Jang, Dongyoung Kim, and Jinwoo Shin. Dual-stream diffusion for world-model augmented vision-language-action model.arXiv preprint arXiv:2510.27607, 2025. 5

    work page internal anchor Pith review arXiv 2025

  79. [81]

    Unleashing large-scale video generative pre-training for visual robot manipulation

    Hongtao Wu, Ya Jing, Chilam Cheang, Guangzeng Chen, Jiafeng Xu, Xinghang Li, Minghuan Liu, Hang Li, and Tao Kong. Unleashing large-scale video generative pre-training for visual robot manipulation. In The Twelfth International Conference on Learning Representations, 2024. URLhttps://openreview.net/ forum?id=NxoFmGgWC9. 5

    work page 2024

  80. [82]

    Qwen3 Technical Report

    An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, et al. Qwen3 technical report.arXiv preprint arXiv:2505.09388, 2025. 18

    work page internal anchor Pith review Pith/arXiv arXiv 2025

Showing first 80 references.