StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing
Pith reviewed 2026-05-10 18:57 UTC · model grok-4.3
The pith
A modular backbone-action-head architecture unifies fragmented VLA research under one shared abstraction.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
StarVLA establishes a modular backbone-action-head architecture under a shared abstraction that supports independent swapping of components from VLM and world-model backbones to various action paradigms, while providing reusable training strategies and integrated benchmarks that enable simple reproducible recipes to achieve competitive performance.
What carries the argument
The modular backbone-action-head architecture with shared abstraction that lets backbone and action head be swapped independently while preserving training and evaluation interfaces.
If this is right
- New VLA variants can be prototyped by exchanging only the backbone or only the action head without rewriting training or evaluation code.
- The same training recipes and evaluation protocols apply uniformly to both vision-language-model and world-model approaches.
- Reproduction of prior methods and direct comparison across benchmarks become possible from a single codebase.
- Unified interfaces for simulation and real-robot deployment reduce the engineering cost of moving between environments.
Where Pith is reading between the lines
- The framework could shorten the time from idea to working agent by removing repeated data-pipeline and evaluation work.
- Direct head-to-head testing of VLM-based versus world-model-based agents on identical tasks becomes feasible for the first time.
- Extensions that add new action paradigms or new benchmarks would automatically inherit the existing training and evaluation machinery.
Load-bearing premise
The shared modular abstraction preserves performance and compatibility when different backbones and action heads are swapped in.
What would settle it
A controlled swap of a new backbone into the framework that produces benchmark scores materially below the scores reported for that same backbone in its original non-modular implementation.
Figures
read the original abstract
Building generalist embodied agents requires integrating perception, language understanding, and action, which are core capabilities addressed by Vision-Language-Action (VLA) approaches based on multimodal foundation models, including recent advances in vision-language models and world models. Despite rapid progress, VLA methods remain fragmented across incompatible architectures, codebases, and evaluation protocols, hindering principled comparison and reproducibility. We present StarVLA, an open-source codebase for VLA research. StarVLA addresses these challenges in three aspects. First, it provides a modular backbone--action-head architecture that supports both VLM backbones (e.g., Qwen-VL) and world-model backbones (e.g., Cosmos) alongside representative action-decoding paradigms, all under a shared abstraction in which backbone and action head can each be swapped independently. Second, it provides reusable training strategies, including cross-embodiment learning and multimodal co-training, that apply consistently across supported paradigms. Third, it integrates major benchmarks, including LIBERO, SimplerEnv, RoboTwin~2.0, RoboCasa-GR1, and BEHAVIOR-1K, through a unified evaluation interface that supports both simulation and real-robot deployment. StarVLA also ships simple, fully reproducible single-benchmark training recipes that, despite minimal data engineering, already match or surpass prior methods on multiple benchmarks with both VLM and world-model backbones. To our best knowledge, StarVLA is one of the most comprehensive open-source VLA frameworks available, and we expect it to lower the barrier for reproducing existing methods and prototyping new ones. StarVLA is being actively maintained and expanded; we will update this report as the project evolves. The code and documentation are available at https://github.com/starVLA/starVLA.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript introduces StarVLA, an open-source codebase for Vision-Language-Action (VLA) model development. It proposes a modular backbone–action-head architecture supporting independent swaps of VLM backbones (e.g., Qwen-VL) and world-model backbones (e.g., Cosmos) along with representative action-decoding paradigms under a shared abstraction; provides reusable training strategies such as cross-embodiment learning and multimodal co-training; integrates benchmarks including LIBERO, SimplerEnv, RoboTwin 2.0, RoboCasa-GR1, and BEHAVIOR-1K through a unified evaluation interface; and ships simple, fully reproducible single-benchmark training recipes that are claimed to match or surpass prior methods on these benchmarks despite minimal data engineering.
Significance. A well-maintained, modular, and reproducible codebase with integrated benchmarks and explicit training recipes would meaningfully lower barriers to entry and enable principled comparisons in the fragmented VLA field. The explicit release of code, documentation, and single-benchmark recipes is a concrete strength that supports direct reproduction and extension.
major comments (1)
- [Abstract] Abstract: the central claim that 'simple, fully reproducible single-benchmark training recipes ... already match or surpass prior methods on multiple benchmarks with both VLM and world-model backbones' is load-bearing for the paper's contribution but is presented without any accompanying experimental tables, ablation studies, success-rate comparisons, or training curves. This leaves unverified whether the shared modular abstraction preserves representational capacity and training dynamics relative to native implementations of the cited backbones.
minor comments (1)
- The description of the unified evaluation interface would benefit from an explicit API-level example or pseudocode showing how backbone and action-head swaps are performed without hidden compatibility adjustments.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback and for recognizing the value of a modular, reproducible VLA codebase. We address the single major comment below.
read point-by-point responses
-
Referee: [Abstract] Abstract: the central claim that 'simple, fully reproducible single-benchmark training recipes ... already match or surpass prior methods on multiple benchmarks with both VLM and world-model backbones' is load-bearing for the paper's contribution but is presented without any accompanying experimental tables, ablation studies, success-rate comparisons, or training curves. This leaves unverified whether the shared modular abstraction preserves representational capacity and training dynamics relative to native implementations of the cited backbones.
Authors: We agree that the performance claim is central and requires explicit empirical support within the manuscript. In the revised version we will add a dedicated experimental section containing success-rate tables on LIBERO, SimplerEnv, RoboTwin 2.0, RoboCasa-GR1 and BEHAVIOR-1K, direct comparisons against the original native implementations of the cited backbones, and ablations that isolate the effect of the shared modular interface. Training curves will also be included to document convergence behavior. These additions will verify that the abstraction does not degrade representational capacity or training dynamics. revision: yes
Circularity Check
No derivation chain or fitted predictions; codebase and benchmark presentation only
full rationale
The manuscript describes a modular software framework (backbone-action-head abstraction, training strategies, unified benchmark interface) and states that its provided recipes match or surpass prior methods on external benchmarks. No equations, first-principles derivations, parameter fitting, or predictions appear in the text. Performance claims are empirical reports of running the released code against public benchmarks, with no self-referential reduction of outputs to inputs by construction. The work is self-contained as an engineering artifact release; any circularity would require hidden data or hyperparameter advantages, which is a reproducibility concern rather than a definitional or derivation circularity.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption A modular backbone-action-head abstraction can support independent component swapping without loss of functionality or performance
Forward citations
Cited by 44 Pith papers
-
EBench: Elemental Diagnosis of Generalist Mobile Manipulation Policies
EBench is a benchmark that evaluates generalist mobile manipulation policies on 26 tasks across 5 capability and 4 generalization dimensions, revealing distinct capability profiles among models with similar success rates.
-
Denoising Tells When to Replan: Denoising-Variance Adaptive Chunking for Flow-Based Robot Policies
DVAC uses denoising variance as an intrinsic signal to adaptively chunk actions in flow-based robot policies, improving success rates and cutting replans on LIBERO, RoboTwin, CALVIN, and real-world tasks.
-
Same Weights, Different Robot: A Deployment Safety View of VLA Policies
The paper identifies a deployment safety gap in VLA policies where identical checkpoints can be executable-inequivalent due to action metadata mismatches, supported by a derived closed-form transform and empirical dri...
-
RotVLA: Rotational Latent Action for Vision-Language-Action Model
RotVLA models latent actions as continuous SO(n) rotations with triplet-frame supervision and flow-matching to reach 98.2% success on LIBERO and 89.6%/88.5% on RoboTwin2.0 using a 1.7B-parameter model.
-
LoopVLA: Learning Sufficiency in Recurrent Refinement for Vision-Language-Action Models
LoopVLA adds recurrent refinement and learned sufficiency estimation to VLA models, cutting parameters 45% and raising throughput 1.7x while matching baseline task success on LIBERO and VLA-Arena.
-
Towards Backdoor-Based Ownership Verification for Vision-Language-Action Models
GuardVLA embeds a stealthy backdoor watermark in VLAs via secret messages in visual data and uses a swap-and-detect mechanism for post-release ownership verification that preserves task performance.
-
VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Experts
VLA-GSE improves VLA adaptation by initializing generalized shared experts and specialized routed experts via spectral decomposition of the backbone, outperforming full fine-tuning and other PEFT methods on robotic be...
-
Being-H0.7: A Latent World-Action Model from Egocentric Videos
Being-H0.7 adds future-aware latent reasoning to direct VLA policies via dual-branch alignment on latent queries, matching world-model benefits at VLA efficiency.
-
DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executors
Discrete diffusion policies act as natural asynchronous executors for robotics by treating action generation as iterative unmasking, yielding higher success rates and lower computation than flow-matching real-time chu...
-
DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executors
Discrete diffusion policies support native asynchronous execution via unmasking for real-time chunking, delivering higher success rates and 0.7x inference cost versus flow-matching RTC on dynamic robotics benchmarks a...
-
Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond
Proposes a levels x laws taxonomy for world models in AI agents, defining L1-L3 capabilities across physical, digital, social, and scientific regimes while reviewing over 400 works to outline a roadmap for advanced ag...
-
Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision
ZR-0 is a dual-stream VLA model trained with dense ECoT supervision on 60M frames from 400K trajectories to enable cross-embodiment transfer in simulation and real-world settings.
-
Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision
ZR-0 trains a dual-stream VLA model on 60 million frames with dense ECoT annotations so that high-level reasoning transfers across single-arm, bimanual, and humanoid embodiments while skipping reasoning at inference.
-
Trust Your Instincts: Confidence-Driven Test-Time RL for Vision-Language-Action Models
T^2VLA is a test-time reinforcement learning framework for VLAs that uses internal confidence to define intrinsic rewards via similarity to high-confidence expert demonstrations and a dual-expert bootstrapping mechanism.
-
LA4VLA: Learning to Act without Seeing via Language-Action Pretraining
LA4VLA pretrains on language-action pairs from decomposed demonstrations to create reusable action priors, yielding up to 45 percentage point gains in real-world VLA success rates when mixed with standard training.
-
LA4VLA: Learning to Act without Seeing via Language-Action Pretraining
LA4VLA creates a 33K language-action dataset from existing demos and shows that pretraining on language-action pairs before or alongside vision-language-action training boosts success rates in sim and real robot tasks.
-
EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies
EventVLA introduces foundational visual anchors and a Keyframe Evidence Memory module that predicts future keyframe probabilities from VLA embeddings to improve long-horizon task success by an average of 40% on 17 sim...
-
Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Models
Qwen-RobotManip applies unified alignment across representation, motion, and behavior to enable large-scale training on heterogeneous manipulation data, yielding emergent generalization on out-of-distribution robotic ...
-
TempoVLA: Learning Speed-Controllable Vision-Language-Action Policies
TempoVLA learns a single VLA policy with controllable execution speed via variable-speed trajectory augmentation and explicit speed conditioning.
-
Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation
ERVLA trains on a 978k-trajectory embodied CoT corpus using reasoning as supervision with dropout, then predicts actions without CoT at test time, reaching 86.9% on LIBERO-Plus and 53.2% on VLABench.
-
PHASER: Phase-Aware and Semantic Experience Replay for Vision-Language-Action Models
PHASER improves average success rate by up to 31% over uniform experience replay on LIBERO continual learning benchmarks for VLA models by phase-centric capacity allocation and semantic interference routing.
-
RoboSemanticBench: Diagnosing Semantic Grounding in Action Prediction for VLA Models
RoboSemanticBench reveals that representative VLA models grasp blocks successfully but select the semantically correct answer at near-random rates, indicating a gap between backbone semantics and action prediction.
-
FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policies
FineVLA unifies robot datasets into 47k fine-grained trajectories, adds a VLM annotator and benchmark, and shows that mixing fine-grained and goal-level instructions improves steerable control without hurting task success.
-
Lngram: N-gram Conditional Memory in Latent Space
Lngram is a latent N-gram conditional memory module that learns discrete symbols from hidden states for N-gram lookup, outperforming baselines in language modeling and multimodal tasks.
-
Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action
Pelican-Unified 1.0 trains a single VLM plus Unified Future Generator to jointly optimize understanding, reasoning, future video prediction, and action generation, reporting top-tier scores on VLM, WorldArena, and Rob...
-
Geometry Guided Self-Consistency for Physical AI
KeyStone improves task success rates in diffusion-based physical AI models by up to 13.3% by sampling K trajectories in parallel, clustering them in action space, and returning the medoid of the largest cluster.
-
Long-Horizon Manipulation via Trace-Conditioned VLA Planning
LoHo-Manip enables robust long-horizon robot manipulation by using a receding-horizon VLM manager to output progress-aware subtask sequences and 2D visual traces that condition a VLA executor for automatic replanning.
-
Learning Action Priors for Cross-embodiment Robot Manipulation
A two-stage framework pretrains an action module with temporal motion priors from unconditioned trajectories using flow-matching, then transfers it to VLA training via decoder reuse and distillation, yielding better p...
-
EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies
EventVLA uses a foresight-driven Keyframe Evidence Memory module to selectively store sparse task-critical visual events predicted from VLA latent embeddings, reporting +40% average success rate gains on 17 simulation...
-
Invertible Neural Network Adapter for One-Step Flow Matching in Robot Manipulation
An invertible adapter for flow matching enables one-step high-dimensional action generation in robotic manipulation, cutting inference time roughly in half while preserving performance.
-
Kairos: A Native World Model Stack for Physical AI
Kairos is a native world model stack using cross-embodiment pretraining, hybrid linear temporal attention with theoretical error bounds, and deployment-aware co-design, reporting top performance on embodied benchmarks.
-
World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis
WLA models use an autoregressive Transformer to jointly predict textual subtasks, subgoal images, and robot actions from instructions, images, and states, reporting SOTA success rates on RoboTwin2.0 and RMBench.
-
DeMaVLA: A Vision-Language-Action Foundation Model for Generalizable Deformable Manipulation
DeMaVLA is a VLA foundation model using a pruned action expert and flow matching, pre-trained on 5000 hours of real demonstrations and post-trained on multi-task folding data with human-in-the-loop correction, reporti...
-
Rethinking VLM Representation for VLA Initialization
Experiments indicate original VLM representations are crucial for VLA performance, LoRA outperforms full finetuning, and staged robot-data pretraining yields the strongest initialization.
-
PhysBrain 1.0 Technical Report
PhysBrain 1.0 extracts scene elements, spatial dynamics, actions and depth relations from human egocentric video to create QA supervision for VLMs, then transfers the resulting physical priors to VLA policies via capa...
-
Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action
A unified embodied foundation model uses one VLM for understanding and reasoning plus a joint video-action future generator, reporting competitive scores on VLM, world modeling, and robot benchmarks without apparent c...
-
IntentVLA: Short-Horizon Intent Modeling for Aliased Robot Manipulation
IntentVLA conditions VLA chunk generation on a compact intent code from recent observations and introduces AliasBench to evaluate stability under short-horizon observation aliasing, reporting gains on multiple robot b...
-
Learning Action Manifold with Multi-view Latent Priors for Robotic Manipulation
The method uses multi-view diffusion priors and action manifold learning to resolve depth ambiguity and improve action prediction in VLA robotic manipulation models, reporting higher success rates than baselines on LI...
-
VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Experts
VLA-GSE uses spectral decomposition of the VLA backbone to create generalized and specialized experts, enabling effective robot task adaptation while updating only 2.51% of parameters and achieving 81.2% zero-shot suc...
-
VLA Foundry: A Unified Framework for Training Vision-Language-Action Models
VLA Foundry provides a single training stack for VLA models and releases open models that match prior closed-source performance or outperform baselines on multi-task manipulation in simulation.
-
RLDX-1 Technical Report
RLDX-1 achieves 86.8% success on complex ALLEX humanoid manipulation tasks where prior VLAs reach only around 40%.
-
RLDX-1 Technical Report
RLDX-1 outperforms frontier VLAs such as π0.5 and GR00T N1.6 on dexterous manipulation benchmarks, reaching 86.8% success on ALLEX humanoid tasks versus around 40% for the baselines.
-
Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond
A survey proposing a three-level capability taxonomy (L1 Predictor, L2 Simulator, L3 Evolver) for world models across physical, digital, social, and scientific domains.
-
JoyAI-RA 0.1: A Foundation Model for Robotic Autonomy
JoyAI-RA is a multi-source pretrained VLA model that claims to bridge human-to-robot embodiment gaps via data unification and outperforms prior methods on generalization-heavy robotic tasks.
Reference graph
Works this paper leans on
-
[1]
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning
1X World Model Team (2025). 1x world model: Evaluating bits, not atoms. Supplementary technical progress report. Contributed by Daniel Ho, Jack Monas, Juntao Ren, Christina Yu. AgiBot (2025). Agibot official website.https://www.agibot.com/. Assran, M., Bardes, A., Fan, D., Garrido, Q., Howes, R., Komeili, M., Muckley, M., Rizvi, A., Roberts, C., Sinha, K....
work page internal anchor Pith review arXiv 2025
-
[2]
Ctrl-World: A Controllable Generative World Model for Robot Manipulation
Guo, Y ., Shi, L. X., Chen, J., and Finn, C. (2025). Ctrl-world: A controllable generative world model for robot manipulation. arXiv preprint arXiv:2510.10125. He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep residual learning for image recognition. InProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770–778. ...
work page internal anchor Pith review arXiv 2025
-
[3]
Liu, H., Li, C., Wu, Q., and Lee, Y . J. (2023a). Visual instruction tuning.CoRR, abs/2304.08485. Liu, S., Wu, L., Li, B., Tan, H., Chen, H., Wang, Z., Xu, K., Su, H., and Zhu, J. (2024b). Rdt-1b: a diffusion foundation model for bimanual manipulation.arXiv preprint arXiv:2410.07864. 22 Liu, S., Zeng, Z., Ren, T., Li, F., Zhang, H., Yang, J., Jiang, Q., L...
work page internal anchor Pith review arXiv 2022
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.