中文
相关论文

相关论文: {\Omega}-QVLA: Robust Quantization for Vision-Lang…

200 篇论文

Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal…

机器人学 · 计算机科学 2026-03-06 Hugo Buurmeijer , Carmen Amo Alonso , Aiden Swann , Marco Pavone

In this paper, we introduce an innovative vector quantization based action tokenizer built upon the largest-scale action trajectory dataset to date, leveraging over 100 times more data than previous approaches. This extensive dataset…

机器人学 · 计算机科学 2025-07-02 Yating Wang , Haoyi Zhu , Mingyu Liu , Jiange Yang , Hao-Shu Fang , Tong He

Vision-Language-Action (VLA) models map visual observations and language instructions directly to robotic actions. While effective for simple tasks, standard VLA models often struggle with complex, multi-step tasks requiring logical…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Zhide Zhong , Junfeng Li , Junjie He , Haodong Yan , Xin Gong , Guanyi Zhao , Yingjie Cai , Jiantao Gao , Xu Yan , Bingbing Liu , Yingcong Chen , Liuqing Yang , Haoang Li

Vision-language-action (VLA) models represent an important step toward general-purpose robotic systems by integrating visual perception, language understanding, and action execution. However, systematic evaluation of these models,…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Pranav Guruprasad , Yangyue Wang , Sudipta Chowdhury , Harshvardhan Sikka , Paul Pu Liang

Reinforcement learning (RL) can refine Vision-Language-Action (VLA) policies beyond behavior cloning, but real-world RL remains expensive due to extensive rollouts, resets, supervision, and safety risks. Action-conditioned video world…

机器人学 · 计算机科学 2026-05-26 Xiaokang Liu , Zechen Bai , Hai Ci , Kevin Yuchen Ma , Mike Zheng Shou

Large policies pretrained on a combination of Internet-scale vision-language data and diverse robot demonstrations have the potential to change how we teach robots new skills: rather than training new behaviors from scratch, we can…

Visual-Language-Action (VLA) models report impressive success rates on robotic manipulation benchmarks, yet these results may mask fundamental weaknesses in robustness. We perform a systematic vulnerability analysis by introducing…

Current Vision-Language-Action (VLA) paradigms in autonomous driving primarily rely on Imitation Learning (IL), which introduces inherent challenges such as distribution shift and causal confusion. Online Reinforcement Learning offers a…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Haoyu Fu , Diankun Zhang , Zongchuang Zhao , Jianfeng Cui , Hongwei Xie , Bing Wang , Guang Chen , Dingkang Liang , Xiang Bai

We present VLA Foundry, an open-source framework that unifies LLM, VLM, and VLA training in a single codebase. Most open-source VLA efforts specialize on the action training stage, often stitching together incompatible pretraining…

机器人学 · 计算机科学 2026-04-22 Jean Mercat , Sedrick Keh , Kushal Arora , Isabella Huang , Paarth Shah , Haruki Nishimura , Shun Iwase , Katherine Liu

Recent vision-language-action (VLA) models built on pretrained vision-language models (VLMs) have demonstrated strong performance in robotic manipulation. However, these models remain constrained by the single-frame image paradigm and fail…

机器人学 · 计算机科学 2025-10-31 Hao Li , Shuai Yang , Yilun Chen , Xinyi Chen , Xiaoda Yang , Yang Tian , Hanqing Wang , Tai Wang , Dahua Lin , Feng Zhao , Jiangmiao Pang

Moving beyond the traditional paradigm of adapting internet-pretrained models to physical tasks, we present DM0, an Embodied-Native Vision-Language-Action (VLA) framework designed for Physical AI. Unlike approaches that treat physical…

Recent large-scale Vision Language Action (VLA) models have shown superior performance in robotic manipulation tasks guided by natural language. However, current VLA models suffer from two drawbacks: (i) generation of massive tokens leading…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Juyi Lin , Amir Taherin , Arash Akbari , Arman Akbari , Lei Lu , Guangyu Chen , Taskin Padir , Xiaomeng Yang , Weiwei Chen , Yiqian Li , Xue Lin , David Kaeli , Pu Zhao , Yanzhi Wang

Recent Vision-Language-Action (VLA) models equipped with Flow Matching (FM) action heads achieve state-of-the-art performance in complex robot manipulation. However, the multi-step iterative ODE solving required by FM introduces inference…

机器人学 · 计算机科学 2026-03-19 Zhou Fang , Jiaqi Wang , Yi Zhou , Qiongfeng Shi

Vision-language-action (VLA) models for closed-loop robot control are typically cast under the Markov assumption, making them prone to errors on tasks requiring historical context. To incorporate memory, existing VLAs either retrieve from a…

机器人学 · 计算机科学 2026-03-16 Hang Li , Fengyi Shen , Dong Chen , Liudi Yang , Xudong Wang , Jinkui Shi , Zhenshan Bing , Ziyuan Liu , Alois Knoll

A central challenge in mobile manipulation is preserving multiple plausible action models while remaining reactive during execution. A bottle in a cluttered scene can often be approached and grasped in multiple valid ways. Robust behavior…

机器人学 · 计算机科学 2026-04-03 Jia Syuen Lim , Zhizhen Zhang , Peter Bohm , Brendan Tidd , Zi Huang , Yadan Luo

Spatial perception and reasoning are crucial for Vision-Language-Action (VLA) models to accomplish fine-grained manipulation tasks. However, existing approaches often lack the ability to understand and reason over the essential 3D…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Yixuan Li , Yuhui Chen , Mingcai Zhou , Haoran Li , Zhengtao Zhang , Dongbin Zhao

Fine-tuning is a crucial process for adapting large language models (LLMs) to diverse applications. In certain scenarios, such as multi-tenant serving, deploying multiple LLMs becomes necessary to meet complex demands. Recent studies…

计算与语言 · 计算机科学 2024-11-27 Bowen Ping , Shuo Wang , Hanqing Wang , Xu Han , Yuzhuang Xu , Yukun Yan , Yun Chen , Baobao Chang , Zhiyuan Liu , Maosong Sun

Vision-Language-Action (VLA) models aim to predict robotic actions based on visual observations and language instructions. Existing approaches require fine-tuning pre-trained visionlanguage models (VLMs) as visual and language features are…

机器人学 · 计算机科学 2026-01-01 Huang Huang , Fangchen Liu , Letian Fu , Tingfan Wu , Mustafa Mukadam , Jitendra Malik , Ken Goldberg , Pieter Abbeel

Vision-Language-Action models (VLAs) have demonstrated strong potential for embodied AI, yet their deployment on resource-limited robots remains challenging due to high memory and computational demands. While Post-Training Quantization…

机器人学 · 计算机科学 2026-04-14 Siyuan Xu , Tianshi Wang , Fengling Li , Lei Zhu , Heng Tao Shen

Despite advances in Vision-Language-Action (VLA) models, robotic manipulation struggles with fine-grained tasks because current models lack mechanisms for active visual attention allocation. Human gaze naturally encodes intent, planning,…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Anupam Pani , Yanchao Yang