中文
相关论文

相关论文: DiG-Flow: Discrepancy-Guided Flow Matching for Rob…

200 篇论文

Continual learning in robotics seeks systems that can constantly adapt to changing environments and tasks, mirroring human adaptability. A key challenge is refining dynamics models, essential for planning and control, while addressing…

机器人学 · 计算机科学 2025-09-09 Alejandro Murillo-Gonzalez , Lantao Liu

In this paper, we present DiffusionVLA, a novel framework that seamlessly combines the autoregression model with the diffusion model for learning visuomotor policy. Central to our approach is a next-token prediction objective, enabling the…

Vision--Language--Action (VLA) models bridge multimodal reasoning with physical control, but adapting them to new tasks with scarce demonstrations remains unreliable. While fine-tuned VLA policies often produce semantically plausible…

人工智能 · 计算机科学 2026-05-25 Changhua Xu , En Yu , Junyu Xuan , Jie Lu

A fundamental objective of manipulation policy design is to endow robots to comprehend human instructions, reason about scene cues, and execute generalized actions in dynamic environments. Recent autoregressive vision-language-action (VLA)…

Vision-language-action (VLA) models have demonstrated exceptional performance in natural language-driven perception and control. However, the high computational cost of VLA models poses significant efficiency challenges, particularly for…

机器人学 · 计算机科学 2026-03-31 Yiran Shi , Dongqi Guo , Tianchen Zhao , Feng Gao , Liangzhi Shi , Chao Yu , ZhiJian Mo , Qihua Xiao , XiaoShuai Peng , Qingmin Liao , Yu Wang

Recent studies on Vision-Language-Action (VLA) models have shifted from the end-to-end action-generation paradigm toward a pipeline involving task planning followed by action generation, demonstrating improved performance on various…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Chongkai Gao , Zixuan Liu , Zhenghao Chi , Junshan Huang , Xin Fei , Yiwen Hou , Yuxuan Zhang , Yudi Lin , Zhirui Fang , Zeyu Jiang , Lin Shao

Reinforcement learning (RL) fine-tuning has shown promise for Vision-Language-Action (VLA) models in robotic manipulation, but deployment-time visual shifts pose practical challenges. A key difficulty is that standard task rewards supervise…

机器人学 · 计算机科学 2026-05-14 Yuanfang Peng , Jingjing Fu , Chuheng Zhang , Li Zhao , Jiang Bian , Mingyu Liu , Ling Zhang , Jun Zhang , Rui Wang

In robotics, Vision-Language-Action (VLA) models that integrate diverse multimodal signals from multi-view inputs have emerged as an effective approach. However, most prior work adopts static fusion that processes all visual inputs…

机器人学 · 计算机科学 2026-02-18 Young-Chae Son , Jung-Woo Lee , Yoon-Ji Choi , Dae-Kwan Ko , Soo-Chul Lim

Vision-Language-Action (VLA) models extend vision-language models to embodied control by mapping natural-language instructions and visual observations to robot actions. Despite their capabilities, VLA systems face significant challenges due…

机器人学 · 计算机科学 2025-10-24 Weifan Guan , Qinghao Hu , Aosheng Li , Jian Cheng

Enabling robots to perform diverse tasks across varied environments is a central challenge in robot learning. While vision-language-action (VLA) models have shown promise for generalizable robot skills, realizing their full potential…

机器人学 · 计算机科学 2025-08-12 Junjie Wen , Yichen Zhu , Jinming Li , Zhibin Tang , Chaomin Shen , Feifei Feng

Vision-Language-Action (VLA) models are receiving increasing attention for their ability to enable robots to perform complex tasks by integrating visual context with linguistic commands. However, achieving efficient real-time performance…

机器人学 · 计算机科学 2024-10-22 ByungOk Han , Jaehong Kim , Jinhyeok Jang

Vision-Language-Action (VLA) models enable embodied decision-making but rely heavily on imitation learning, leading to compounding errors and poor robustness under distribution shift. Reinforcement learning (RL) can mitigate these issues…

Vision-language-action (VLA) models represent a promising direction for developing general-purpose robotic systems, demonstrating the ability to combine visual understanding, language comprehension, and action generation. However,…

机器人学 · 计算机科学 2024-12-10 Pranav Guruprasad , Harshvardhan Sikka , Jaewoo Song , Yangyue Wang , Paul Pu Liang

Vision-Language-Action (VLA) models enable generalist robotic manipulation but suffer from high inference latency. This bottleneck stems from the massive number of visual tokens processed by large language backbones. Existing methods either…

机器人学 · 计算机科学 2026-03-12 Yuquan Li , Lianjie Ma , Han Ding , Lijun Zhu

Vision-Language-Action (VLA) models have demonstrated strong performance across a wide range of robotic manipulation tasks. Despite the success, extending large pretrained Vision-Language Models (VLMs) to the action space can induce…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Yiye Chen , Yanan Jian , Xiaoyi Dong , Shuxin Cao , Jing Wu , Patricio Vela , Benjamin E. Lundell , Dongdong Chen

Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal…

机器人学 · 计算机科学 2026-03-06 Hugo Buurmeijer , Carmen Amo Alonso , Aiden Swann , Marco Pavone

Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for robotic manipulation, in which reliable action prediction critically depends on accurately interpreting and integrating visual observations conditioned on…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Yulin Luo , Hao Chen , Zhuangzhe Wu , Bowen Sui , Jiaming Liu , Chenyang Gu , Zhuoyang Liu , Qiuxuan Feng , Jiale Yu , Shuo Gu , Peng Jia , Pheng-Ann Heng , Shanghang Zhang

One of the central challenges preventing robots from acquiring complex manipulation skills is the prohibitive cost of collecting large-scale robot demonstrations. In contrast, humans are able to learn efficiently by watching others interact…

机器人学 · 计算机科学 2025-11-13 Changhe Chen , Quantao Yang , Xiaohao Xu , Nima Fazeli , Olov Andersson

Augmenting vision-language-action models (VLAs) with world models is promising for robotic policy learning but faces challenges in jointly predicting states and actions due to the modality gap. To address this, we propose DUal-STream…

计算机视觉与模式识别 · 计算机科学 2026-05-29 John Won , Kyungmin Lee , Huiwon Jang , Dongyoung Kim , Jinwoo Shin

We introduce OG-VLA, a novel architecture and learning framework that combines the generalization strengths of Vision Language Action models (VLAs) with the robustness of 3D-aware policies. We address the challenge of mapping natural…

机器人学 · 计算机科学 2025-11-19 Ishika Singh , Ankit Goyal , Stan Birchfield , Dieter Fox , Animesh Garg , Valts Blukis