English
Related papers

Related papers: Leave No Observation Behind: Real-time Correction …

200 papers

Real-world fine manipulation, particularly in bimanual manipulation, typically requires low-latency control and stable visual localization, while collecting large-scale data is costly and limited demonstrations may lead to localization…

Robotics · Computer Science 2026-05-04 Xianbo Cai , Hideyuki Ichiwara , Masaki Yoshikawa , Tetsuya Ogata

Autoregressive sequence models, such as Transformer-based vision-language action (VLA) policies, can be tremendously effective for capturing complex and generalizable robotic behaviors. However, such models require us to choose a…

Many Vision-Language-Action (VLA) models flatten image patches into a 1D token sequence, weakening the 2D spatial cues needed for precise manipulation. We introduce IVRA, a lightweight, training-free method that improves spatial…

Robotics · Computer Science 2026-01-23 Jongwoo Park , Kanchana Ranasinghe , Jinhyeok Jang , Cristina Mata , Yoo Sung Jang , Michael S Ryoo

Current Vision-Language-Action (VLA) models rely on fixed computational depth, expending the same amount of compute on simple adjustments and complex multi-step manipulation. While Chain-of-Thought (CoT) prompting enables variable…

Robotics · Computer Science 2026-02-10 Yalcin Tur , Jalal Naghiyev , Haoquan Fang , Wei-Chuan Tsai , Jiafei Duan , Dieter Fox , Ranjay Krishna

Vision-Language-Action (VLA) models have advanced rapidly with stronger backbones, broader pre-training, and larger demonstration datasets, yet their action heads remain largely homogeneous: most directly predict action commands in a fixed…

Artificial Intelligence · Computer Science 2026-05-13 Huoren Yang , Jianchao Zhao , Hu Yusong , Qiguan Ou , Yuyang Gao , Wei Ke , Yuhang He , SongLin Dong , Zhiheng Ma , Yihong Gong

Vision-Language-Action (VLA) models have emerged as a promising paradigm for grounding visual-language understanding into real-world robotic manipulation. However, dexterous manipulation remains challenging for VLA policies due to…

Robotics · Computer Science 2026-05-29 Zhongxi Chen , Yifan Han , Yanming Shao , Huanming Liu , Congsheng Xu , Xiaoyu Chen , Yao Mu , Wenzhao Lian

Robotic laboratories play a critical role in autonomous scientific discovery by enabling scalable, continuous experimental execution. Recent vision-language-action (VLA) models offer a promising foundation for robotic laboratories. However,…

Robotics · Computer Science 2026-02-11 Yiwen Pang , Bo Zhou , Changjin Li , Xuanhao Wang , Shengxiang Xu , Deng-Bao Wang , Min-Ling Zhang , Shimin Di

Current vision-language-action (VLA) models generalize poorly, particularly when tasks require new compositions of skills or objects. We introduce Atomic Action Slicing (AAS), a planner-aligned approach that decomposes long-horizon…

Machine Learning · Computer Science 2025-12-15 Stefan Tabakov , Asen Popov , Dimitar Dimitrov , S. Ensiye Kiyamousavi , Vladimir Hristov , Boris Kraychev

Manipulating dynamic objects remains an open challenge for Vision-Language-Action (VLA) models, which, despite strong generalization in static manipulation, struggle in dynamic scenarios requiring rapid perception, temporal anticipation,…

Robotics · Computer Science 2026-01-30 Haozhe Xie , Beichen Wen , Jiarui Zheng , Zhaoxi Chen , Fangzhou Hong , Haiwen Diao , Ziwei Liu

Long-sequence processing is a critical capability for modern large language models. However, the self-attention mechanism in the standard Transformer architecture faces severe computational and memory bottlenecks when processing long…

Computation and Language · Computer Science 2025-09-30 Weilin Zhao , Zihan Zhou , Zhou Su , Chaojun Xiao , Yuxuan Li , Yanghao Li , Yudi Zhang , Weilun Zhao , Zhen Li , Yuxiang Huang , Ao Sun , Xu Han , Zhiyuan Liu

Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal…

Robotics · Computer Science 2026-03-06 Hugo Buurmeijer , Carmen Amo Alonso , Aiden Swann , Marco Pavone

Long-horizon robotic manipulation requires bridging the gap between high-level planning (System 2) and low-level control (System 1). Current Vision-Language-Action (VLA) models often entangle these processes, performing redundant multimodal…

Robotics · Computer Science 2026-02-10 Tongqing Chen , Hang Wu , Jiasen Wang , Xiaotao Li , Lu Fang

Vision-language-action (VLA) models provide a powerful approach to training control policies for physical systems, such as robots, by combining end-to-end learning with transfer of semantic knowledge from web-scale vision-language model…

Temporal context is essential for robotic manipulation because such tasks are inherently non-Markovian, yet mainstream VLA models typically overlook it and struggle with long-horizon, temporally dependent tasks. Cognitive science suggests…

Robotics · Computer Science 2026-02-02 Hao Shi , Bin Xie , Yingfei Liu , Lin Sun , Fengrong Liu , Tiancai Wang , Erjin Zhou , Haoqiang Fan , Xiangyu Zhang , Gao Huang

Visual Planning for Assistance (VPA) aims to predict a sequence of user actions required to achieve a specified goal based on a video showing the user's progress. Although recent advances in multimodal large language models (MLLMs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Ce Zhang , Yale Song , Ruta Desai , Michael Louis Iuzzolino , Joseph Tighe , Gedas Bertasius , Satwik Kottur

Vision-language-action (VLA) models trained on large-scale internet data and robot demonstrations have the potential to serve as generalist robot policies. However, despite their large-scale training, VLAs are often brittle to…

Robotics · Computer Science 2024-10-04 Asher J. Hancock , Allen Z. Ren , Anirudha Majumdar

Vision-Language-Action (VLA) models pre-trained on large, diverse datasets show remarkable potential for general-purpose robotic manipulation. However, a primary bottleneck remains in adapting these models to downstream tasks, especially…

Robotics · Computer Science 2025-09-08 Yang Zhang , Chenwei Wang , Ouyang Lu , Yuan Zhao , Yunfei Ge , Zhenglong Sun , Xiu Li , Chi Zhang , Chenjia Bai , Xuelong Li

Recent advances in training-free video editing have enabled lightweight and precise cross-frame generation by leveraging pre-trained text-to-image diffusion models. However, existing methods often rely on heuristic frame selection to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zhangkai Wu , Xuhui Fan , Zhongyuan Xie , Kaize Shi , Longbing Cao

Vision-Language-Action (VLA) models have shown substantial potential in real-world robotic manipulation. However, fine-tuning these models through supervised learning struggles to achieve robust performance due to limited, inconsistent…

Robotics · Computer Science 2025-04-15 Yuhui Chen , Shuai Tian , Shugao Liu , Yingting Zhou , Haoran Li , Dongbin Zhao

Active Label Correction (ALC) has emerged as a promising solution to the high cost and error-prone nature of manual pixel-wise annotation in semantic segmentation, by actively identifying and correcting mislabeled data. Although recent work…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Youjin Jeon , Kyusik Cho , Suhan Woo , Euntai Kim