English
Related papers

Related papers: HSC-VLA: Hierarchical Scene-Clearing for Robust Bi…

200 papers

The rapid evolution of Embodied AI has enabled Vision-Language-Action (VLA) models to excel in multimodal perception and task execution. However, applying Reinforcement Learning (RL) to these massive models in large-scale distributed…

Artificial Intelligence · Computer Science 2026-05-15 Yucheng Guo , Yongjian Guo , Zhong Guan , Wen Huang , Haoran Sun , Haodong Yue , Xiaolong Xiang , Shuai Di , Zhen Sun , Luqiao Wang , Junwu Xiong , Yicheng Gong

Existing Vision-Language-Action (VLA) models often struggle to generalize to long-horizon tasks due to their heavy reliance on immediate observations. While recent studies incorporate retrieval mechanisms or extend context windows to handle…

Robotics · Computer Science 2026-03-03 Yipeng Chen , Wentao Tan , Lei Zhu , Fengling Li , Jingjing Li , Guoli Yang , Heng Tao Shen

Vision-Language-Action (VLA) models have emerged as a powerful paradigm in Embodied AI. However, the significant computational overhead of processing redundant visual tokens remains a critical bottleneck for real-time robotic deployment.…

Robotics · Computer Science 2025-11-25 Juntao Gao , Feiyang Ye , Jing Zhang , Wenjing Qian

Recent advances in vision-language models (VLMs) have enabled instruction-conditioned robotic systems with improved generalization. However, most existing work focuses on reactive System 1 policies, underutilizing VLMs' strengths in…

Robotics · Computer Science 2025-10-30 Songhao Han , Boxiang Qiu , Yue Liao , Siyuan Huang , Chen Gao , Shuicheng Yan , Si Liu

We present ProgVLA, a compact vision-language-action (VLA) model designed for reliable robot manipulation under tight compute and memory budgets. The model specifically focuses on efficiently processing long multi-modal sequences by…

Robotics · Computer Science 2026-05-28 Seungsu Kim , Jinyoung Choi , Seungmin Baek , Jean-Michel Renders

Multimodal Large Language Models (MLLMs) excel in understanding complex language and visual data, enabling generalist robotic systems to interpret instructions and perform embodied tasks. Nevertheless, their real-world deployment is…

Robotics · Computer Science 2025-04-15 Rongyu Zhang , Menghang Dong , Yuan Zhang , Liang Heng , Xiaowei Chi , Gaole Dai , Li Du , Yuan Du , Shanghang Zhang

The quadratic computational complexity of MultiHead SelfAttention (MHSA) remains a fundamental bottleneck in scaling Large Language Models (LLMs) for longcontext tasks. While sparse and linearized attention mechanisms attempt to mitigate…

Computation and Language · Computer Science 2025-12-19 Caner Erden

Vision-Language-Action (VLA) models demonstrate impressive zero-shot generalization but frequently suffer from a "Precision-Reasoning Gap" in cluttered environments. This failure is driven by background-induced feature dilution, where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Sangmim Song , Sarath Kodagoda , Marc Carmichael , Karthick Thiyagarajan

Large Multimodal Models (LMMs) have made significant strides in visual question-answering for single images. Recent advancements like long-context LMMs have allowed them to ingest larger, or even multiple, images. However, the ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Tsung-Han Wu , Giscard Biamby , Jerome Quenum , Ritwik Gupta , Joseph E. Gonzalez , Trevor Darrell , David M. Chan

Vision-Language-Action (VLA) models have recently emerged, demonstrating strong generalization in robotic scene understanding and manipulation. However, when confronted with long-horizon tasks that require defined goal states, such as LEGO…

Vision-Language-Action (VLA) models extend vision-language models to embodied control by mapping natural-language instructions and visual observations to robot actions. Despite their capabilities, VLA systems face significant challenges due…

Robotics · Computer Science 2025-10-24 Weifan Guan , Qinghao Hu , Aosheng Li , Jian Cheng

Long-horizon robotic manipulation requires bridging the gap between high-level planning (System 2) and low-level control (System 1). Current Vision-Language-Action (VLA) models often entangle these processes, performing redundant multimodal…

Robotics · Computer Science 2026-02-10 Tongqing Chen , Hang Wu , Jiasen Wang , Xiaotao Li , Lu Fang

Real-world datasets often exhibit class imbalance across multiple categories, manifesting as long-tailed distributions and few-shot scenarios. This is especially challenging in Class-Imbalanced Multi-Label Image Classification (CI-MLIC)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Sheng Huang , Jiexuan Yan , Beiyan Liu , Bo Liu , Richang Hong

Real-world embodied agents face long-horizon tasks, characterized by high-level goals demanding multi-step solutions beyond single actions. Successfully navigating these requires both high-level task planning (i.e., decomposing goals into…

Robotics · Computer Science 2025-06-03 Yi Yang , Jiaxuan Sun , Siqi Kou , Yihan Wang , Zhijie Deng

Recent advancements in vision-language-action (VLA) models have shown promise in robotic manipulation, yet they continue to struggle with long-horizon, multi-step tasks. Existing methods lack internal reasoning mechanisms that can identify…

Vision-Language-Action (VLA) models offer a promising paradigm for generalist robotic policies, yet their adaptation is hindered by data inefficiency and poor generalization. We argue that these bottlenecks stem from the prevailing Direct…

Robotics · Computer Science 2026-05-28 Yutai Li , Shaohui Peng , Jiaming Guo , Di Huang , Zihao Zhang , Yuxuan Guo , Yunkai Gao , Siming Lan , Ling Li , Xing Hu , Yunji Chen

Heating, ventilation, and air conditioning (HVAC) systems account for a substantial share of building energy consumption. Environmental uncertainty and dynamic occupancy behavior bring challenges in decarbonized HVAC control. Reinforcement…

Systems and Control · Electrical Eng. & Systems 2026-03-30 Dianyu Zhong , Tian Xing , Kailai Sun , Xu Yang , Heye Huang , Irfan Qaisar , Tinggang Jia , Shaobo Wang , Qianchuan Zhao

While Vision-Language-Action models (VLAs) are rapidly advancing towards generalist robot policies, it remains difficult to quantitatively understand their limits and failure modes. To address this, we introduce a comprehensive benchmark…

Robotics · Computer Science 2025-12-30 Borong Zhang , Jiahao Li , Jiachen Shen , Yishuai Cai , Yuhao Zhang , Yuanpei Chen , Juntao Dai , Jiaming Ji , Yaodong Yang

Robotic manipulation, a key frontier in robotics and embodied AI, requires precise motor control and multimodal understanding, yet traditional rule-based methods fail to scale or generalize in unstructured, novel environments. In recent…

Robotics · Computer Science 2025-09-04 Rui Shao , Wei Li , Lingsen Zhang , Renshan Zhang , Zhiyang Liu , Ran Chen , Liqiang Nie

Pre-trained Vision-Language Models (VLMs) such as CLIP have shown excellent generalization abilities. However, adapting these large-scale models to downstream tasks while preserving their generalization capabilities remains challenging.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Hao Zheng , Shunzhi Yang , Zhuoxin He , Jinfeng Yang , Zhenhua Huang