English
Related papers

Related papers: Long-Term Memory for VLA-based Agents in Open-Worl…

200 papers

Real-world embodied agents face long-horizon tasks, characterized by high-level goals demanding multi-step solutions beyond single actions. Successfully navigating these requires both high-level task planning (i.e., decomposing goals into…

Robotics · Computer Science 2025-06-03 Yi Yang , Jiaxuan Sun , Siqi Kou , Yihan Wang , Zhijie Deng

Current embodied intelligent systems still face a substantial gap between high-level reasoning and low-level physical execution in open-world environments. Although Vision-Language-Action (VLA) models provide strong perception and intuitive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Dongjie Huo , Haoyun Liu , Guoqing Liu , Dekang Qi , Zhiming Sun , Maoguo Gao , Jianxin He , Yandan Yang , Xinyuan Chang , Feng Xiong , Xing Wei , Zhiheng Ma , Mu Xu

Vision-Language-Action (VLA) systems have shown strong potential for language-driven robotic manipulation. However, scaling them to long-horizon tasks remains challenging. Existing pipelines typically separate data collection, policy…

Vision-Language-Action (VLA) models have recently emerged, demonstrating strong generalization in robotic scene understanding and manipulation. However, when confronted with long-horizon tasks that require defined goal states, such as LEGO…

Vision-language-action (VLA) models provide a powerful approach to training control policies for physical systems, such as robots, by combining end-to-end learning with transfer of semantic knowledge from web-scale vision-language model…

Vision-Language-Action (VLA) models mark a transformative advancement in artificial intelligence, aiming to unify perception, natural language understanding, and embodied action within a single computational framework. This foundational…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Ranjan Sapkota , Yang Cao , Konstantinos I. Roumeliotis , Manoj Karkee

Vision-Language-Action (VLA) models map visual observations and language instructions directly to robotic actions. While effective for simple tasks, standard VLA models often struggle with complex, multi-step tasks requiring logical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhide Zhong , Junfeng Li , Junjie He , Haodong Yan , Xin Gong , Guanyi Zhao , Yingjie Cai , Jiantao Gao , Xu Yan , Bingbing Liu , Yingcong Chen , Liuqing Yang , Haoang Li

Embodied AI is widely recognized as a cornerstone of artificial general intelligence (AGI) because it involves controlling embodied agents to perform tasks in the physical world. Building on the success of large language models (LLMs) and…

Robotics · Computer Science 2026-05-04 Yueen Ma , Zixing Song , Yuzheng Zhuang , Jianye Hao , Irwin King

In dynamic environments such as warehouses, hospitals, and homes, robots must seamlessly transition between gross motion and precise manipulations to complete complex tasks. However, current Vision-Language-Action (VLA) frameworks, largely…

Vision-Language-Action (VLA) models demonstrate remarkable potential for generalizable robotic manipulation. The execution of complex multi-step behaviors in VLA models can be improved by robust instruction grounding, a critical component…

Pre-trained Vision-Language-Action (VLA) models have achieved remarkable success in improving robustness and generalization for end-to-end robotic manipulation. However, these models struggle with long-horizon tasks due to their lack of…

Robotics · Computer Science 2025-11-13 Runhao Li , Wenkai Guo , Zhenyu Wu , Changyuan Wang , Haoyuan Deng , Zhenyu Weng , Yap-Peng Tan , Ziwei Wang

The rapid evolution of Embodied AI has enabled Vision-Language-Action (VLA) models to excel in multimodal perception and task execution. However, applying Reinforcement Learning (RL) to these massive models in large-scale distributed…

Artificial Intelligence · Computer Science 2026-05-15 Yucheng Guo , Yongjian Guo , Zhong Guan , Wen Huang , Haoran Sun , Haodong Yue , Xiaolong Xiang , Shuai Di , Zhen Sun , Luqiao Wang , Junwu Xiong , Yicheng Gong

Chemical reasoning usually involves complex, multi-step processes that demand precise calculations, where even minor errors can lead to cascading failures. Furthermore, large language models (LLMs) encounter difficulties handling…

Computation and Language · Computer Science 2025-01-14 Xiangru Tang , Tianyu Hu , Muyang Ye , Yanjun Shao , Xunjian Yin , Siru Ouyang , Wangchunshu Zhou , Pan Lu , Zhuosheng Zhang , Yilun Zhao , Arman Cohan , Mark Gerstein

Recent advances in vision-language models (VLMs) have enabled instruction-conditioned robotic systems with improved generalization. However, most existing work focuses on reactive System 1 policies, underutilizing VLMs' strengths in…

Robotics · Computer Science 2025-10-30 Songhao Han , Boxiang Qiu , Yue Liao , Siyuan Huang , Chen Gao , Shuicheng Yan , Si Liu

Vision-language-action (VLA) models provide a promising foundation for general-purpose robotics. However, their successful deployment in real-world scenarios requires the ability to continually acquire new skills while retaining previously…

Robotics · Computer Science 2026-05-27 Jiarun Zhu , Yijun Hong , Xiaoquan Sun , Zetian Xu , Mingqi Yuan , Zhiyong Wang , Wenjun Zeng , Jiayu Chen

Vision-Language-Action (VLA) models have emerged as a generalist robotic agent. However, existing VLAs are hindered by excessive parameter scales, prohibitive pre-training requirements, and limited applicability to diverse embodiments. To…

Vision-Language-Action (VLA) models aim to control robots for manipulation from visual observations and natural-language instructions. However, existing hierarchical and autoregressive paradigms often introduce architectural overhead,…

Vision-language-action (VLA) models are emerging as embodied foundation models for robotic manipulation, but their deployment introduces a new unlearning challenge: removing unsafe, spurious, or privacy-sensitive behaviors without degrading…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Ravi Ranjan , Agoritsa Polyzou

Existing Vision-Language-Action (VLA) models often struggle to generalize to long-horizon tasks due to their heavy reliance on immediate observations. While recent studies incorporate retrieval mechanisms or extend context windows to handle…

Robotics · Computer Science 2026-03-03 Yipeng Chen , Wentao Tan , Lei Zhu , Fengling Li , Jingjing Li , Guoli Yang , Heng Tao Shen

Robotic manipulation is a fundamental component of automation. However, traditional perception-planning pipelines often fall short in open-ended tasks due to limited flexibility, while the architecture of a single end-to-end…