中文
相关论文

相关论文: Notes-to-Self: Scratchpad Augmented VLAs for Memor…

200 篇论文

Vision-Language-Action (VLA) models exhibit strong generalization in robotic manipulation, yet reinforcement learning (RL) fine-tuning often degrades robustness under spatial distribution shifts. For flow-matching VLA policies, this…

机器人学 · 计算机科学 2026-02-03 Xu Pan , Zhenglin Wan , Xingrui Yu , Xianwei Zheng , Youkai Ke , Ming Sun , Rui Wang , Ziwei Wang , Ivor Tsang

Pre-trained vision-language-action (VLA) models offer a promising foundation for generalist robot policies, but often produce brittle behaviors or unsafe failures when deployed zero-shot in out-of-distribution scenarios. We present…

机器人学 · 计算机科学 2025-11-14 Cyrus Neary , Omar G. Younis , Artur Kuramshin , Ozgur Aslan , Glen Berseth

Pretrained Vision-Language-Action (VLA) policies have achieved strong single-step manipulation, but their inference remains largely memoryless, which is brittle in non-Markovian long-horizon settings with occlusion, state aliasing, and…

机器人学 · 计算机科学 2026-03-10 Jun Sun , Boyu Yang , Jiahao Zhang , Ning Ma , Chencheng Wu , Siqing Zhang , Yiou Huang , Qiufeng Wang , Shan Liang , Yaran Chen

Vision-Language-Action (VLA) models have emerged as a powerful paradigm in Embodied AI. However, the significant computational overhead of processing redundant visual tokens remains a critical bottleneck for real-time robotic deployment.…

机器人学 · 计算机科学 2025-11-25 Juntao Gao , Feiyang Ye , Jing Zhang , Wenjing Qian

Enabling robots to perform diverse tasks across varied environments is a central challenge in robot learning. While vision-language-action (VLA) models have shown promise for generalizable robot skills, realizing their full potential…

机器人学 · 计算机科学 2025-08-12 Junjie Wen , Yichen Zhu , Jinming Li , Zhibin Tang , Chaomin Shen , Feifei Feng

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for general-purpose robot control through natural language instructions. However, their high inference cost-stemming from large-scale token computation and…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Xudong Tan , Yaoxin Yang , Peng Ye , Jialin Zheng , Bizhe Bai , Xinyi Wang , Jia Hao , Tao Chen

Large language models have been shown to struggle with multi-step reasoning, and do not retain previous reasoning steps for future use. We propose a simple method for solving both of these problems by allowing the model to take Self-Notes.…

机器学习 · 计算机科学 2023-11-01 Jack Lanchantin , Shubham Toshniwal , Jason Weston , Arthur Szlam , Sainbayar Sukhbaatar

Foundational Vision-Language Models (VLMs) excel across diverse tasks, but adapting them to new domains without forgetting prior knowledge remains a critical challenge. Continual Learning (CL) addresses this challenge by enabling models to…

机器学习 · 计算机科学 2026-02-03 Vaibhav Singh , Rahaf Aljundi , Eugene Belilovsky

The goal of this paper is to improve the performance and reliability of vision-language-action (VLA) models through iterative online interaction. Since collecting policy rollouts in the real world is expensive, we investigate whether a…

机器人学 · 计算机科学 2026-02-17 Yanjiang Guo , Tony Lee , Lucy Xiaoyang Shi , Jianyu Chen , Percy Liang , Chelsea Finn

Vision-Language-Action (VLA) models are promising for generalist robot manipulation but remain brittle in out-of-distribution (OOD) settings, especially with limited real-robot data. To resolve the generalization bottleneck, we introduce a…

Vision-Language-Action (VLA) models have demonstrated significant potential for embodied decision-making; however, their application in complex chemical laboratory automation remains restricted by limited long-horizon reasoning and the…

机器人学 · 计算机科学 2026-04-20 Xu Huang , Weixin Mao , Yinhao Li , Hua Chen , Jiabao Zhao

Vision-Language-Action models (VLAs) are emerging as powerful tools for learning generalizable visuomotor control policies. However, current VLAs are mostly trained on large-scale image-text-action data and remain limited in two key ways:…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Wenqi Liang , Gan Sun , Yao He , Jiahua Dong , Suyan Dai , Ivan Laptev , Salman Khan , Yang Cong

Recent advances in multimodal vision-language-action (VLA) models have revolutionized traditional robot learning, enabling systems to interpret vision, language, and action in unified frameworks for complex task planning. However, mastering…

机器人学 · 计算机科学 2025-06-12 Hongjun Wu , Heng Zhang , Pengsong Zhang , Jin Wang , Cong Wang

Humanoid robots with behavioral autonomy have consistently been regarded as ideal collaborators in our daily lives and promising representations of embodied intelligence. Compared to fixed-based robotic arms, humanoid robots offer a larger…

机器人学 · 计算机科学 2024-09-04 Jin Wang , Nikos Tsagarakis

Vision-Language-Action (VLA) models have made substantial progress by leveraging the robust capabilities of Visual Language Models (VLMs). However, VLMs' significant parameter size and autoregressive (AR) decoding nature impose considerable…

机器学习 · 计算机科学 2025-09-23 Songsheng Wang , Rucheng Yu , Zhihang Yuan , Chao Yu , Feng Gao , Yu Wang , Derek F. Wong

High-performing vision language models still produce incorrect answers, yet their failure modes are often difficult to explain. To make model internals more accessible and enable systematic debugging, we introduce VisualScratchpad, an…

人工智能 · 计算机科学 2026-03-10 Hyesu Lim , Jinho Choi , Taekyung Kim , Byeongho Heo , Jaegul Choo , Dongyoon Han

Pretraining Vision-Language-Action (VLA) policies on internet-scale video is appealing, yet current latent-action objectives often learn the wrong thing: they remain anchored to pixel variation rather than action-relevant state transitions,…

机器人学 · 计算机科学 2026-02-17 Jingwen Sun , Wenyao Zhang , Zekun Qi , Shaojie Ren , Zezhi Liu , Hanxin Zhu , Guangzhong Sun , Xin Jin , Zhibo Chen

Vision-language-action (VLA) models hold the promise to attain generalizable embodied control. To achieve this, a pervasive paradigm is to leverage the rich vision-semantic priors of large vision-language models (VLMs). However, the…

机器人学 · 计算机科学 2025-11-11 Chuheng Zhang , Rushuai Yang , Xiaoyu Chen , Kaixin Wang , Li Zhao , Yi Chen , Jiang Bian

Vision-Language-Action (VLA) models have demonstrated strong performance across a wide range of robotic manipulation tasks. Despite the success, extending large pretrained Vision-Language Models (VLMs) to the action space can induce…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Yiye Chen , Yanan Jian , Xiaoyi Dong , Shuxin Cao , Jing Wu , Patricio Vela , Benjamin E. Lundell , Dongdong Chen

The Vision-Language-Action (VLA) models have demonstrated remarkable performance on embodied tasks and shown promising potential for real-world applications. However, current VLAs still struggle to produce consistent and precise…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Ziwen Li , Xin Wang , Hanlue Zhang , Runnan Chen , Runqi Lin , Xiao He , Han Huang , Yandong Guo , Fakhri Karray , Tongliang Liu , Mingming Gong