English
Related papers

Related papers: TGM-VLA: Task-Guided Mixup for Sampling-Efficient …

200 papers

Vision-language models (VLMs) are highly effective but often underperform on specialized tasks; for example, Llava-1.5 struggles with chart and diagram understanding due to scarce task-specific training data. Existing training data, sourced…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Siddharth Joshi , Besmira Nushi , Vidhisha Balachandran , Varun Chandrasekaran , Vibhav Vineet , Neel Joshi , Baharan Mirzasoleiman

With the rapid development of embodied artificial intelligence, significant progress has been made in vision-language-action (VLA) models for general robot decision-making. However, the majority of existing VLAs fail to account for the…

Robotics · Computer Science 2025-02-17 Hongyin Zhang , Pengxiang Ding , Shangke Lyu , Ying Peng , Donglin Wang

Imitation learning, which enables robots to learn behaviors from demonstrations by human, has emerged as a promising solution for generating robot motions in such environments. The imitation learning-based robot motion generation method,…

Robotics · Computer Science 2025-03-17 Hyeonjun Park , Daegyu Lim , Seungyeon Kim , Sumin Park

Vision-Language-Action (VLA) models pretrained on large-scale multimodal datasets have emerged as powerful foundations for robotic perception and control. However, their massive scale, often billions of parameters, poses significant…

Robotics · Computer Science 2025-12-11 Yifan Ye , Jiaqi Ma , Jun Cen , Zhihe Lu

Recent advances in vision-language-action (VLA) models have motivated the extension of their capabilities to embodied settings, where reinforcement learning (RL) offers a principled way to optimize task success through interaction. However,…

Vision-Language-Action (VLA) models offer a promising paradigm for generalist robotic policies, yet their adaptation is hindered by data inefficiency and poor generalization. We argue that these bottlenecks stem from the prevailing Direct…

Robotics · Computer Science 2026-05-28 Yutai Li , Shaohui Peng , Jiaming Guo , Di Huang , Zihao Zhang , Yuxuan Guo , Yunkai Gao , Siming Lan , Ling Li , Xing Hu , Yunji Chen

Vision-language-action models must enable agents to execute long-horizon tasks under partial observability. However, most existing approaches remain observation-driven, relying on short context windows or repeated queries to vision-language…

Artificial Intelligence · Computer Science 2026-02-26 Vaidehi Bagaria , Bijo Sebastian , Nirav Kumar Patel

With Transformers achieving outstanding performance on individual remote sensing (RS) tasks, we are now approaching the realization of a unified model that excels across multiple tasks through multi-task learning (MTL). Compared to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Qingyun Li , Shuran Ma , Junwei Luo , Yi Yu , Yue Zhou , Fengxiang Wang , Xudong Lu , Xiaoxing Wang , Xin He , Yushi Chen , Xue Yang

Recent progress in Reinforcement Learning (RL) provides a principled approach to optimizing Vision-Language-Action (VLA) models, facilitating a shift from trajectory imitation to active learning in the task environment. Despite improvements…

Robotics · Computer Science 2026-05-19 Sixu Lin , Yunpeng Qing , Litao Liu , Ming Zhou , Ruixing Jin , Xiaoyi Fan , Guiliang Liu

Poor sample efficiency continues to be the primary challenge for deployment of deep Reinforcement Learning (RL) algorithms for real-world applications, and in particular for visuo-motor control. Model-based RL has the potential to be highly…

Machine Learning · Computer Science 2022-12-13 Nicklas Hansen , Yixin Lin , Hao Su , Xiaolong Wang , Vikash Kumar , Aravind Rajeswaran

Vision-Language-Action (VLA) models, particularly diffusion-based architectures, demonstrate transformative potential for embodied intelligence but are severely hampered by high computational and memory demands stemming from extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Yantai Yang , Yuhao Wang , Zichen Wen , Luo Zhongwei , Chang Zou , Zhipeng Zhang , Chuan Wen , Linfeng Zhang

Vision-Language-Action (VLA) models have recently achieved remarkable progress in robotic perception and control, yet most existing approaches primarily rely on VLM trained using 2D images, which limits their spatial understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Zhifeng Rao , Wenlong Chen , Lei Xie , Xia Hua , Dongfu Yin , Zhen Tian , F. Richard Yu

Vision-language-action (VLA) models provide a powerful approach to training control policies for physical systems, such as robots, by combining end-to-end learning with transfer of semantic knowledge from web-scale vision-language model…

Recent vision-language-action (VLA) systems have demonstrated strong capabilities in embodied manipulation. However, most existing VLA policies rely on limited observation windows and end-to-end action prediction, which makes them brittle…

Robotics · Computer Science 2026-04-16 Zhen Liu , Xinyu Ning , Zhe Hu , Xinxin Xie , Weize Li , Zhipeng Tang , Chongyu Wang , Zejun Yang , Hanlin Wang , Yitong Liu , Zhongzhu Pu

Vision-Language-Action (VLA) models show strong potential for general-purpose robotic manipulation, yet their closed-loop reliability often degrades under local deployment conditions. Existing evaluations typically treat test episodes as…

Robotics · Computer Science 2026-05-13 Jianchao Zhao , Huoren Yang , Yusong Hu , Yuyang Gao , Qiguan Ou , Cong Wan , SongLin Dong , Zhiheng Ma , Yihong Gong

Reinforcement learning (RL) fine-tuning has shown promise for Vision-Language-Action (VLA) models in robotic manipulation, but deployment-time visual shifts pose practical challenges. A key difficulty is that standard task rewards supervise…

Robotics · Computer Science 2026-05-14 Yuanfang Peng , Jingjing Fu , Chuheng Zhang , Li Zhao , Jiang Bian , Mingyu Liu , Ling Zhang , Jun Zhang , Rui Wang

The ability to efficiently and reliably learn new tasks has been a foundational challenge in robotics. Vision-Language-Action (VLA) models have demonstrated strong generalization across diverse manipulation tasks, yet pretrained policies…

Robotics · Computer Science 2026-05-26 Perry Dong , Kuo-Han Hung , Tian Gao , Dorsa Sadigh , Chelsea Finn

Vision-Language-Action (VLA) models have shown great potential in general robotic decision-making tasks via imitation learning. However, the variable quality of training data often constrains the performance of these models. On the other…

Robotics · Computer Science 2025-05-13 Hongyin Zhang , Zifeng Zhuang , Han Zhao , Pengxiang Ding , Hongchao Lu , Donglin Wang

Recent Vision-Language-Action (VLA) models built on pre-trained Vision-Language Models (VLMs) require extensive post-training, resulting in high computational overhead that limits scalability and deployment.We propose CogVLA, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Wei Li , Renshan Zhang , Rui Shao , Jie He , Liqiang Nie

Vision-Language-Action (VLA) models have shown great potential for embodied AI by integrating visual perception, language understanding, and action execution. In real-time deployment, these models must process continuous visual streams,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Ziyan Liu , Yeqiu Chen , Hongyi Cai , Tao Lin , Shuo Yang , Zheng Liu , Bo Zhao