English
Related papers

Related papers: ViVa: A Video-Generative Value Model for Robot Rei…

200 papers

Deep reinforcement learning (RL) algorithms suffer severe performance degradation when the interaction data is scarce, which limits their real-world application. Recently, visual representation learning has been shown to be effective and…

Machine Learning · Computer Science 2022-08-17 Yang Yue , Bingyi Kang , Zhongwen Xu , Gao Huang , Shuicheng Yan

Latent Action Models (LAMs) have emerged as an effective paradigm for handling heterogeneous datasets during Vision-Language-Action (VLA) model pretraining, offering a unified action space across embodiments. However, existing LAMs often…

Robotics · Computer Science 2026-05-14 Qiwei Li , Xicheng Gong , Xinghang Li , Peiyan Li , Quanyun Zhou , Hangjun Ye , Jiahuan Zhou , Yadong Mu

Lifelong learning is critical for embodied agents in open-world environments, where reinforcement learning fine-tuning has emerged as an important paradigm to enable Vision-Language-Action (VLA) models to master dexterous manipulation…

Artificial Intelligence · Computer Science 2026-02-04 Qixin Zeng , Shuo Zhang , Hongyin Zhang , Renjie Wang , Han Zhao , Libang Zhao , Runze Li , Donglin Wang , Chao Huang

Although large-scale video-language pre-training models, which usually build a global alignment between the video and the text, have achieved remarkable progress on various downstream tasks, the idea of adopting fine-grained information…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Weihong Zhong , Mao Zheng , Duyu Tang , Xuan Luo , Heng Gong , Xiaocheng Feng , Bing Qin

Vision-Language-Action (VLA) models show strong potential for general-purpose robotic manipulation, yet their closed-loop reliability often degrades under local deployment conditions. Existing evaluations typically treat test episodes as…

Robotics · Computer Science 2026-05-13 Jianchao Zhao , Huoren Yang , Yusong Hu , Yuyang Gao , Qiguan Ou , Cong Wan , SongLin Dong , Zhiheng Ma , Yihong Gong

Pretraining Vision-Language-Action (VLA) policies on internet-scale video is appealing, yet current latent-action objectives often learn the wrong thing: they remain anchored to pixel variation rather than action-relevant state transitions,…

Robotics · Computer Science 2026-02-17 Jingwen Sun , Wenyao Zhang , Zekun Qi , Shaojie Ren , Zezhi Liu , Hanxin Zhu , Guangzhong Sun , Xin Jin , Zhibo Chen

Recent advances in AI-generated content (AIGC) have led to the emergence of powerful text-to-video generation models. Despite these successes, evaluating the quality of AIGC-generated videos remains challenging due to limited…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xuanyu Zhang , Weiqi Li , Shijie Zhao , Junlin Li , Li Zhang , Jian Zhang

Autonomous driving has long relied on modular "Perception-Decision-Action" pipelines, where hand-crafted interfaces and rule-based components often break down in complex or long-tailed scenarios. Their cascaded design further propagates…

Vision-language-action (VLA) models provide a powerful approach to training control policies for physical systems, such as robots, by combining end-to-end learning with transfer of semantic knowledge from web-scale vision-language model…

Ultra long video understanding remains an open challenge, as existing vision language models (VLMs) falter on such content due to limited context length and inefficient long term memory retention. To address this, recent works have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Hongbo Jin , Qingyuan Wang , Wenhao Zhang , Yang Liu , Sijie Cheng

Vision-Language-Action (VLA) models have shown great potential for embodied AI by integrating visual perception, language understanding, and action execution. In real-time deployment, these models must process continuous visual streams,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Ziyan Liu , Yeqiu Chen , Hongyi Cai , Tao Lin , Shuo Yang , Zheng Liu , Bo Zhao

Vision-Language-Action (VLA) models have recently enabled robotic manipulation by grounding visual and linguistic cues into actions. However, most VLAs assume the Markov property, relying only on the current observation and thus suffering…

A fundamental objective of manipulation policy design is to endow robots to comprehend human instructions, reason about scene cues, and execute generalized actions in dynamic environments. Recent autoregressive vision-language-action (VLA)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Jiaming Liu , Hao Chen , Pengju An , Zhuoyang Liu , Renrui Zhang , Chenyang Gu , Xiaoqi Li , Ziyu Guo , Sixiang Chen , Mengzhen Liu , Chengkai Hou , Mengdi Zhao , KC alex Zhou , Pheng-Ann Heng , Shanghang Zhang

Large policies pretrained on a combination of Internet-scale vision-language data and diverse robot demonstrations have the potential to change how we teach robots new skills: rather than training new behaviors from scratch, we can…

Long-horizon robotic manipulation remains challenging for Vision-Language-Action (VLA) models despite recent progress in zero-shot generalization and simulation-to-real-world transfer. Current VLA models suffer from stage hallucination,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeting Liu , Zida Yang , Zeyu Zhang , Hao Tang

Vision-Language-Action (VLA) models have emerged as promising solutions for robotic manipulation, yet their robustness to real-world physical variations remains critically underexplored. To bridge this gap, we propose Eva-VLA, the first…

Robotics · Computer Science 2026-03-17 Hanqing Liu , Shouwei Ruan , Jiahuan Long , Junqi Wu , Jiacheng Hou , Huili Tang , Tingsong Jiang , Weien Zhou , Wen Yao

Visual-textual understanding is essential for language-guided robot manipulation. Recent works leverage pre-trained vision-language models to measure the similarity between encoded visual observations and textual instructions, and then…

Robotics · Computer Science 2025-09-30 Chaoran Zhu , Hengyi Wang , Yik Lung Pang , Changjae Oh

Continual learning is a long-standing challenge in robot policy learning, where a policy must acquire new skills over time without catastrophically forgetting previously learned ones. While prior work has extensively studied continual…

Machine Learning · Computer Science 2026-03-19 Huihan Liu , Changyeon Kim , Bo Liu , Minghuan Liu , Yuke Zhu

AI-driven video analytics has become increasingly important across diverse domains. However, existing systems are often constrained to specific, predefined tasks, limiting their adaptability in open-ended analytical scenarios. The recent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Yuxuan Yan , Shiqi Jiang , Ting Cao , Yifan Yang , Qianqian Yang , Yuanchao Shu , Yuqing Yang , Lili Qiu

Current Vision-Language-Action (VLA) models typically treat the deepest representation of a vision-language backbone as universally optimal for action prediction. However, robotic manipulation is composed of many frequent closed-loop…

Artificial Intelligence · Computer Science 2026-05-12 Boyang Shen , Kaixiang Yang , Hao Wang , Qiuyu Yu , Qiang Xie , Qiang Li , Zhiwei Wang