中文
相关论文

相关论文: VQ-VLA: Improving Vision-Language-Action Models vi…

200 篇论文

Tokenizer, serving as a translator to map the intricate visual data into a compact latent space, lies at the core of visual generative models. Based on the finding that existing tokenizers are tailored to image or video inputs, this paper…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Junke Wang , Yi Jiang , Zehuan Yuan , Binyue Peng , Zuxuan Wu , Yu-Gang Jiang

Vision-Language-Action models have demonstrated remarkable capabilities in predicting agent movements within virtual environments and real-world scenarios based on visual observations and textual instructions. Although recent research has…

计算机视觉与模式识别 · 计算机科学 2025-08-13 Maxim A. Patratskiy , Alexey K. Kovalev , Aleksandr I. Panov

Enabling robots to perform diverse tasks across varied environments is a central challenge in robot learning. While vision-language-action (VLA) models have shown promise for generalizable robot skills, realizing their full potential…

机器人学 · 计算机科学 2025-08-12 Junjie Wen , Yichen Zhu , Jinming Li , Zhibin Tang , Chaomin Shen , Feifei Feng

Vision-Language-Action (VLA) models enable instruction-following embodied control, but their large compute and memory footprints hinder deployment on resource-constrained robots and edge platforms. While reducing weights to 1-bit precision…

机器学习 · 计算机科学 2026-02-17 Xin Yan , Zhenglin Wan , Feiyang Ye , Xingrui Yu , Hangyu Du , Yang You , Ivor Tsang

In large-scale recommender systems, ultra-long user behavior sequences encode rich signals of evolving interests. Extending sequence length generally improves accuracy, but directly modeling such sequences in production is infeasible due to…

信息检索 · 计算机科学 2025-08-26 Kaiyuan Li , Yongxiang Tang , Yanhua Cheng , Yong Bai , Yanxiang Zeng , Chao Wang , Xialong Liu , Peng Jiang

Vision-Language-Action (VLA) models enable robots to interpret natural-language instructions and perform diverse tasks, yet their integration of perception, language, and control introduces new safety vulnerabilities. Despite growing…

密码学与安全 · 计算机科学 2025-11-18 Jiayu Li , Yunhan Zhao , Xiang Zheng , Zonghuan Xu , Yige Li , Xingjun Ma , Yu-Gang Jiang

Prevailing Vision-Language-Action Models (VLAs) for robotic manipulation are built upon vision-language backbones pretrained on large-scale, but disconnected static web data. As a result, despite improved semantic generalization, the policy…

机器人学 · 计算机科学 2025-12-22 Jonas Pai , Liam Achenbach , Victoriano Montesinos , Benedek Forrai , Oier Mees , Elvis Nava

The pursuit of robot generalists, agents capable of performing diverse tasks across diverse environments, demands rigorous and scalable evaluation. Yet real-world testing of robot policies remains fundamentally constrained: it is…

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for general-purpose robot control through natural language instructions. However, their high inference cost-stemming from large-scale token computation and…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Xudong Tan , Yaoxin Yang , Peng Ye , Jialin Zheng , Bizhe Bai , Xinyi Wang , Jia Hao , Tao Chen

Recent vision-language-action (VLA) models have significantly advanced robotic manipulation by unifying perception, reasoning, and control. To achieve such integration, recent studies adopt a predictive paradigm that models future visual…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yijie Zhu , Jie He , Rui Shao , Kaishen Yuan , Tao Tan , Xiaochen Yuan , Zitong Yu

This paper presents a novel approach for pretraining robotic manipulation Vision-Language-Action (VLA) models using a large corpus of unscripted real-life video recordings of human hand activities. Treating human hand as dexterous robot…

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

机器人学 · 计算机科学 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain

This paper proposes VLA-AN, an efficient and onboard Vision-Language-Action (VLA) framework dedicated to autonomous drone navigation in complex environments. VLA-AN addresses four major limitations of existing large aerial navigation…

机器人学 · 计算机科学 2025-12-22 Yuze Wu , Mo Zhu , Xingxing Li , Yuheng Du , Yuxin Fan , Wenjun Li , Zhichao Han , Xin Zhou , Fei Gao

Long-horizon robotic manipulation remains challenging for Vision-Language-Action (VLA) models despite recent progress in zero-shot generalization and simulation-to-real-world transfer. Current VLA models suffer from stage hallucination,…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Zeting Liu , Zida Yang , Zeyu Zhang , Hao Tang

The quality of the latent space in visual tokenizers (e.g., VAEs) is crucial for modern generative models. However, the standard reconstruction-based training paradigm produces a latent space that is biased towards low-level information,…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Jingfeng Yao , Yuda Song , Yucong Zhou , Xinggang Wang

Tactile feedback is generally recognized to be crucial for effective interaction with the physical world. However, state-of-the-art Vision-Language-Action (VLA) models lack the ability to interpret and use tactile signals, limiting their…

机器人学 · 计算机科学 2025-07-30 Jianxin Bi , Kevin Yuchen Ma , Ce Hao , Mike Zheng Shou , Harold Soh

Despite progress, Vision-Language-Action models (VLAs) are limited by a scarcity of large-scale, diverse robot data. While human manipulation videos offer a rich alternative, existing methods are forced to choose between small,…

机器人学 · 计算机科学 2026-02-26 Hao Luo , Ye Wang , Wanpeng Zhang , Haoqi Yuan , Yicheng Feng , Haiweng Xu , Sipeng Zheng , Zongqing Lu

Recent vision-language-action (VLA) models build upon vision-language foundations, and have achieved promising results and exhibit the possibility of task generalization in robot manipulation. However, due to the heterogeneity of tactile…

机器人学 · 计算机科学 2025-08-25 Zhengxue Cheng , Yiqian Zhang , Wenkang Zhang , Haoyu Li , Keyu Wang , Li Song , Hengdi Zhang

In dynamic environments such as warehouses, hospitals, and homes, robots must seamlessly transition between gross motion and precise manipulations to complete complex tasks. However, current Vision-Language-Action (VLA) frameworks, largely…

机器人学 · 计算机科学 2026-03-03 Xiongfeng Peng , Jiaqian Yu , Dingzhe Li , Yixiang Jin , Lu Xu , Yamin Mao , Chao Zhang , Weiming Li , Sujin Jang , Dongwook Lee , Daehyun Ji

Vision-Language-Action (VLA) models demonstrate significant potential for developing generalized policies in real-world robotic control. This progress inspires researchers to explore fine-tuning these models with Reinforcement Learning…

机器人学 · 计算机科学 2025-08-05 Dongchi Huang , Zhirui Fang , Tianle Zhang , Yihang Li , Lin Zhao , Chunhe Xia