中文
相关论文

相关论文: AnywhereVLA: Language-Conditioned Exploration and …

200 篇论文

Vision-Language-Action (VLA) models trained on large robot datasets promise general-purpose, robust control across diverse domains and embodiments. However, existing approaches often fail out-of-the-box when deployed in novel environments,…

机器人学 · 计算机科学 2025-10-21 Ruihan Zhao , Tyler Ingebrand , Sandeep Chinchali , Ufuk Topcu

The Vision-Language-Action models (VLA) have achieved significant advances in robotic manipulation recently. However, vision-only VLA models create fundamental limitations, particularly in perceiving interactive and manipulation dynamic…

机器人学 · 计算机科学 2025-11-14 Xiangyi Wei , Haotian Zhang , Xinyi Cao , Siyu Xie , Weifeng Ge , Yang Li , Changbo Wang

Robotic real-world reinforcement learning (RL) with vision-language-action (VLA) models is bottlenecked by sparse, handcrafted rewards and inefficient exploration. We introduce VLAC, a general process reward model built upon InternVL and…

Vision-Language-Action (VLA) models have emerged as a promising framework for enabling generalist robots capable of perceiving, reasoning, and acting in the real world. These models usually build upon pretrained Vision-Language Models…

机器人学 · 计算机科学 2025-11-25 Tao Lin , Gen Li , Yilei Zhong , Yanwen Zou , Yuxin Du , Jiting Liu , Encheng Gu , Bo Zhao

Grounding language to a navigating agent's observations can leverage pretrained multimodal foundation models to match perceptions to object or event descriptions. However, previous approaches remain disconnected from environment mapping,…

机器人学 · 计算机科学 2025-06-10 Chenguang Huang , Oier Mees , Andy Zeng , Wolfram Burgard

Robotic manipulation, a key frontier in robotics and embodied AI, requires precise motor control and multimodal understanding, yet traditional rule-based methods fail to scale or generalize in unstructured, novel environments. In recent…

机器人学 · 计算机科学 2025-09-04 Rui Shao , Wei Li , Lingsen Zhang , Renshan Zhang , Zhiyang Liu , Ran Chen , Liqiang Nie

The deployment of artificial intelligence models at the edge is increasingly critical for autonomous robots operating in GPS-denied environments where local, resource-efficient reasoning is essential. This work demonstrates the feasibility…

机器人学 · 计算机科学 2025-11-11 Justin Williams , Kishor Datta Gupta , Roy George , Mrinmoy Sarkar

Vision--Language--Action (VLA) models often use intermediate representations to connect multimodal inputs with continuous control, yet spatial guidance is often injected implicitly through latent features. We propose $CorridorVLA$, which…

机器人学 · 计算机科学 2026-04-24 Dachong Li , ZhuangZhuang Chen , Jin Zhang , Jianqiang Li

Vision-Language-Action (VLA) models have shown remarkable generalization by mapping web-scale knowledge to robotic control, yet they remain blind to physical contact. Consequently, they struggle with contact-rich manipulation tasks that…

机器人学 · 计算机科学 2026-05-07 Guo Ye , Zexi Zhang , Xu Zhao , Shang Wu , Haoran Lu , Shihan Lu , Han Liu

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical…

Vision-Language-Action (VLA) models extend vision-language models to embodied control by mapping natural-language instructions and visual observations to robot actions. Despite their capabilities, VLA systems face significant challenges due…

机器人学 · 计算机科学 2025-10-24 Weifan Guan , Qinghao Hu , Aosheng Li , Jian Cheng

Vision-language-action (VLA) models hold promise as generalist robotics solutions by translating visual and linguistic inputs into robot actions, yet they lack reliability due to their black-box nature and sensitivity to environmental…

机器人学 · 计算机科学 2025-02-10 Hong Lu , Hengxu Li , Prithviraj Singh Shahani , Stephanie Herbers , Matthias Scheutz

In embodied AI, visual perception should be active rather than passive: the system must decide where to look and at what scale to sense to acquire maximally informative data under pixel and spatial budget constraints. Existing vision models…

机器人学 · 计算机科学 2026-04-06 Jiashu Yang , Yifan Han , Yucheng Xie , Ning Guo , Wenzhao Lian

In unstructured environments, functional dexterous grasping calls for the tight integration of semantic understanding, precise 3D functional localization, and physically interpretable execution. Modular hierarchical methods are more…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Fan Yang , Wenrui Chen , Guorun Yan , Ruize Liao , Wanjun Jia , Dongsheng Luo , Jiacheng Lin , Kailun Yang , Zhiyong Li , Yaonan Wang

Recent vision-language-action (VLA) models built on pretrained vision-language models (VLMs) have demonstrated strong performance in robotic manipulation. However, these models remain constrained by the single-frame image paradigm and fail…

机器人学 · 计算机科学 2025-10-31 Hao Li , Shuai Yang , Yilun Chen , Xinyi Chen , Xiaoda Yang , Yang Tian , Hanqing Wang , Tai Wang , Dahua Lin , Feng Zhao , Jiangmiao Pang

End-to-end autonomous driving models based on Vision-Language-Action (VLA) architectures have shown promising results by learning driving policies through behavior cloning on expert demonstrations. However, imitation learning inherently…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Zihao Sheng , Xin Ye , Jingru Luo , Sikai Chen , Liu Ren

Vision-language-action models (VLAs) have become an increasingly popular approach for addressing robot manipulation problems in recent years. However, such models need to output actions at a rate suitable for robot control, which limits the…

机器人学 · 计算机科学 2025-09-30 Eric Hannus , Miika Malin , Tran Nguyen Le , Ville Kyrki

Vision-Language-Action models (VLAs) are emerging as powerful tools for learning generalizable visuomotor control policies. However, current VLAs are mostly trained on large-scale image-text-action data and remain limited in two key ways:…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Wenqi Liang , Gan Sun , Yao He , Jiahua Dong , Suyan Dai , Ivan Laptev , Salman Khan , Yang Cong

Autonomous navigation in highly constrained environments remains challenging for mobile robots. Classical navigation approaches offer safety assurances but require environment-specific parameter tuning; end-to-end learning bypasses…

机器人学 · 计算机科学 2026-03-11 Yuanjie Lu , Beichen Wang , Zhengqi Wu , Yang Li , Xiaomin Lin , Chengzhi Mao , Xuesu Xiao

Autonomous robotic exploration of unknown and hazardous environments, a long-standing challenge, can be significantly improved by leveraging the advanced reasoning of Vision-Language Models (VLMs). We introduce a novel exploration pipeline…

机器人学 · 计算机科学 2026-05-25 Aarush Aitha , Avideh Zakhor