中文
相关论文

相关论文: ProgVLA: Progress-Aware Robot Manipulation Skill L…

200 篇论文

Prompt-based learning has been demonstrated as a compelling paradigm contributing to large language models' tremendous success (LLMs). Inspired by their success in language tasks, existing research has leveraged LLMs in embodied instruction…

Robotic manipulation in 3D requires effective computation of N degree-of-freedom joint-space trajectories that enable precise and robust control. To achieve this, robots must integrate semantic understanding with visual perception to…

机器人学 · 计算机科学 2026-03-31 Vineet Bhat , Yu-Hsiang Lan , Prashanth Krishnamurthy , Ramesh Karri , Farshad Khorrami

Vision-Language-Action (VLA) models have demonstrated significant advantages in robotic manipulation. However, their reliance on vision and language often leads to suboptimal performance in tasks involving visual occlusion, fine-grained…

Predictive foresight is important to intelligent embodied agents. Since the motor execution of a robot is intrinsically constrained by its visual perception of environmental geometry, effectively anticipating the future requires capturing…

机器人学 · 计算机科学 2026-03-12 Xiaoxu Xu , Hao Li , Jinhui Ye , Yilun Chen , Jia Zeng , Xinyi Chen , Linning Xu , Dahua Lin , Weixin Li , Jiangmiao Pang

The advancement of large Vision-Language-Action (VLA) models has significantly improved robotic manipulation in terms of language-guided task execution and generalization to unseen scenarios. While existing VLAs adapted from pretrained…

Large policies pretrained on a combination of Internet-scale vision-language data and diverse robot demonstrations have the potential to change how we teach robots new skills: rather than training new behaviors from scratch, we can…

Recent Vision-Language-Action (VLA) models reformulate vision-language models by tuning them with millions of robotic demonstrations. While they perform well when fine-tuned for a single embodiment or task family, extending them to…

机器人学 · 计算机科学 2026-03-12 Yuxia Fu , Zhizhen Zhang , Yuqi Zhang , Zijian Wang , Zi Huang , Yadan Luo

Vision-Language-Action~(VLA) models have shown strong potential for general-purpose robotic manipulation, yet they still struggle to generalize to unseen tasks that necessitate transferring relevant experience across objects, scenes, and…

机器人学 · 计算机科学 2026-05-29 Shengyu Si , Yuanzhuo Lu , Ruimeng Yang , Ziyi Ye , Zuxuan Wu , Yu-Gang Jiang

Vision-language-action (VLA) models represent a promising direction for developing general-purpose robotic systems, demonstrating the ability to combine visual understanding, language comprehension, and action generation. However,…

机器人学 · 计算机科学 2024-12-10 Pranav Guruprasad , Harshvardhan Sikka , Jaewoo Song , Yangyue Wang , Paul Pu Liang

Multimodal Large Language Models (MLLMs) excel in understanding complex language and visual data, enabling generalist robotic systems to interpret instructions and perform embodied tasks. Nevertheless, their real-world deployment is…

机器人学 · 计算机科学 2025-04-15 Rongyu Zhang , Menghang Dong , Yuan Zhang , Liang Heng , Xiaowei Chi , Gaole Dai , Li Du , Yuan Du , Shanghang Zhang

Vision-Language-Action (VLA) models have demonstrated strong performance in robotic manipulation, yet their closed-loop deployment is hindered by the high latency and compute cost of repeatedly running large vision-language backbones at…

机器人学 · 计算机科学 2026-01-28 Wenda Yu , Tianshi Wang , Fengling Li , Jingjing Li , Lei Zhu

Vision-Language-Action (VLA) models hold great promise for general-purpose robotic intelligence, yet scaling up such models is severely bottlenecked by the high cost of acquiring annotated training data. Fortunately, vision-equipped robots…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Yuhao Zhou , Yunpeng Zhu , Yang Zhou , Jindi Lyu , Jian Lan , Zhangyuan Wang , Dan Si , Thomas Seidl , Qing Ye , Jiancheng Lyu

Vision-language-action (VLA) models are effective robot action executors, but they remain limited on long-horizon tasks due to the dual burden of extended closed-loop planning and diverse physical operations. We therefore propose…

机器人学 · 计算机科学 2026-05-14 Zixing Lei , Changxing Liu , Yichen Xiong , Minhao Xiong , Yuanzhuo Ding , Zhipeng Zhang , Weixin Li , Siheng Chen

In dynamic environments such as warehouses, hospitals, and homes, robots must seamlessly transition between gross motion and precise manipulations to complete complex tasks. However, current Vision-Language-Action (VLA) frameworks, largely…

机器人学 · 计算机科学 2026-03-03 Xiongfeng Peng , Jiaqian Yu , Dingzhe Li , Yixiang Jin , Lu Xu , Yamin Mao , Chao Zhang , Weiming Li , Sujin Jang , Dongwook Lee , Daehyun Ji

Vision-Language-Action (VLA) models offer a promising autonomous driving paradigm for leveraging world knowledge and reasoning capabilities, especially in long-tail scenarios. However, existing VLA models often struggle with the high…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Zewei Zhou , Ruining Yang , Xuewei , Qi , Yiluan Guo , Sherry X. Chen , Tao Feng , Kateryna Pistunova , Yishan Shen , Lili Su , Jiaqi Ma

Offering great potential in robotic manipulation, a capable Vision-Language-Action (VLA) foundation model is expected to faithfully generalize across tasks and platforms while ensuring cost efficiency (e.g., data and GPU hours required for…

Despite their strong performance in embodied tasks, recent Vision-Language-Action (VLA) models remain highly fragile under multimodal perturbations, where visual corruption and linguistic noise jointly induce distribution shifts that…

机器人学 · 计算机科学 2026-04-15 Yuhan Xie , Yuping Yan , Yunqi Zhao , Handing Wang , Yaochu Jin

Vision-Language-Action (VLA) models provide a promising paradigm for robot learning by integrating visual perception with language-guided policy learning. However, most existing approaches rely on 2D visual inputs to perform actions in 3D…

机器人学 · 计算机科学 2025-12-16 Yicheng Feng , Wanpeng Zhang , Ye Wang , Hao Luo , Haoqi Yuan , Sipeng Zheng , Zongqing Lu

Vision-Language-Action (VLA) models have emerged as a promising approach for enabling robots to follow language instructions and predict corresponding actions. However, current VLA models mainly rely on 2D visual inputs, neglecting the rich…

机器人学 · 计算机科学 2025-08-14 Lin Sun , Bin Xie , Yingfei Liu , Hao Shi , Tiancai Wang , Jiale Cao

Robotic manipulation in open-world environments requires reasoning across semantics, geometry, and long-horizon action dynamics. Existing hierarchical Vision-Language-Action (VLA) frameworks typically use 2D representations to connect…

机器人学 · 计算机科学 2026-03-17 You Wu , Zixuan Chen , Cunxu Ou , Wenxuan Wang , Wenbo Huang , Lin Cao , Yangtao Chen , Weichao Qiu , Xingyue Quan , Jieqi Shi , Jing Huo , Yang Gao