中文
相关论文

相关论文: Being-H0: Vision-Language-Action Pretraining from …

200 篇论文

This paper presents a novel approach for pretraining robotic manipulation Vision-Language-Action (VLA) models using a large corpus of unscripted real-life video recordings of human hand activities. Treating human hand as dexterous robot…

We introduce Being-H0.5, a foundational Vision-Language-Action (VLA) model designed for robust cross-embodiment generalization across diverse robotic platforms. While existing VLAs often struggle with morphological heterogeneity and data…

Visual-Language-Action models (VLAs) have advanced generalist robot control by mapping multimodal observations and language instructions directly to actions, but sparse action supervision often encourages shortcut mappings rather than…

机器人学 · 计算机科学 2026-05-04 Hao Luo , Wanpeng Zhang , Yicheng Feng , Sipeng Zheng , Haiweng Xu , Chaoyi Xu , Ziheng Xi , Yuhui Fu , Zongqing Lu

Real robot data collection for imitation learning has led to significant advancements in robotic manipulation. However, the requirement for robot hardware in the process fundamentally constrains the scale of the data. In this paper, we…

Vision-Language-Action models (VLAs) hold immense promise for enabling generalist robot manipulation. However, the best way to build them remains an open question. Current approaches often add complexity, such as modifying the existing…

机器人学 · 计算机科学 2025-10-16 Ankit Goyal , Hugo Hadfield , Xuning Yang , Valts Blukis , Fabio Ramos

We adapt a pre-trained Vision-Language-Action (VLA) model (Open-VLA) for dexterous human-robot collaboration with minimal language prompting. Our approach adds (i) FiLM conditioning to visual backbones for task-aware perception, (ii) an…

机器人学 · 计算机科学 2025-10-30 Boshi An , Chenyu Yang , Robert Katzschmann

Prevailing Vision-Language-Action Models (VLAs) for robotic manipulation are built upon vision-language backbones pretrained on large-scale, but disconnected static web data. As a result, despite improved semantic generalization, the policy…

机器人学 · 计算机科学 2025-12-22 Jonas Pai , Liam Achenbach , Victoriano Montesinos , Benedek Forrai , Oier Mees , Elvis Nava

Moving beyond the traditional paradigm of adapting internet-pretrained models to physical tasks, we present DM0, an Embodied-Native Vision-Language-Action (VLA) framework designed for Physical AI. Unlike approaches that treat physical…

Vision-Language-Action (VLA) models show promise for robotic control, yet performance in complex household environments remains sub-optimal. Mobile manipulation requires reasoning about global scene layout, fine-grained geometry, and…

机器人学 · 计算机科学 2026-03-25 Ruisen Tu , Arth Shukla , Sohyun Yoo , Xuanlin Li , Junxi Li , Jianwen Xie , Hao Su , Zhuowen Tu

Vision-Language-Action (VLA) models provide a promising paradigm for robot learning by integrating visual perception with language-guided policy learning. However, most existing approaches rely on 2D visual inputs to perform actions in 3D…

机器人学 · 计算机科学 2025-12-16 Yicheng Feng , Wanpeng Zhang , Ye Wang , Hao Luo , Haoqi Yuan , Sipeng Zheng , Zongqing Lu

Vision-language-action (VLA) models can enable broad open world generalization, but require large and diverse datasets. It is appealing to consider whether some of this data can come from human videos, which cover diverse real-world…

机器人学 · 计算机科学 2025-12-30 Simar Kareer , Karl Pertsch , James Darpinian , Judy Hoffman , Danfei Xu , Sergey Levine , Chelsea Finn , Suraj Nair

Despite progress, Vision-Language-Action models (VLAs) are limited by a scarcity of large-scale, diverse robot data. While human manipulation videos offer a rich alternative, existing methods are forced to choose between small,…

机器人学 · 计算机科学 2026-02-26 Hao Luo , Ye Wang , Wanpeng Zhang , Haoqi Yuan , Yicheng Feng , Haiweng Xu , Sipeng Zheng , Zongqing Lu

While Vision-Language-Action (VLA) models have demonstrated remarkable success in robotic manipulation, their application has largely been confined to low-degree-of-freedom end-effectors performing simple, vision-guided pick-and-place…

机器人学 · 计算机科学 2026-03-10 Tutian Tang , Xingyu Ji , Wanli Xing , Ce Hao , Wenqiang Xu , Lin Shao , Cewu Lu , Qiaojun Yu , Jiangmiao Pang , Kaifeng Zhang

Robotic manipulation, a key frontier in robotics and embodied AI, requires precise motor control and multimodal understanding, yet traditional rule-based methods fail to scale or generalize in unstructured, novel environments. In recent…

机器人学 · 计算机科学 2025-09-04 Rui Shao , Wei Li , Lingsen Zhang , Renshan Zhang , Zhiyang Liu , Ran Chen , Liqiang Nie

Dexterous manipulation is essential for real-world robot autonomy, mirroring the central role of human hand coordination in daily activity. Humans rely on rich multimodal perception--vision, sound, and language-guided intent--to perform…

This paper presents RynnVLA-001, a vision-language-action(VLA) model built upon large-scale video generative pretraining from human demonstrations. We propose a novel two-stage pretraining methodology. The first stage, Ego-Centric Video…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Yuming Jiang , Siteng Huang , Shengke Xue , Yaxi Zhao , Jun Cen , Sicong Leng , Kehan Li , Jiayan Guo , Kexiang Wang , Mingxiu Chen , Fan Wang , Deli Zhao , Xin Li

Human videos contain rich manipulation priors, but using them for robot learning remains difficult because raw observations entangle scene understanding, human motion, and embodiment-specific action. We introduce MoT-HRA, a hierarchical…

机器人学 · 计算机科学 2026-05-22 Yifan Xie , YuAn Wang , Guangyu Chen , Jinkun Liu , Yu Sun , Wenbo Ding

Vision Language Models (VLMs) have recently been leveraged to generate robotic actions, forming Vision-Language-Action (VLA) models. However, directly adapting a pretrained VLM for robotic control remains challenging, particularly when…

While Vision-Language-Action (VLA) models have demonstrated promising generalization capabilities in robotic manipulation, deploying them on specific and complex downstream tasks still demands effective post-training. In parallel,…

机器人学 · 计算机科学 2026-03-11 Yifan Han , Zhongxi Chen , Yuxuan Zhao , Congsheng Xu , Yanming Shao , Yichuan Peng , Yao Mu , Wenzhao Lian

Vision-Language-Action (VLA) models have recently become highly prominent in the field of robotics. Leveraging vision-language foundation models trained on large-scale internet data, the VLA model can generate robotic actions directly from…

机器人学 · 计算机科学 2025-05-19 Wei Zhao , Gongsheng Li , Zhefei Gong , Pengxiang Ding , Han Zhao , Donglin Wang
‹ 上一页 1 2 3 10 下一页 ›