中文
相关论文

相关论文: NORA: A Small Open-Sourced Generalist Vision Langu…

200 篇论文

Vision-Language-Action (VLA) models empower robots to understand and execute tasks described by natural language instructions. However, a key challenge lies in their ability to generalize beyond the specific environments and conditions they…

Vision-language-action (VLA) models have shown strong generalization for robotic action prediction through large-scale vision-language pretraining. However, most existing models rely solely on RGB cameras, limiting their perception and,…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Heyu Guo , Shanmu Wang , Ruichun Ma , Shiqi Jiang , Yasaman Ghasempour , Omid Abari , Baining Guo , Lili Qiu

Vision-language-action (VLA) models integrate visual observations and language instructions to predict robot actions, demonstrating promising generalization in manipulation tasks. However, most existing approaches primarily rely on direct…

机器人学 · 计算机科学 2026-03-02 Jiasong Xiao , Yutao She , Kai Li , Yuyang Sha , Ziang Cheng , Ziang Tong

Vision-Language-Action (VLA) models have gained much attention from the research community thanks to their strength in translating multimodal observations with linguistic instructions into desired robotic actions. Despite their…

机器人学 · 计算机科学 2026-04-21 Tuan Van Vo , Tan Q. Nguyen , Khang Nguyen , Nhat Xuan Tran , Duy H. M. Nguyen , An T. Le , Ngo Anh Vien , Minh Nhat Vu

Vision-Language-Action (VLA) models are promising for generalist robot manipulation but remain brittle in out-of-distribution (OOD) settings, especially with limited real-robot data. To resolve the generalization bottleneck, we introduce a…

Generalization remains a core challenge in embodied AI, as robots must adapt to diverse environments. While OpenVLA represents the State-of-the-Art (SOTA) in Vision-Language-Action models by leveraging large-scale pre-training, its…

人工智能 · 计算机科学 2026-03-18 Dongik Shin

Most existing vision-language-action (VLA) models for robotic manipulation lack progress awareness, typically relying on hand-crafted heuristics for task termination. This limitation is particularly severe in long-horizon tasks involving…

机器人学 · 计算机科学 2026-03-31 Hongyu Yan , Qiwei Li , Jiaolong Yang , Yadong Mu

Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for robotic manipulation, in which reliable action prediction critically depends on accurately interpreting and integrating visual observations conditioned on…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Yulin Luo , Hao Chen , Zhuangzhe Wu , Bowen Sui , Jiaming Liu , Chenyang Gu , Zhuoyang Liu , Qiuxuan Feng , Jiale Yu , Shuo Gu , Peng Jia , Pheng-Ann Heng , Shanghang Zhang

Vision-Language-Action (VLA) models have shown strong performance on embodied manipulation, yet they remain brittle under visual observation changes, paraphrased language instructions, and compounded perturbations. This limitation suggests…

机器人学 · 计算机科学 2026-05-20 Jingzhou Luo , Yifan Wen , Yongjie Bai , Xinshuai Song , Yang Liu , Liang Lin

Humans can flexibly interpret and compose different goal specifications, such as language instructions, spatial coordinates, or visual references, when navigating to a destination. In contrast, most existing robotic navigation policies are…

机器人学 · 计算机科学 2025-09-25 Noriaki Hirose , Catherine Glossop , Dhruv Shah , Sergey Levine

Vision-based robotic policies often struggle with even minor viewpoint changes, underscoring the need for view-invariant visual representations. This challenge becomes more pronounced in real-world settings, where viewpoint variability is…

机器人学 · 计算机科学 2026-01-07 Youngjoon Jeong , Junha Chun , Taesup Kim

Magnetically actuated microrobots have been used as wireless, non-contact manipulation tools at microscales, making them promising for minimally invasive applications. However, their control remains challenging due to indirect actuation,…

机器人学 · 计算机科学 2026-05-28 Yongchen Wang , Kangyi Lu , Lan Wei , Dandan Zhang

Vision-Language-Action (VLA) models show promise in embodied reasoning, yet remain far from true generalists-they often require task-specific fine-tuning, incur high compute costs, and generalize poorly to unseen tasks. We propose MetaVLA,…

人工智能 · 计算机科学 2026-01-29 Chen Li , Zhantao Yang , Han Zhang , Fangyi Chen , Chenchen Zhu , Anudeepsekhar Bolimera , Marios Savvides

Vision-language-action models (VLAs) have become increasingly popular in robot manipulation for their end-to-end design and remarkable performance. However, existing VLAs rely heavily on vision-language models (VLMs) that only support…

机器人学 · 计算机科学 2025-02-24 Wei Zhao , Pengxiang Ding , Min Zhang , Zhefei Gong , Shuanghao Bai , Han Zhao , Donglin Wang

Current Vision-Language-Action (VLA) models typically treat the deepest representation of a vision-language backbone as universally optimal for action prediction. However, robotic manipulation is composed of many frequent closed-loop…

人工智能 · 计算机科学 2026-05-12 Boyang Shen , Kaixiang Yang , Hao Wang , Qiuyu Yu , Qiang Xie , Qiang Li , Zhiwei Wang

In modern healthcare, the demand for autonomous robotic assistants has grown significantly, particularly in the operating room, where surgical tasks require precision and reliability. Robotic scrub nurses have emerged as a promising…

机器人学 · 计算机科学 2024-10-01 Shunlei Li , Jin Wang , Rui Dai , Wanyu Ma , Wing Yin Ng , Yingbai Hu , Zheng Li

Vision-Language-Action (VLA) models are a powerful paradigm for generalist robotic control. However, their high computational cost and limited control frequency hinder real-time robotic manipulation, especially when large vision-language…

机器人学 · 计算机科学 2026-05-29 Ye Li , Huanan Liu , Kangye Ji , Yuan Meng , Jiajun Fan , Yuansong Wang , Shiyu Qin , Chenglei Wu , Shu-Tao Xia , Zhi Wang

Recent advancements in Vision-Language-Action (VLA) models have leveraged pre-trained Vision-Language Models (VLMs) to improve the generalization capabilities. VLMs, typically pre-trained on vision-language understanding tasks, provide rich…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Jianke Zhang , Yanjiang Guo , Yucheng Hu , Xiaoyu Chen , Xiang Zhu , Jianyu Chen

In this study, we are interested in imbuing robots with the capability of physically-grounded task planning. Recent advancements have shown that large language models (LLMs) possess extensive knowledge useful in robotic tasks, especially in…

机器人学 · 计算机科学 2023-12-27 Yingdong Hu , Fanqi Lin , Tong Zhang , Li Yi , Yang Gao

Recent studies have successfully integrated large vision-language models (VLMs) into low-level robotic control by supervised fine-tuning (SFT) with expert robotic datasets, resulting in what we term vision-language-action (VLA) models.…

机器人学 · 计算机科学 2025-01-29 Yanjiang Guo , Jianke Zhang , Xiaoyu Chen , Xiang Ji , Yen-Jen Wang , Yucheng Hu , Jianyu Chen