中文
相关论文

相关论文: BLaDA: Bridging Language to Functional Dexterous A…

200 篇论文

Vision-Language-Action (VLA) models have recently emerged, demonstrating strong generalization in robotic scene understanding and manipulation. However, when confronted with long-horizon tasks that require defined goal states, such as LEGO…

Gaussian Splatting (GS) has recently marked a significant advancement in 3D reconstruction, delivering both rapid rendering and high-quality results. However, existing 3DGS methods pose challenges in understanding underlying 3D semantics,…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Yuyang Zhang , Baao Xie , Hu Zhu , Qi Wang , Huanting Guo , Xin Jin , Wenjun Zeng

Recent advances in 3D Gaussian Splatting (3DGS) have enabled Simultaneous Localization and Mapping (SLAM) systems to build photorealistic maps. However, these maps lack the open-vocabulary semantic understanding required for advanced…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Sibaek Lee , Seongbo Ha , Kyeongsu Kang , Joonyeol Choi , Seungjun Tak , Hyeonwoo Yu

This paper presents a novel hierarchical alignment model (HAM) that learns multi-granularity visual and linguistic representations in an end-to-end manner. We extract key points and proposal points to model 3D contexts and instances, and…

计算机视觉与模式识别 · 计算机科学 2023-06-12 Jiaming Chen , Weixin Luo , Ran Song , Xiaolin Wei , Lin Ma , Wei Zhang

Vision-Language-Action (VLA) models have shown remarkable success in robotic tasks like manipulation by fusing a language model's reasoning with a vision model's 3D understanding. However, their high computational cost remains a major…

机器人学 · 计算机科学 2026-03-18 Zebin Yang , Yijiahao Qi , Tong Xie , Bo Yu , Shaoshan Liu , Meng Li

Reinforcement learning (RL) has achieved great success in dexterous grasping, significantly improving grasp performance and generalization from simulation to the real world. However, fine-grained functional grasping, which is essential for…

机器人学 · 计算机科学 2025-12-16 Chuan Mao , Haoqi Yuan , Ziye Huang , Chaoyi Xu , Kai Ma , Zongqing Lu

Multimodal Large Language Models (MLLMs) exhibit impressive capabilities across a variety of tasks, especially when equipped with carefully designed visual prompts. However, existing studies primarily focus on logical reasoning and visual…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Dingning Liu , Cheng Wang , Peng Gao , Renrui Zhang , Xinzhu Ma , Yuan Meng , Zhihui Wang

Open-vocabulary 3D visual grounding aims to localize target objects based on free-form language queries, which is crucial for embodied AI applications such as autonomous navigation, robotics, and augmented reality. Learning 3D language…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Zhenyang Liu , Sixiao Zheng , Siyu Chen , Cairong Zhao , Longfei Liang , Xiangyang Xue , Yanwei Fu

Autonomous driving systems face significant challenges in achieving human-like adaptability, robustness, and interpretability in complex, open-world environments. These challenges stem from fragmented architectures, limited generalization…

机器人学 · 计算机科学 2025-08-01 Yi Zhang , Erik Leo Haß , Kuo-Yi Chao , Nenad Petrovic , Yinglei Song , Chengdong Wu , Alois Knoll

Language-guided robot dexterous generation enables robots to grasp and manipulate objects based on human commands. However, previous data-driven methods are hard to understand intention and execute grasping with unseen categories in the…

机器人学 · 计算机科学 2025-07-31 Yi-Lin Wei , Mu Lin , Yuhao Lin , Jian-Jian Jiang , Xiao-Ming Wu , Ling-An Zeng , Wei-Shi Zheng

Despite the prevalence of transparent object interactions in human everyday life, transparent robotic manipulation research remains limited to short-horizon tasks and basic grasping capabilities. Although some methods have partially…

机器人学 · 计算机科学 2026-02-25 Taeyeop Lee , Gyuree Kang , Bowen Wen , Youngho Kim , Seunghyeok Back , In So Kweon , David Hyunchul Shim , Kuk-Jin Yoon

Achieving reliable robotic manipulation, such as dexterous grasping, requires a synergy between physically stable interactions and semantic task guidance, yet these objectives are often treated as separate, disjoint goals. In this paper, we…

机器人学 · 计算机科学 2026-05-14 Han Yi Shin , Heeju Ko , Jaewon Mun , Qixing Huang , Jaehyeok Lee , Sung June Kim , Honglak Lee , Sujin Jang , Sangpil Kim

Pretrained vision-language models (VLMs), such as CLIP, achieve remarkable zero-shot performance, yet their downstream potential hinges on effective fine-tuning. Most adaptation methods typically focus on refining representation from…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Liang Chen , Ghazi Shazan Ahmad , Tianjun Yao , Lingqiao Liu , Zhiqiang Shen

3D perceptual representations are well suited for robot manipulation as they easily encode occlusions and simplify spatial reasoning. Many manipulation tasks require high spatial precision in end-effector pose prediction, which typically…

机器人学 · 计算机科学 2023-10-23 Theophile Gervet , Zhou Xian , Nikolaos Gkanatsios , Katerina Fragkiadaki

As multimodal language models advance, their application to 3D scene understanding is a fast-growing frontier, driving the development of 3D Vision-Language Models (VLMs). Current methods show strong dependence on object detectors,…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Anna-Maria Halacheva , Jan-Nico Zaech , Xi Wang , Danda Pani Paudel , Luc Van Gool

Vision-language-action (VLA) models have shown strong performance in robotic manipulation, yet their robustness to physically realizable adversarial attacks remains underexplored. Existing studies reveal vulnerabilities through language…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Jiawei Chen , Simin Huang , Jiawei Du , Shuaihang Chen , Yu Tian , Mingjie Wei , Chao Yu , Zhaoxia Yin

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

机器人学 · 计算机科学 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain

As aerial platforms evolve from passive observers to active manipulators, the challenge shifts toward designing intuitive interfaces that allow non-expert users to command these systems naturally. This work introduces a novel concept of…

Vision-Language-Action (VLA) models have recently emerged as powerful generalists for robotic manipulation. However, due to their predominant reliance on visual modalities, they fundamentally lack the physical intuition required for…

机器人学 · 计算机科学 2026-02-02 Yuzhe Huang , Pei Lin , Wanlin Li , Daohan Li , Jiajun Li , Jiaming Jiang , Chenxi Xiao , Ziyuan Jiao

Reasoning about spatial relationships between objects is essential for many real-world robotic tasks, such as fetch-and-delivery, object rearrangement, and object search. The ability to detect and disambiguate different objects and identify…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Negar Nejatishahidin , Madhukar Reddy Vongala , Jana Kosecka