English
Related papers

Related papers: BLaDA: Bridging Language to Functional Dexterous A…

200 papers

Vision-Language-Action (VLA) models have recently emerged, demonstrating strong generalization in robotic scene understanding and manipulation. However, when confronted with long-horizon tasks that require defined goal states, such as LEGO…

Gaussian Splatting (GS) has recently marked a significant advancement in 3D reconstruction, delivering both rapid rendering and high-quality results. However, existing 3DGS methods pose challenges in understanding underlying 3D semantics,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yuyang Zhang , Baao Xie , Hu Zhu , Qi Wang , Huanting Guo , Xin Jin , Wenjun Zeng

Recent advances in 3D Gaussian Splatting (3DGS) have enabled Simultaneous Localization and Mapping (SLAM) systems to build photorealistic maps. However, these maps lack the open-vocabulary semantic understanding required for advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Sibaek Lee , Seongbo Ha , Kyeongsu Kang , Joonyeol Choi , Seungjun Tak , Hyeonwoo Yu

This paper presents a novel hierarchical alignment model (HAM) that learns multi-granularity visual and linguistic representations in an end-to-end manner. We extract key points and proposal points to model 3D contexts and instances, and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Jiaming Chen , Weixin Luo , Ran Song , Xiaolin Wei , Lin Ma , Wei Zhang

Vision-Language-Action (VLA) models have shown remarkable success in robotic tasks like manipulation by fusing a language model's reasoning with a vision model's 3D understanding. However, their high computational cost remains a major…

Robotics · Computer Science 2026-03-18 Zebin Yang , Yijiahao Qi , Tong Xie , Bo Yu , Shaoshan Liu , Meng Li

Reinforcement learning (RL) has achieved great success in dexterous grasping, significantly improving grasp performance and generalization from simulation to the real world. However, fine-grained functional grasping, which is essential for…

Robotics · Computer Science 2025-12-16 Chuan Mao , Haoqi Yuan , Ziye Huang , Chaoyi Xu , Kai Ma , Zongqing Lu

Multimodal Large Language Models (MLLMs) exhibit impressive capabilities across a variety of tasks, especially when equipped with carefully designed visual prompts. However, existing studies primarily focus on logical reasoning and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Dingning Liu , Cheng Wang , Peng Gao , Renrui Zhang , Xinzhu Ma , Yuan Meng , Zhihui Wang

Open-vocabulary 3D visual grounding aims to localize target objects based on free-form language queries, which is crucial for embodied AI applications such as autonomous navigation, robotics, and augmented reality. Learning 3D language…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Zhenyang Liu , Sixiao Zheng , Siyu Chen , Cairong Zhao , Longfei Liang , Xiangyang Xue , Yanwei Fu

Autonomous driving systems face significant challenges in achieving human-like adaptability, robustness, and interpretability in complex, open-world environments. These challenges stem from fragmented architectures, limited generalization…

Robotics · Computer Science 2025-08-01 Yi Zhang , Erik Leo Haß , Kuo-Yi Chao , Nenad Petrovic , Yinglei Song , Chengdong Wu , Alois Knoll

Language-guided robot dexterous generation enables robots to grasp and manipulate objects based on human commands. However, previous data-driven methods are hard to understand intention and execute grasping with unseen categories in the…

Robotics · Computer Science 2025-07-31 Yi-Lin Wei , Mu Lin , Yuhao Lin , Jian-Jian Jiang , Xiao-Ming Wu , Ling-An Zeng , Wei-Shi Zheng

Despite the prevalence of transparent object interactions in human everyday life, transparent robotic manipulation research remains limited to short-horizon tasks and basic grasping capabilities. Although some methods have partially…

Achieving reliable robotic manipulation, such as dexterous grasping, requires a synergy between physically stable interactions and semantic task guidance, yet these objectives are often treated as separate, disjoint goals. In this paper, we…

Robotics · Computer Science 2026-05-14 Han Yi Shin , Heeju Ko , Jaewon Mun , Qixing Huang , Jaehyeok Lee , Sung June Kim , Honglak Lee , Sujin Jang , Sangpil Kim

Pretrained vision-language models (VLMs), such as CLIP, achieve remarkable zero-shot performance, yet their downstream potential hinges on effective fine-tuning. Most adaptation methods typically focus on refining representation from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Liang Chen , Ghazi Shazan Ahmad , Tianjun Yao , Lingqiao Liu , Zhiqiang Shen

3D perceptual representations are well suited for robot manipulation as they easily encode occlusions and simplify spatial reasoning. Many manipulation tasks require high spatial precision in end-effector pose prediction, which typically…

Robotics · Computer Science 2023-10-23 Theophile Gervet , Zhou Xian , Nikolaos Gkanatsios , Katerina Fragkiadaki

As multimodal language models advance, their application to 3D scene understanding is a fast-growing frontier, driving the development of 3D Vision-Language Models (VLMs). Current methods show strong dependence on object detectors,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Anna-Maria Halacheva , Jan-Nico Zaech , Xi Wang , Danda Pani Paudel , Luc Van Gool

Vision-language-action (VLA) models have shown strong performance in robotic manipulation, yet their robustness to physically realizable adversarial attacks remains underexplored. Existing studies reveal vulnerabilities through language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiawei Chen , Simin Huang , Jiawei Du , Shuaihang Chen , Yu Tian , Mingjie Wei , Chao Yu , Zhaoxia Yin

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

Robotics · Computer Science 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain

As aerial platforms evolve from passive observers to active manipulators, the challenge shifts toward designing intuitive interfaces that allow non-expert users to command these systems naturally. This work introduces a novel concept of…

Vision-Language-Action (VLA) models have recently emerged as powerful generalists for robotic manipulation. However, due to their predominant reliance on visual modalities, they fundamentally lack the physical intuition required for…

Robotics · Computer Science 2026-02-02 Yuzhe Huang , Pei Lin , Wanlin Li , Daohan Li , Jiajun Li , Jiaming Jiang , Chenxi Xiao , Ziyuan Jiao

Reasoning about spatial relationships between objects is essential for many real-world robotic tasks, such as fetch-and-delivery, object rearrangement, and object search. The ability to detect and disambiguate different objects and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Negar Nejatishahidin , Madhukar Reddy Vongala , Jana Kosecka