中文
相关论文

相关论文: BLaDA: Bridging Language to Functional Dexterous A…

200 篇论文

Dexterous grasp generation aims to produce grasp poses that align with task requirements and human interpretable grasp semantics. However, achieving semantically controllable dexterous grasp synthesis remains highly challenging due to the…

We present ASAP, a new framework for detecting and grounding multi-modal media manipulation (DGM4).Upon thorough examination, we observe that accurate fine-grained cross-modal semantic alignment between the image and text is vital for…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Zhenxing Zhang , Yaxiong Wang , Lechao Cheng , Zhun Zhong , Dan Guo , Meng Wang

3D Visual Grounding (3DVG) aims at localizing 3D object based on textual descriptions. Conventional supervised methods for 3DVG often necessitate extensive annotations and a predefined vocabulary, which can be restrictive. To address this…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Zhihao Yuan , Jinke Ren , Chun-Mei Feng , Hengshuang Zhao , Shuguang Cui , Zhen Li

The emergence of vision language models (VLMs) bridges the gap between vision and language, enabling multimodal understanding beyond traditional visual-only deep learning models. However, transferring VLMs from the natural image domain to…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Boyi Li , Ce Zhang , Richard M. Timmerman , Wenxuan Bao

Robust humanoid locomotion requires accurate and globally consistent perception of the surrounding 3D environment. However, existing perception modules, mainly based on depth images or elevation maps, offer only partial and locally…

机器人学 · 计算机科学 2025-11-19 Qingwei Ben , Botian Xu , Kailin Li , Feiyu Jia , Wentao Zhang , Jingping Wang , Jingbo Wang , Dahua Lin , Jiangmiao Pang

3D Gaussian Splatting SLAM has emerged as a widely used technique for high-fidelity mapping in spatial intelligence. However, existing methods often rely on a single representation scheme, which limits their performance in large-scale…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Wenkai Zhu , Xu Li , Qimin Xu , Benwu Wang , Kun Wei , Yiming Peng , Zihang Wang

This paper introduces Unified Language-driven Zero-shot Domain Adaptation (ULDA), a novel task setting that enables a single model to adapt to diverse target domains without explicit domain-ID knowledge. We identify the constraints in the…

计算机视觉与模式识别 · 计算机科学 2024-04-11 Senqiao Yang , Zhuotao Tian , Li Jiang , Jiaya Jia

Task-oriented grasping is a crucial yet challenging task in robotic manipulation. Despite the recent progress, few existing methods address task-oriented grasping with dexterous hands. Dexterous hands provide better precision and…

机器人学 · 计算机科学 2026-01-12 Weishang Wu , Yifei Shi , Zhizhong Chen , Zhipong Cai

Vision-language-action (VLA) models have recently emerged as a promising paradigm for robotic control, enabling end-to-end policies that ground natural language instructions into visuomotor actions. However, current VLAs often struggle to…

机器人学 · 计算机科学 2025-09-18 Zijian An , Ran Yang , Yiming Feng , Lifeng Zhou

Learning to ground natural language queries to target objects or regions in 3D point clouds is quite essential for 3D scene understanding. Nevertheless, existing 3D visual grounding approaches require a substantial number of bounding box…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Xiaoxu Xu , Yitian Yuan , Qiudan Zhang , Wenhui Wu , Zequn Jie , Lin Ma , Xu Wang

Enabling humanoid robots to follow free-form natural language commands is a critical step toward seamless human-robot interaction and general-purpose embodied AI. However, existing methods remain limited, often constrained to simple…

机器人学 · 计算机科学 2026-05-12 Zhirui Liu , Kaiyang Ji , Ke Yang , Yahao Fan , Jingyi Yu , Ye Shi , Jingya Wang

Vision-Language-Action (VLA) models have emerged as a promising paradigm for grounding visual-language understanding into real-world robotic manipulation. However, dexterous manipulation remains challenging for VLA policies due to…

机器人学 · 计算机科学 2026-05-29 Zhongxi Chen , Yifan Han , Yanming Shao , Huanming Liu , Congsheng Xu , Xiaoyu Chen , Yao Mu , Wenzhao Lian

In this paper, we propose a flexible SLAM framework, XRDSLAM. It adopts a modular code design and a multi-process running mechanism, providing highly reusable foundational modules such as unified dataset management, 3d visualization,…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Xiaomeng Wang , Nan Wang , Guofeng Zhang

Vision-Language-Action (VLA) models have recently become a central direction in embodied AI, but current systems are restricted to either dual-gripper control or single-arm dexterous hand manipulation. While low-dimensional gripper control…

Force sensing is a crucial modality for Vision-Language-Action (VLA) frameworks, as it enables fine-grained perception and dexterous manipulation in contact-rich tasks. We present Force-Distilled VLA (FD-VLA), a novel framework that…

机器人学 · 计算机科学 2026-03-23 Ruiteng Zhao , Wenshuo Wang , Yicheng Ma , Xiaocong Li , Francis E. H. Tay , Marcelo H. Ang , Haiyue Zhu

The reliance on language in Vision-Language-Action (VLA) models introduces ambiguity, cognitive overhead, and difficulties in precise object identification and sequential task execution, particularly in environments with multiple visually…

机器人学 · 计算机科学 2026-03-02 Donggeon Kim , Seungwon Jan , Hyeonjun Park , Daegyu Lim

In recent years, as robotics has advanced, human-robot collaboration has gained increasing importance. However, current robots struggle to fully and accurately interpret human intentions from voice commands alone. Traditional gripper and…

机器人学 · 计算机科学 2024-12-17 Junliang Li , Kai Ye , Haolan Kang , Mingxuan Liang , Yuhang Wu , Zhenhua Liu , Huiping Zhuang , Rui Huang , Yongquan Chen

Articulated object manipulation remains a critical challenge in robotics due to the complex kinematic constraints and the limited physical reasoning of existing methods. In this work, we introduce ArtGS, a novel framework that extends 3D…

机器人学 · 计算机科学 2025-07-04 Qiaojun Yu , Xibin Yuan , Yu jiang , Junting Chen , Dongzhe Zheng , Ce Hao , Yang You , Yixing Chen , Yao Mu , Liu Liu , Cewu Lu

Achieving diverse and stable dexterous grasping for general and deformable objects remains a fundamental challenge in robotics, due to high-dimensional action spaces and uncertainty in perception. In this paper, we present D3Grasp, a…

机器人学 · 计算机科学 2025-09-25 Keyu Wang , Bingcong Lu , Zhengxue Cheng , Hengdi Zhang , Li Song

We introduce OG-VLA, a novel architecture and learning framework that combines the generalization strengths of Vision Language Action models (VLAs) with the robustness of 3D-aware policies. We address the challenge of mapping natural…

机器人学 · 计算机科学 2025-11-19 Ishika Singh , Ankit Goyal , Stan Birchfield , Dieter Fox , Animesh Garg , Valts Blukis