English
Related papers

Related papers: BLaDA: Bridging Language to Functional Dexterous A…

200 papers

Robotic grasping is a primitive skill for complex tasks and is fundamental to intelligence. For general 6-Dof grasping, most previous methods directly extract scene-level semantic or geometric information, while few of them consider the…

Robotics · Computer Science 2024-10-08 Pengwei Xie , Siang Chen , Wei Tang , Dingchang Hu , Wenming Yang , Guijin Wang

Vision-Language-Action (VLA) models have advanced general-purpose robotic manipulation by leveraging pretrained visual and linguistic representations. However, they struggle with contact-rich tasks that require fine-grained control…

We present ForceSight, a system for text-guided mobile manipulation that predicts visual-force goals using a deep neural network. Given a single RGBD image combined with a text prompt, ForceSight determines a target end-effector pose in the…

Robotics · Computer Science 2023-09-26 Jeremy A. Collins , Cody Houff , You Liang Tan , Charles C. Kemp

Spatial perception and reasoning are crucial for Vision-Language-Action (VLA) models to accomplish fine-grained manipulation tasks. However, existing approaches often lack the ability to understand and reason over the essential 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yixuan Li , Yuhui Chen , Mingcai Zhou , Haoran Li , Zhengtao Zhang , Dongbin Zhao

While Vision-Language-Action (VLA) models have revolutionized autonomous driving by unifying perception and planning, their reliance on explicit textual Chain-of-Thought (CoT) leads to semantic-perceptual decoupling and perceptual-symbolic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yuechen Luo , Fang Li , Shaoqing Xu , Yang Ji , Zehan Zhang , Bing Wang , Yuannan Shen , Jianwei Cui , Long Chen , Guang Chen , Hangjun Ye , Zhi-Xin Yang , Fuxi Wen

Object navigation is a core capability of embodied intelligence, enabling an agent to locate target objects in unknown environments. Recent advances in vision-language models (VLMs) have facilitated zero-shot object navigation (ZSON).…

Robotics · Computer Science 2026-02-13 Wancai Zheng , Hao Chen , Xianlong Lu , Linlin Ou , Xinyi Yu

Dexterous manipulation remains challenging due to the cost of collecting real-robot teleoperation data, the heterogeneity of hand embodiments, and the high dimensionality of control. We present UniDex, a robot foundation suite that couples…

Embodied intelligence fundamentally requires a capability to determine where to act in 3D space. We formalize this requirement as embodied localization -- the problem of predicting executable 3D points conditioned on visual observations and…

Robotics · Computer Science 2026-03-31 Qiming Zhu , Zhirui Fang , Tianming Zhang , Chuanxiu Liu , Xiaoke Jiang , Lei Zhang

Embodied intelligence for contact-rich manipulation has predominantly relied on position control, while explicit awareness and regulation of interaction forces remain under-explored, limiting stability, precision, and robustness in…

3D vision-language (VL) reasoning has gained significant attention due to its potential to bridge the 3D physical world with natural language descriptions. Existing approaches typically follow task-specific, highly specialized paradigms.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Hao Liu , Yanni Ma , Yan Liu , Haihong Xiao , Ying He

Existing Vision-Language-Action (VLA) models often suffer from feature collapse and low training efficiency because they entangle high-level perception with sparse, embodiment-specific action supervision. Since these models typically rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Haitao Lin , Hanyang Yu , Jingshun Huang , He Zhang , Yonggen Ling , Ping Tan , Xiangyang Xue , Yanwei Fu

This paper presents a novel approach for pretraining robotic manipulation Vision-Language-Action (VLA) models using a large corpus of unscripted real-life video recordings of human hand activities. Treating human hand as dexterous robot…

Many robotic manipulation tasks require sensing and responding to force signals such as torque to assess whether the task has been successfully completed and to enable closed-loop control. However, current Vision-Language-Action (VLA)…

Robotics · Computer Science 2025-09-10 Zongzheng Zhang , Haobo Xu , Zhuo Yang , Chenghao Yue , Zehao Lin , Huan-ang Gao , Ziwei Wang , Hao Zhao

Vision language action (VLA) models enable generalist robotic agents but often exhibit language ignorance, relying on visual shortcuts and remaining insensitive to instruction changes. We present Prospective Grounding and Alignment VLA…

Robotics · Computer Science 2026-04-14 Nastaran Darabi , Amit Ranjan Trivedi

Establishing dense correspondence across 3D shapes is crucial for fundamental downstream tasks, including texture transfer, shape interpolation, and robotic manipulation. However, learning these mappings without manual supervision remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qinfeng Xiao , Guofeng Mei , Qilong Liu , Chenyuan Yi , Fabio Poiesi , Jian Zhang , Bo Yang , Yick Kit-lun

Embodied agents face a critical dilemma that end-to-end models lack interpretability and explicit 3D reasoning, while modular systems ignore cross-component interdependencies and synergies. To bridge this gap, we propose the Dynamic 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zihan Wang , Seungjun Lee , Guangzhao Dai , Gim Hee Lee

Functional grasping is essential for humans to perform specific tasks, such as grasping scissors by the finger holes to cut materials or by the blade to safely hand them over. Enabling dexterous robot hands with functional grasping…

Robotics · Computer Science 2024-11-27 Linyi Huang , Hui Zhang , Zijian Wu , Sammy Christen , Jie Song

Vision-Language-Action (VLA) models offer promising capabilities for autonomous driving through multimodal understanding. However, their utilization in safety-critical scenarios is constrained by inherent limitations, including imprecise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yiru Wang , Zichong Gu , Yu Gao , Anqing Jiang , Zhigang Sun , Shuo Wang , Yuwen Heng , Hao Sun

Vision-language-action (VLA) policies have advanced language-conditioned robotic manipulation by transferring semantic priors from pretrained vision-language models to action generation. However, standard action-imitation learning often…

Robotics · Computer Science 2026-05-29 Zijian Zhang , Yuqing Jiang , Qian Cheng , Xiaofan Li , Si Liu , Ding Zhao , Ping Luo , Weitao Zhou , Haibao Yu

Dexterous robotic manipulation remains a longstanding challenge in robotics due to the high dimensionality of control spaces and the semantic complexity of object interaction. In this paper, we propose an object affordance-guided…