English
Related papers

Related papers: BLaDA: Bridging Language to Functional Dexterous A…

200 papers

The heterogeneity between high-level vision-language understanding and low-level action control remains a fundamental challenge in robotic manipulation. Although recent methods have advanced task-specific action alignment, they often…

Robotics · Computer Science 2026-03-16 Wuding Weng , Tongshu Wu , Liucheng Chen , Siyu Xie , Zheng Wang , Xing Xu , Jingkuan Song , Heng Tao Shen

Dexterous manipulation is essential for real-world robot autonomy, mirroring the central role of human hand coordination in daily activity. Humans rely on rich multimodal perception--vision, sound, and language-guided intent--to perform…

In this paper, we claim that spatial understanding is the keypoint in robot manipulation, and propose SpatialVLA to explore effective spatial representations for the robot foundation model. Specifically, we introduce Ego3D Position Encoding…

Robotics · Computer Science 2025-05-20 Delin Qu , Haoming Song , Qizhi Chen , Yuanqi Yao , Xinyi Ye , Yan Ding , Zhigang Wang , JiaYuan Gu , Bin Zhao , Dong Wang , Xuelong Li

Acquiring dexterous robotic skills from human video demonstrations remains a significant challenge, largely due to conventional reliance on low-level trajectory replication, which often fails to generalize across varying objects, spatial…

Robotics · Computer Science 2025-09-10 Shunlei Li , Longsen Gao , Jiuwen Cao , Yingbai Hu

3D medical images such as computed tomography are widely used in clinical practice, offering a great potential for automatic diagnosis. Supervised learning-based approaches have achieved significant progress but rely heavily on extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Haoran Lai , Zihang Jiang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Weifu Lv , Wei Wei , S. Kevin Zhou

3D scene reconstruction and understanding have gained increasing popularity, yet existing methods still struggle to capture fine-grained, language-aware 3D representations from 2D images. In this paper, we present GALA, a novel framework…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Elena Alegret , Kunyi Li , Sen Wang , Siyun Liang , Michael Niemeyer , Stefano Gasperini , Nassir Navab , Federico Tombari

Vision-language-action models have emerged as a crucial paradigm in robotic manipulation. However, existing VLA models exhibit notable limitations in handling ambiguous language instructions and unknown environmental states. Furthermore,…

Robotics · Computer Science 2025-08-26 Helong Huang , Min Cen , Kai Tan , Xingyue Quan , Guowei Huang , Hong Zhang

Vision-language-action models (VLAs) have shown generalization capabilities in robotic manipulation tasks by inheriting from vision-language models (VLMs) and learning action generation. Most VLA models focus on interpreting vision and…

Implicit spatial relations and deep semantic structures encoded in object attributes are crucial for procedural planning in embodied AI systems. However, existing approaches often over rely on the reasoning capabilities of vision language…

Robotics · Computer Science 2026-04-21 Kun Wang , Yiming Li , Mingcheng Qu , Aqiang Zhang , Guang Yang , Tonghua Su

Robotic grasping is a fundamental capability for enabling autonomous manipulation, with usually infinite solutions. State-of-the-art approaches for grasping rely on learning from large-scale datasets comprising expert annotations of…

Robotics · Computer Science 2026-03-17 Manav Kulshrestha , S. Talha Bukhari , Damon Conover , Aniket Bera

As large models gain traction, vision-language-action (VLA) systems are enabling robots to tackle increasingly complex tasks. However, limited by the difficulty of data collection, progress has mainly focused on controlling simple gripper…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Jiawei He , Danshi Li , Xinqiang Yu , Zekun Qi , Wenyao Zhang , Jiayi Chen , Zhaoxiang Zhang , Zhizheng Zhang , Li Yi , He Wang

Vision-Language-Action models have achieved remarkable progress in robotic manipulation, yet they suffer from a critical limitation: a lack of 3D scene understanding. This deficiency manifests as three intertwined challenges: weak…

Robotics · Computer Science 2026-05-29 Zhongyu Xia , Yousen Tang , Bingqing Wei , Yongtao Wang

Autonomous drones capable of interpreting and executing high-level language instructions in unstructured environments remain a long-standing goal. Yet existing approaches are constrained by their dependence on hand-crafted skills, extensive…

Robotics · Computer Science 2026-05-19 Qianzhong Chen , Naixiang Gao , Suning Huang , JunEn Low , Timothy Chen , Jiankai Sun , Mac Schwager

Dexterous grasping remains a fundamental yet challenging problem in robotics. A general-purpose robot must be capable of grasping diverse objects in arbitrary scenarios. However, existing research typically relies on restrictive…

Robotic manipulation in 3D requires effective computation of N degree-of-freedom joint-space trajectories that enable precise and robust control. To achieve this, robots must integrate semantic understanding with visual perception to…

Robotics · Computer Science 2026-03-31 Vineet Bhat , Yu-Hsiang Lan , Prashanth Krishnamurthy , Ramesh Karri , Farshad Khorrami

Grasping is one of the most fundamental challenging capabilities in robotic manipulation, especially in unstructured, cluttered, and semantically diverse environments. Recent researches have increasingly explored language-guided…

Robotics · Computer Science 2025-12-25 Zebin Jiang , Tianle Jin , Xiangtong Yao , Alois Knoll , Hu Cao

Task-oriented dexterous grasping holds broad application prospects in robotic manipulation and human-object interaction. However, most existing methods still struggle to generalize across diverse objects and task instructions, as they…

Robotics · Computer Science 2025-11-18 Juntao Jian , Yi-Lin Wei , Chengjie Mou , Yuhao Lin , Xing Zhu , Yujun Shen , Wei-Shi Zheng , Ruizhen Hu

Open-vocabulary 3D visual grounding and reasoning aim to localize objects in a scene based on implicit language descriptions, even when they are occluded. This ability is crucial for tasks such as vision-language navigation and autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zhenyang Liu , Yikai Wang , Sixiao Zheng , Tongying Pan , Longfei Liang , Yanwei Fu , Xiangyang Xue

Vision-Language-Action (VLA) models show promise for robotic control, yet performance in complex household environments remains sub-optimal. Mobile manipulation requires reasoning about global scene layout, fine-grained geometry, and…

Robotics · Computer Science 2026-03-25 Ruisen Tu , Arth Shukla , Sohyun Yoo , Xuanlin Li , Junxi Li , Jianwen Xie , Hao Su , Zhuowen Tu

Recent Vision-Language-Action (VLA) models have made impressive progress toward general-purpose robotic manipulation by post-training large Vision-Language Models (VLMs) for action prediction. Yet most VLAs entangle perception and control…

‹ Prev 1 2 3 10 Next ›