English
Related papers

Related papers: SynHLMA:Synthesizing Hand Language Manipulation fo…

200 papers

Recent progress in 3D hand--object interaction (HOI) generation has primarily focused on single--hand grasp synthesis, while bimanual manipulation remains significantly more challenging. Long--horizon planning instability, fine--grained…

Robotics · Computer Science 2026-03-11 Zhi Wang , Liu Liu , Ruonan Liu , Dan Guo , Meng Wang

Large-scale articulated objects with high quality are desperately needed for multiple tasks related to embodied AI. Most existing methods for creating articulated objects are either data-driven or simulation based, which are limited by the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Xinyu Lian , Zichao Yu , Ruiming Liang , Yitong Wang , Li Ray Luo , Kaixu Chen , Yuanzhen Zhou , Qihong Tang , Xudong Xu , Zhaoyang Lyu , Bo Dai , Jiangmiao Pang

Grasping is an important human activity that has long been studied in robotics, computer vision, and cognitive science. Most existing works study grasping from the perspective of synthesizing hand poses conditioned on 3D or 2D object…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Chaerin Min , Srinath Sridhar

The hand plays a pivotal role in human ability to grasp and manipulate objects and controllable grasp synthesis is the key for successfully performing downstream tasks. Existing methods that use human intention or task-level language as…

Artificial Intelligence · Computer Science 2024-04-24 Xiaoyun Chang , Yi Sun

Planning physically feasible dexterous hand manipulation is a central challenge in robotic manipulation and Embodied AI. Prior work typically relies on object-centric cues or precise hand-object interaction sequences, foregoing the rich,…

Robotics · Computer Science 2026-03-03 Zhenhao Zhang , Jiaxin Liu , Ye Shi , Jingya Wang

Creating a diverse and comprehensive dataset of hand gestures for dynamic human-machine interfaces in the automotive domain can be challenging and time-consuming. To overcome this challenge, we propose using synthetic gesture datasets…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Amr Gomaa , Robin Zitt , Guillermo Reyes , Antonio Krüger

Learning to generate dual-hand grasps that respect object semantics is essential for robust hand-object interaction but remains largely underexplored due to dataset scarcity. Existing grasp datasets predominantly focus on single-hand…

Robotics · Computer Science 2025-09-29 Quanzhou Li , Zhonghua Wu , Jingbo Wang , Chen Change Loy , Bo Dai

Recent advances in 3D human-aware generation have made significant progress. However, existing methods still struggle with generating novel Human Object Interaction (HOI) from text, particularly for open-set objects. We identify three main…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jinlu Zhang , Yixin Chen , Zan Wang , Jie Yang , Yizhou Wang , Siyuan Huang

We propose a physics-based method for synthesizing dexterous hand-object interactions in a full-body setting. While recent advancements have addressed specific facets of human-object interactions, a comprehensive physics-based approach…

Robotics · Computer Science 2023-09-15 Jona Braun , Sammy Christen , Muhammed Kocabas , Emre Aksan , Otmar Hilliges

The synthesis of human grasping has numerous applications including AR/VR, video games and robotics. While methods have been proposed to generate realistic hand-object interaction for object grasping and manipulation, these typically only…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Yan Wu , Jiahao Wang , Yan Zhang , Siwei Zhang , Otmar Hilliges , Fisher Yu , Siyu Tang

Robotic grasping of house-hold objects has made remarkable progress in recent years. Yet, human grasps are still difficult to synthesize realistically. There are several key reasons: (1) the human hand has many degrees of freedom (more than…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Korrawe Karunratanakul , Jinlong Yang , Yan Zhang , Michael Black , Krikamol Muandet , Siyu Tang

While increasing attention has been paid to co-speech gesture synthesis, most previous works neglect to investigate hand gestures with explicit and essential semantics. In this paper, we study co-speech gesture generation with an emphasis…

Generating natural human grasps necessitates consideration of not just object geometry but also semantic information. Solely depending on object shape for grasp generation confines the applications of prior methods in downstream tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Kailin Li , Jingbo Wang , Lixin Yang , Cewu Lu , Bo Dai

Dyslexia affects reading and writing skills across many languages. This work describes a new application of YOLO-based object detection to isolate and label handwriting patterns (Normal, Reversal, Corrected) within synthetic images that…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Nora Fink

Functional grasping with dexterous robotic hands is a key capability for enabling tool use and complex manipulation, yet progress has been constrained by two persistent bottlenecks: the scarcity of large-scale datasets and the absence of…

Robotics · Computer Science 2026-01-09 Xingyi He , Adhitya Polavaram , Yunhao Cao , Om Deshmukh , Tianrui Wang , Xiaowei Zhou , Kuan Fang

This paper introduces RoboDexVLM, an innovative framework for robot task planning and grasp detection tailored for a collaborative manipulator equipped with a dexterous hand. Previous methods focus on simplified and limited manipulation…

Robotics · Computer Science 2025-03-04 Haichao Liu , Sikai Guo , Pengfei Mai , Jiahang Cao , Haoang Li , Jun Ma

Synthesizing physically plausible articulated human-object interactions (HOI) without 3D/4D supervision remains a fundamental challenge. While recent zero-shot approaches leverage video diffusion models to synthesize human-object…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Zihao Huang , Tianqi Liu , Zhaoxi Chen , Shaocong Xu , Saining Zhang , Lixing Xiao , Zhiguo Cao , Wei Li , Hao Zhao , Ziwei Liu

Data scarcity remains a fundamental bottleneck for embodied intelligence. Existing approaches use large language models (LLMs) to automate gripper-based simulation generation, but they transfer poorly to dexterous manipulation, which…

Robotics · Computer Science 2025-11-04 Feng Chen , Zhuxiu Xu , Tianzhe Chu , Xunzhe Zhou , Li Sun , Zewen Wu , Shenghua Gao , Zhongyu Li , Yanchao Yang , Yi Ma

Generating high-quality whole-body human object interaction motion sequences is becoming increasingly important in various fields such as animation, VR/AR, and robotics. The main challenge of this task lies in determining the level of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yonghao Zhang , Qiang He , Yanguang Wan , Yinda Zhang , Xiaoming Deng , Cuixia Ma , Hongan Wang

Generating realistic hand-object interactions (HOI) videos is a significant challenge due to the difficulty of modeling physical constraints (e.g., contact and occlusion between hands and manipulated objects). Current methods utilize HOI…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Haodong Yan , Hang Yu , Zhide Zhong , Weilin Yuan , Xin Gong , Zehang Luo , Chengxi Heyu , Junfeng Li , Wenxuan Song , Shunbo Zhou , Haoang Li