English
Related papers

Related papers: ClickDiff: Click to Induce Semantic Contact Map fo…

200 papers

Achieving reliable robotic manipulation, such as dexterous grasping, requires a synergy between physically stable interactions and semantic task guidance, yet these objectives are often treated as separate, disjoint goals. In this paper, we…

Robotics · Computer Science 2026-05-14 Han Yi Shin , Heeju Ko , Jaewon Mun , Qixing Huang , Jaehyeok Lee , Sung June Kim , Honglak Lee , Sujin Jang , Sangpil Kim

Real-time interactive grasp synthesis for dynamic objects remains challenging as existing methods fail to achieve low-latency inference while maintaining promptability. To bridge this gap, we propose SPGrasp (spatiotemporal prompt-driven…

Robotics · Computer Science 2025-09-03 Yunpeng Mei , Hongjie Cao , Yinqiu Xia , Wei Xiao , Zhaohan Feng , Gang Wang , Jie Chen

Despite years of research, real-time diverse grasp synthesis for dexterous hands remains an unsolved core challenge in robotics and computer graphics. We present Lightning Grasp, a novel high-performance procedural grasp synthesis algorithm…

Robotics · Computer Science 2025-11-11 Zhao-Heng Yin , Pieter Abbeel

In this work, we explore a novel task of generating human grasps based on single-view scene point clouds, which more accurately mirrors the typical real-world situation of observing objects from a single viewpoint. Due to the incompleteness…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yan-Kang Wang , Chengyi Xing , Yi-Lin Wei , Xiao-Ming Wu , Wei-Shi Zheng

Task-oriented dexterous grasping holds broad application prospects in robotic manipulation and human-object interaction. However, most existing methods still struggle to generalize across diverse objects and task instructions, as they…

Robotics · Computer Science 2025-11-18 Juntao Jian , Yi-Lin Wei , Chengjie Mou , Yuhao Lin , Xing Zhu , Yujun Shen , Wei-Shi Zheng , Ruizhen Hu

Recent advances in Diffusion Probabilistic Models (DPMs) have set new standards in high-quality image synthesis. Yet, controlled generation remains challenging, particularly in sensitive areas such as medical imaging. Medical images feature…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Sarah Cechnicka , Matthew Baugh , Weitong Zhang , Mischa Dombrowski , Zhe Li , Johannes C. Paetzold , Candice Roufosse , Bernhard Kainz

Generative models often treat continuous data and discrete events as separate processes, creating a gap in modeling complex systems where they interact synchronously. To bridge this gap, we introduce JointDiff, a novel diffusion framework…

Machine Learning · Computer Science 2026-01-30 Guillem Capellera , Luis Ferraz , Antonio Rubio , Alexandre Alahi , Antonio Agudo

We introduce the sequential multi-object robotic grasp sampling algorithm SeqGrasp that can robustly synthesize stable grasps on diverse objects using the robotic hand's partial Degrees of Freedom (DoF). We use SeqGrasp to construct the…

Robotics · Computer Science 2025-12-09 Haofei Lu , Yifei Dong , Zehang Weng , Florian T. Pokorny , Jens Lundell , Danica Kragic

Grasping and manipulating objects is an important human skill. Since hand-object contact is fundamental to grasping, capturing it can lead to important insights. However, observing contact through external sensors is challenging because of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Samarth Brahmbhatt , Cusuh Ham , Charles C. Kemp , James Hays

Advancements in generative models have sparked significant interest in generating images while adhering to specific structural guidelines. Scene graph to image generation is one such task of generating images which are consistent with the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Rameshwar Mishra , A V Subramanyam

Recent advances in dexterous grasping synthesis have demonstrated significant progress in producing reasonable and plausible grasps for many task purposes. But it remains challenging to generalize to unseen object categories and diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Juntao Jian , Xiuping Liu , Zixuan Chen , Manyi Li , Jian Liu , Ruizhen Hu

The versatility and adaptability of human grasping catalyze advancing dexterous robotic manipulation. While significant strides have been made in dexterous grasp generation, current research endeavors pivot towards optimizing object…

Today's touch sensors come in many shapes and sizes. This has made it challenging to develop general-purpose touch processing methods since models are generally tied to one specific sensor design. We address this problem by performing…

Robotics · Computer Science 2024-09-13 Samanta Rodriguez , Yiming Dou , Miquel Oller , Andrew Owens , Nima Fazeli

Grasping with anthropomorphic robotic hands involves much more hand-object interactions compared to parallel-jaw grippers. Modeling hand-object interactions is essential to the study of multi-finger hand dextrous manipulation. This work…

Robotics · Computer Science 2022-11-22 Wei Wei , Daheng Li , Peng Wang , Yiming Li , Wanyi Li , Yongkang Luo , Jun Zhong

Robotic grasping is one of the most fundamental tasks in robotic manipulation, and grasp detection/generation has long been the subject of extensive research. Recently, language-driven grasp generation has emerged as a promising direction…

Diffusion models have emerged as powerful generative models for graph generation, yet their use for conditional graph generation remains a fundamental challenge. In particular, guiding diffusion models on graphs under arbitrary reward…

Machine Learning · Computer Science 2025-05-27 Victor M. Tenorio , Nicolas Zilberstein , Santiago Segarra , Antonio G. Marques

Grasping an unknown object is difficult for robot hands. When the characteristics of the object are unknown, knowing how to plan the speed at and width to which the fingers are narrowed is difficult. In this paper, we propose a method to…

Robotics · Computer Science 2024-10-23 Shunsuke Tokiwa , Hikaru Arita , Yosuke Suzuki , Kenji Tahara

Contact-based grasp generation plays a crucial role in various applications. Recent methods typically focus on the geometric structure of objects, producing grasps with diverse hand poses and plausible contact points. However, these…

Graphics · Computer Science 2025-11-18 Zhuo Chen , Zhongqun Zhang , Yihua Cheng , Ales Leonardis , Hyung Jin Chang

Generating images from graph-structured inputs, such as scene graphs, is uniquely challenging due to the difficulty of aligning nodes and connections in graphs with objects and their relations in images. Most existing methods address this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Ling Yang , Zhilin Huang , Yang Song , Shenda Hong , Guohao Li , Wentao Zhang , Bin Cui , Bernard Ghanem , Ming-Hsuan Yang

We present ArtiGrasp, a novel method to synthesize bi-manual hand-object interactions that include grasping and articulation. This task is challenging due to the diversity of the global wrist motions and the precise finger control that are…

Robotics · Computer Science 2024-03-05 Hui Zhang , Sammy Christen , Zicong Fan , Luocheng Zheng , Jemin Hwangbo , Jie Song , Otmar Hilliges