English
Related papers

Related papers: GenHeld: Generating and Editing Handheld Objects

200 papers

We present the Evolved Grasping Analysis Dataset (EGAD), comprising over 2000 generated objects aimed at training and evaluating robotic visual grasp detection algorithms. The objects in EGAD are geometrically diverse, filling a space…

Robotics · Computer Science 2020-04-24 Douglas Morrison , Peter Corke , Jürgen Leitner

Synthesizing 3D whole bodies that realistically grasp objects is useful for animation, mixed reality, and robotics. This is challenging, because the hands and body need to look natural w.r.t. each other, the grasped object, as well as the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Georgios Paschalidis , Romana Wilschut , Dimitrije Antić , Omid Taheri , Dimitrios Tzionas

Humans have the remarkable ability to use held objects as tools to interact with their environment. For this to occur, humans internally estimate how hand movements affect the object's movement. We wish to endow robots with this capability.…

Robotics · Computer Science 2024-07-16 Weiming Zhi , Haozhan Tang , Tianyi Zhang , Matthew Johnson-Roberson

The availability of rich 3D datasets corresponding to the geometrical complexity of the built environments is considered an ongoing challenge for 3D deep learning methodologies. To address this challenge, we introduce GenScan, a generative…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Mohammad Keshavarzi , Oladapo Afolabi , Luisa Caldas , Allen Y. Yang , Avideh Zakhor

Humans frequently grasp, manipulate, and move objects. Interactive systems assist humans in these tasks, enabling applications in Embodied AI, human-robot interaction, and virtual reality. However, current methods in hand-object synthesis…

Robotics · Computer Science 2025-03-10 Sammy Christen

We propose G-HOP, a denoising diffusion based generative prior for hand-object interactions that allows modeling both the 3D object and a human hand, conditioned on the object category. To learn a 3D spatial diffusion model that can capture…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yufei Ye , Abhinav Gupta , Kris Kitani , Shubham Tulsiani

Grasp synthesis is one of the challenging tasks for any robot object manipulation task. In this paper, we present a new deep learning-based grasp synthesis approach for 3D objects. In particular, we propose an end-to-end 3D Convolutional…

Robotics · Computer Science 2020-09-15 Yikun Li , Lambert Schomaker , S. Hamidreza Kasaei

Generating digital humans that move realistically has many applications and is widely studied, but existing methods focus on the major limbs of the body, ignoring the hands and head. Hands have been separately studied, but the focus has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Omid Taheri , Vasileios Choutas , Michael J. Black , Dimitrios Tzionas

Hands are dexterous and highly versatile manipulators that are central to how humans interact with objects and their environment. Consequently, modeling realistic hand-object interactions, including the subtle motion of individual fingers,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Omid Taheri , Yi Zhou , Dimitrios Tzionas , Yang Zhou , Duygu Ceylan , Soren Pirk , Michael J. Black

While predicting robot grasps with parallel jaw grippers have been well studied and widely applied in robot manipulation tasks, the study on natural human grasp generation with a multi-finger hand remains a very challenging problem. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Hanwen Jiang , Shaowei Liu , Jiashun Wang , Xiaolong Wang

Grasping is the process of picking up an object by applying forces and torques at a set of contacts. Recent advances in deep-learning methods have allowed rapid progress in robotic object grasping. In this systematic review, we surveyed the…

We develop a system for modeling hand-object interactions in 3D from RGB images that show a hand which is holding a novel object from a known category. We design a Convolutional Neural Network (CNN) for Hand-held Object Pose and Shape…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Mia Kokic , Danica Kragic , Jeannette Bohg

In this work, we present BG-HOP, a generative prior that seeks to model bimanual hand-object interactions in 3D. We address the challenge of limited bimanual interaction data by extending existing single-hand generative priors,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Sriram Krishna , Sravan Chittupalli , Sungjae Park

As several industries are moving towards modeling massive 3D virtual worlds, the need for content creation tools that can scale in terms of the quantity, quality, and diversity of 3D content is becoming evident. In our work, we aim to train…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Jun Gao , Tianchang Shen , Zian Wang , Wenzheng Chen , Kangxue Yin , Daiqing Li , Or Litany , Zan Gojcic , Sanja Fidler

The motion of picking up and placing an object in 3D space is full of subtle detail. Typically these motions are formed from the same constraints, optimizing for swiftness, energy efficiency, as well as physiological limits. Yet, even for…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Connor Daly , Yuzuko Nakamura , Tobias Ritschel

Achieving dexterous robotic grasping with multi-fingered hands remains a significant challenge. While existing methods rely on complete 3D scans to predict grasp poses, these approaches face limitations due to the difficulty of acquiring…

The rise in additive manufacturing comes with unique opportunities and challenges. Massive part customization and rapid design changes are made possible with additive manufacturing, however, manufacturing industries that desire the…

Robotics · Computer Science 2024-03-29 Joyce Xin-Yan Lim , Quang-Cuong Pham

We present a method for teaching machines to understand and model the underlying spatial common sense of diverse human-object interactions in 3D in a self-supervised way. This is a challenging task, as there exist specific manifolds of the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sookwan Han , Hanbyul Joo

Grasping manipulation is a fundamental mode for human interaction with daily life objects. The synthesis of grasping motion is also greatly demanded in many applications such as animation and robotics. In objects grasping research field,…

Robotics · Computer Science 2024-10-04 Quanquan Shao , Yi Fang

We present HOReeNet, which tackles the novel task of manipulating images involving hands, objects, and their interactions. Especially, we are interested in transferring objects of source images to target images and manipulating 3D hand…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Changhwa Lee , Junuk Cha , Hansol Lee , Seongyeong Lee , Donguk Kim , Seungryul Baek