English
Related papers

Related papers: Task-Oriented Grasp Prediction with Visual-Languag…

200 papers

Nowadays robots play an increasingly important role in our daily life. In human-centered environments, robots often encounter piles of objects, packed items, or isolated objects. Therefore, a robot must be able to grasp and manipulate…

Robotics · Computer Science 2022-10-06 Hamidreza Kasaei , Mohammadreza Kasaei

Picking a specific object from clutter is an essential component of many manipulation tasks. Partial observations often require the robot to collect additional views of the scene before attempting a grasp. This paper proposes a closed-loop…

Robotics · Computer Science 2022-07-22 Michel Breyer , Lionel Ott , Roland Siegwart , Jen Jen Chung

Grasping constitutes a critical challenge for visually impaired people. To address this problem, we developed a tactile bracelet that assists in grasping by guiding the user's hand to a target object using vibration commands. Here we…

Human-Computer Interaction · Computer Science 2025-04-24 Marcin Furtak , Florian Pätzold , Tim Kietzmann , Silke M. Kärcher , Peter König

Humans excel in grasping and manipulating objects because of their life-long experience and knowledge about the 3D shape and weight distribution of objects. However, the lack of such intuition in robots makes robotic grasping an…

Computer Vision and Pattern Recognition · Computer Science 2018-11-05 Ghazal Ghazaei , Iro Laina , Christian Rupprecht , Federico Tombari , Nassir Navab , Kianoush Nazarpour

Quadruped robots are increasingly used in various applications due to their high mobility and ability to operate in diverse terrains. However, most available quadruped robots are primarily focused on mobility without object manipulation…

Task-oriented dexterous grasping holds broad application prospects in robotic manipulation and human-object interaction. However, most existing methods still struggle to generalize across diverse objects and task instructions, as they…

Robotics · Computer Science 2025-11-18 Juntao Jian , Yi-Lin Wei , Chengjie Mou , Yuhao Lin , Xing Zhu , Yujun Shen , Wei-Shi Zheng , Ruizhen Hu

The choice of a grasp plays a critical role in the success of downstream manipulation tasks. Consider a task of placing an object in a cluttered scene; the majority of possible grasps may not be suitable for the desired placement. In this…

Robotics · Computer Science 2023-04-11 Zhanpeng He , Nikhil Chavan-Dafle , Jinwook Huh , Shuran Song , Volkan Isler

Task and motion planning (TAMP) algorithms aim to help robots achieve task-level goals, while maintaining motion-level feasibility. This paper focuses on TAMP domains that involve robot behaviors that take extended periods of time (e.g.,…

Robotics · Computer Science 2022-02-25 Xiaohan Zhang , Yifeng Zhu , Yan Ding , Yuke Zhu , Peter Stone , Shiqi Zhang

We consider the problem of closed-loop robotic grasping and present a novel planner which uses Visual Feedback and an uncertainty-aware Adaptive Sampling strategy (VFAS) to close the loop. At each iteration, our method VFAS-Grasp builds a…

Robotics · Computer Science 2023-10-31 Pedro Piacenza , Jiacheng Yuan , Jinwook Huh , Volkan Isler

Humans grasp unfamiliar objects by combining an initial visual estimate with tactile and proprioceptive feedback during interaction. We present ShapeGrasp, a robotic implementation of this approach. The proposed method is an iterative…

Robotics · Computer Science 2026-05-05 Lukas Rustler , Matej Hoffmann

Currently, task-oriented grasp detection approaches are mostly based on pixel-level affordance detection and semantic segmentation. These pixel-level approaches heavily rely on the accuracy of a 2D affordance mask, and the generated grasp…

Robotics · Computer Science 2022-10-18 Wenkai Chen , Hongzhuo Liang , Zhaopeng Chen , Fuchun Sun , Jianwei Zhang

Task-oriented grasping (TOG) is more challenging than simple object grasping because it requires precise identification of object parts and careful selection of grasping areas to ensure effective and robust manipulation. While recent…

Robotics · Computer Science 2026-03-30 Hao Chen , Takuya Kiyokawa , Weiwei Wan , Kensuke Harada

We present ArtiGrasp, a novel method to synthesize bi-manual hand-object interactions that include grasping and articulation. This task is challenging due to the diversity of the global wrist motions and the precise finger control that are…

Robotics · Computer Science 2024-03-05 Hui Zhang , Sammy Christen , Zicong Fan , Luocheng Zheng , Jemin Hwangbo , Jie Song , Otmar Hilliges

Multi-hand semantic grasp generation aims to generate feasible and semantically appropriate grasp poses for different robotic hands based on natural language instructions. Although the task is highly valuable, due to the lack of multihand…

Robotic grasping presents a difficult motor task in real-world scenarios, constituting a major hurdle to the deployment of capable robots across various industries. Notably, the scarcity of data makes grasping particularly challenging for…

Robotics · Computer Science 2024-06-18 Abhi Kamboj , Katherine Driggs-Campbell

We present VLPG-Nav, a visual language navigation method for guiding robots to specified objects within household scenes. Unlike existing methods primarily focused on navigating the robot toward objects, our approach considers the…

In this paper, we address the problem of task-oriented grasping for humanoid robots, emphasizing the need to align with human social norms and task-specific objectives. Existing methods, employ a variety of open-loop and closed-loop…

Robotics · Computer Science 2026-02-25 Dimitrios Dimou , José Santos-Victor , Plinio Moreno

Successful robotic grasping in cluttered environments not only requires a model to visually ground a target object but also to reason about obstructions that must be cleared beforehand. While current vision-language embodied reasoning…

Achieving dexterous robotic grasping with multi-fingered hands remains a significant challenge. While existing methods rely on complete 3D scans to predict grasp poses, these approaches face limitations due to the difficulty of acquiring…

Manipulation tasks are sequential in nature. Grasp selection approaches that take into account the con- straints at each task step are critical, since they allow to both (1) Identify grasps that likely require simple arm motions through the…

Robotics · Computer Science 2017-09-05 Ana C. Huamán Quispe