English
Related papers

Related papers: Visuo-Tactile Manipulation Planning Using Reinforc…

200 papers

Learning object affordances is an effective tool in the field of robot learning. While the data-driven models investigate affordances of single or paired objects, there is a gap in the exploration of affordances of compound objects composed…

Robotics · Computer Science 2024-12-18 Tuba Girgin , Emre Ugur

Manipulation of deformable objects is a challenging task for a robot. It will be problematic to use a single sensory input to track the behaviour of such objects: vision can be subjected to occlusions, whereas tactile inputs cannot capture…

Robotics · Computer Science 2023-05-01 Leszek Pecyna , Siyuan Dong , Shan Luo

Training end-to-end deep robot policies requires a lot of domain-, task-, and hardware-specific data, which is often costly to provide. In this work, we propose to tackle this issue by employing a deep neural network with a modular…

Robotics · Computer Science 2019-03-12 Aleksi Hämäläinen , Karol Arndt , Ali Ghadirzadeh , Ville Kyrki

Object affordance is an important concept in hand-object interaction, providing information on action possibilities based on human motor capacity and objects' physical property thus benefiting tasks such as action anticipation and robot…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Zecheng Yu , Yifei Huang , Ryosuke Furuta , Takuma Yagi , Yusuke Goutsu , Yoichi Sato

Affordance is crucial for intelligent robots in the context of object manipulation. In this paper, we argue that affordance should be task-/instruction-dependent, which is overlooked by many previous works. That is, different instructions…

Robotics · Computer Science 2025-08-26 Bokai Ji , Jie Gu , Xiaokang Ma , Chu Tang , Jingmin Chen , Guangxia Li

Previous soft tissue manipulation studies assumed that the grasping point was known and the target deformation can be achieved. During the operation, the constraints are supposed to be constant, and there is no obstacles around the soft…

Robotics · Computer Science 2023-12-27 Xian He , Shuai Zhang , Shanlin Yang , Bo Ouyang

This paper introduces an automatic affordance reasoning paradigm tailored to minimal semantic inputs, addressing the critical challenges of classifying and manipulating unseen classes of objects in household settings. Inspired by human…

Robotics · Computer Science 2024-06-10 Ceng Zhang , Xin Meng , Dongchen Qi , Gregory S. Chirikjian

This paper introduces a challenging object grasping task and proposes a self-supervised learning approach. The goal of the task is to grasp an object which is not feasible with a single parallel gripper, but only with harnessing environment…

Robotics · Computer Science 2021-04-06 Hengyue Liang , Xibai Lou , Yang Yang , Changhyun Choi

General-purpose robotic manipulation, including reach and grasp, is essential for deployment into households and workspaces involving diverse and evolving tasks. Recent advances propose using large pre-trained models, such as Large Language…

Robotics · Computer Science 2025-07-16 Huiyi Wang , Fahim Shahriar , Alireza Azimi , Gautham Vasan , Rupam Mahmood , Colin Bellinger

Robotic manipulation faces critical challenges in understanding spatial affordances--the "where" and "how" of object interactions--essential for complex manipulation tasks like wiping a board or stacking objects. Existing methods, including…

Planning for robotic manipulation requires reasoning about the changes a robot can affect on objects. When such interactions can be modelled analytically, as in domains with rigid objects, efficient planning algorithms exist. However, in…

Robotics · Computer Science 2019-05-14 Angelina Wang , Thanard Kurutach , Kara Liu , Pieter Abbeel , Aviv Tamar

Robotic manipulation in industrial scenarios such as construction commonly faces uncertain observations in which the state of the manipulating object may not be accurately captured due to occlusions and partial observables. For example,…

Robotics · Computer Science 2025-05-23 Xiao Hu , Yang Ye

Robotic manipulation with two-finger grippers is challenged by objects lacking distinct graspable features. Traditional pre-grasping methods, which typically involve repositioning objects or utilizing external aids like table edges, are…

Manipulation planning is the problem of finding a sequence of robot configurations that involves interactions with objects in the scene, e.g., grasping and placing an object, or more general tool-use. To achieve such interactions,…

Robotics · Computer Science 2022-08-01 Jung-Su Ha , Danny Driess , Marc Toussaint

Perceiving and manipulating 3D articulated objects in diverse environments is essential for home-assistant robots. Recent studies have shown that point-level affordance provides actionable priors for downstream manipulation tasks. However,…

Robotics · Computer Science 2025-09-17 Ruihai Wu , Kai Cheng , Yan Shen , Chuanruo Ning , Guanqi Zhan , Hao Dong

In this paper, a novel robotic grasping system is established to automatically pick up objects in cluttered scenes. A composite robotic hand composed of a suction cup and a gripper is designed for grasping the object stably. The suction cup…

Robotics · Computer Science 2023-02-22 Yuhong Deng , Xiaofeng Guo , Yixuan Wei , Kai Lu , Bin Fang , Di Guo , Huaping Liu , Fuchun Sun

Visual affordance learning is crucial for robots to understand and interact effectively with the physical world. Recent advances in this field attempt to leverage pre-trained knowledge of vision-language foundation models to learn…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Qian Zhang , Lin Zhang , Xing Fang , Mingxin Zhang , Zhiyuan Wei , Ran Song , Wei Zhang

Conventional works that learn grasping affordance from demonstrations need to explicitly predict grasping configurations, such as gripper approaching angles or grasping preshapes. Classic motion planners could then sample trajectories by…

Robotics · Computer Science 2021-08-17 Yantian Zha , Siddhant Bhambri , Lin Guan

Service robots are expected to autonomously and efficiently work in human-centric environments. For this type of robots, object perception and manipulation are challenging tasks due to need for accurate and real-time response. This paper…

Robotics · Computer Science 2019-04-05 S. Hamidreza Kasaei , Nima Shafii , Luis Seabra Lopes , Ana Maria Tome

Many robotic tasks in real-world environments require physical interactions with an object such as pick up or push. For successful interactions, the robot needs to know the object's affordances, which are defined as the potential actions…

Robotics · Computer Science 2025-01-13 Paula Wulkop , Halil Umut Özdemir , Antonia Hüfner , Jen Jen Chung , Roland Siegwart , Lionel Ott