English
Related papers

Related papers: Towards Affordance Prediction with Vision via Task…

200 papers

Data-driven approaches have become a dominant paradigm for robotic grasp planning. However, the performance of these approaches is enormously influenced by the quality of the available training data. In this paper, we propose a framework to…

Robotics · Computer Science 2022-09-07 Junnan Jiang , Yuyang Tu , Xiaohui Xiao , Zhongtao Fu , Jianwei Zhang , Fei Chen , Miao Li

Visual affordance learning is crucial for robots to understand and interact effectively with the physical world. Recent advances in this field attempt to leverage pre-trained knowledge of vision-language foundation models to learn…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Qian Zhang , Lin Zhang , Xing Fang , Mingxin Zhang , Zhiyuan Wei , Ran Song , Wei Zhang

Pick-and-place is an important manipulation task in domestic or manufacturing applications. There exist many works focusing on grasp detection with high picking success rate but lacking consideration of downstream manipulation tasks (e.g.,…

Robotics · Computer Science 2023-04-05 Jen-Wei Wang , Lingfeng Sun , Xinghao Zhu , Qiyang Qian , Masayoshi Tomizuka

Visual affordance learning is a key component for robots to understand how to interact with objects. Conventional approaches in this field rely on pre-defined objects and actions, falling short of capturing diverse interactions in realworld…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Tomoya Yoshida , Shuhei Kurita , Taichi Nishimura , Shinsuke Mori

Object affordance is an important concept in human-object interaction, providing information on action possibilities based on human motor capacity and objects' physical property thus benefiting tasks such as action anticipation and robot…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Zecheng Yu , Yifei Huang , Ryosuke Furuta , Takuma Yagi , Yusuke Goutsu , Yoichi Sato

Visual actionable affordance has emerged as a transformative approach in robotics, focusing on perceiving interaction areas prior to manipulation. Traditional methods rely on pixel sampling to identify successful interaction samples or…

Robotics · Computer Science 2025-10-10 Taewhan Kim , Hojin Bae , Zeming Li , Xiaoqi Li , Iaroslav Ponomarenko , Ruihai Wu , Hao Dong

Compliant and soft hands have gained a lot of attention in the past decade because of their ability to adapt to the shape of the objects, increasing their effectiveness for grasping. However, when it comes to grasping highly flexible…

Robotics · Computer Science 2020-04-10 Júlia Borràs , Guillem Alenya , Carme Torras

Robotic affordances, providing information about what actions can be taken in a given situation, can aid robotic manipulation. However, learning about affordances requires expensive large annotated datasets of interactions or…

Robotics · Computer Science 2024-06-07 Pietro Mazzaglia , Taco Cohen , Daniel Dijkman

Robotic affordances, providing information about what actions can be taken in a given situation, can aid robotic manipulation. However, learning about affordances requires expensive large annotated datasets of interactions or…

Robotics · Computer Science 2024-06-14 Pietro Mazzaglia , Taco Cohen , Daniel Dijkman

Service robots are expected to autonomously and efficiently work in human-centric environments. For this type of robots, object perception and manipulation are challenging tasks due to need for accurate and real-time response. This paper…

Robotics · Computer Science 2019-04-05 S. Hamidreza Kasaei , Nima Shafii , Luis Seabra Lopes , Ana Maria Tome

Robotic grasping is one of the most fundamental robotic manipulation tasks and has been actively studied. However, how to quickly teach a robot to grasp a novel target object in clutter remains challenging. This paper attempts to tackle the…

Robotics · Computer Science 2021-04-07 Yang Yang , Yuanhao Liu , Hengyue Liang , Xibai Lou , Changhyun Choi

Recognizing the category of the object and using the features of the object itself to predict grasp configuration is of great significance to improve the accuracy of the grasp detection model and expand its application. Researchers have…

Robotics · Computer Science 2022-03-03 Mingshuai Dong , Shimin Wei , Jianqin Yin , Xiuli Yu

Evaluation of grasps on deformable 3D objects is a little-studied problem, even if the applicability of rigid object grasp quality measures for deformable ones is an open question. A central issue with most quality measures is their…

Robotics · Computer Science 2023-09-27 Tran Nguyen Le , Jens Lundell , Fares J. Abu-Dakka , Ville Kyrki

Affordance information about a scene provides important clues as to what actions may be executed in pursuit of meeting a specified goal state. Thus, integrating affordance-based reasoning into symbolic action plannning pipelines would…

Robotics · Computer Science 2020-09-15 Fu-Jen Chu , Ruinian Xu , Chao Tang , Patricio A. Vela

Task driven object detection aims to detect object instances suitable for affording a task in an image. Its challenge lies in object categories available for the task being too diverse to be limited to a closed set of object vocabulary for…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jiajin Tang , Ge Zheng , Jingyi Yu , Sibei Yang

A key challenge in robot teaching is grasp-type recognition with a single RGB image and a target object name. Here, we propose a simple yet effective pipeline to enhance learning-based recognition by leveraging a prior distribution of grasp…

Robotics · Computer Science 2020-09-22 Naoki Wake , Kazuhiro Sasabuchi , Katsushi Ikeuchi

Accurately modeling local surface properties of objects is crucial to many robotic applications, from grasping to material recognition. Surface properties like friction are however difficult to estimate, as visual observation of the object…

Robotics · Computer Science 2025-01-09 Tran Nguyen Le , Francesco Verdoja , Fares J. Abu-Dakka , Ville Kyrki

The ability to understand the ways to interact with objects from visual cues, a.k.a. visual affordance, is essential to vision-guided robotic research. This involves categorizing, segmenting and reasoning of visual affordance. Relevant…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Shengheng Deng , Xun Xu , Chaozheng Wu , Ke Chen , Kui Jia

This paper proposes a novel method for understanding daily hand-object manipulation by developing computer vision-based techniques. Specifically, we focus on recognizing hand grasp types, object attributes and manipulation actions within an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Minjie Cai , Kris Kitani , Yoichi Sato

Grasping objects of different shapes and sizes - a foundational, effortless skill for humans - remains a challenging task in robotics. Although model-based approaches can predict stable grasp configurations for known object models, they…

Robotics · Computer Science 2022-11-22 Malte Mosbach , Sven Behnke