English
Related papers

Related papers: Recognizing Object Affordances to Support Scene Re…

200 papers

Affordances are the possibilities of actions the environment offers to the individual. Ordinary objects (hammer, knife) usually have many affordances (grasping, pounding, cutting), and detecting these allow artificial agents to understand…

Machine Learning · Computer Science 2021-07-06 Hugo Caselles-Dupré , Michael Garcia-Ortiz , David Filliat

Localizing functional regions of objects or affordances is an important aspect of scene understanding. In this work, we cast the problem of affordance segmentation as that of semantic image segmentation. In order to explore various levels…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 Abhilash Srikantha , Juergen Gall

Affordance learning considers the interaction opportunities for an actor in the scene and thus has wide application in scene understanding and intelligent robotics. In this paper, we focus on contextual affordance learning, i.e., using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Jieteng Yao , Junjie Chen , Li Niu , Bin Sheng

Recent development in autonomous driving involves high-level computer vision and detailed road scene understanding. Today, most autonomous vehicles are using mediated perception approach for path planning and control, which highly rely on…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Chen Sun , Jean M. Uwabeza Vianney , Dongpu Cao

Affordance grounding refers to the task of finding the area of an object with which one can interact. It is a fundamental but challenging task, as a successful solution requires the comprehensive understanding of a scene in multiple aspects…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Shengyi Qian , Weifeng Chen , Min Bai , Xiong Zhou , Zhuowen Tu , Li Erran Li

Visual affordance segmentation identifies the surfaces of an object an agent can interact with. Common challenges for the identification of affordances are the variety of the geometry and physical properties of these surfaces as well as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Tommaso Apicella , Alessio Xompero , Edoardo Ragusa , Riccardo Berta , Andrea Cavallaro , Paolo Gastaldo

Affordance is crucial for intelligent robots in the context of object manipulation. In this paper, we argue that affordance should be task-/instruction-dependent, which is overlooked by many previous works. That is, different instructions…

Robotics · Computer Science 2025-08-26 Bokai Ji , Jie Gu , Xiaokang Ma , Chu Tang , Jingmin Chen , Guangxia Li

Learning to understand and infer object functionalities is an important step towards robust visual intelligence. Significant research efforts have recently focused on segmenting the object parts that enable specific types of human-object…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Spyridon Thermos , Petros Daras , Gerasimos Potamianos

This paper introduces an automatic affordance reasoning paradigm tailored to minimal semantic inputs, addressing the critical challenges of classifying and manipulating unseen classes of objects in household settings. Inspired by human…

Robotics · Computer Science 2024-06-10 Ceng Zhang , Xin Meng , Dongchen Qi , Gregory S. Chirikjian

Reasoning about object affordances allows an autonomous agent to perform generalised manipulation tasks among object instances. While current approaches to grasp affordance estimation are effective, they are limited to a single hypothesis.…

Visual affordance learning is a key component for robots to understand how to interact with objects. Conventional approaches in this field rely on pre-defined objects and actions, falling short of capturing diverse interactions in realworld…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Tomoya Yoshida , Shuhei Kurita , Taichi Nishimura , Shinsuke Mori

Object affordance reasoning, the ability to infer object functionalities based on physical properties, is fundamental for task-oriented planning and activities in both humans and Artificial Intelligence (AI). This capability, required for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Xiaomeng Zhu , Yuyang Li , Leiyao Cui , Pengfei Li , Huan-ang Gao , Yixin Zhu , Hao Zhao

Our ability to interact with the world around us relies on being able to infer what actions objects afford -- often referred to as affordances. The neural mechanisms of object-action associations are realized in the visuomotor pathway where…

Neurons and Cognition · Quantitative Biology 2020-02-24 Aria Yuan Wang , Michael J. Tarr

To be capable of lifelong learning in a real-life environment, robots have to tackle multiple challenges. Being able to relate physical properties they may observe in their environment to possible interactions they may have is one of them.…

Artificial Intelligence · Computer Science 2020-09-24 Alexandre Manoury , Sao Mai Nguyen , Cédric Buche

The ability to understand the ways to interact with objects from visual cues, a.k.a. visual affordance, is essential to vision-guided robotic research. This involves categorizing, segmenting and reasoning of visual affordance. Relevant…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Shengheng Deng , Xun Xu , Chaozheng Wu , Ke Chen , Kui Jia

Affordance detection from visual input is a fundamental step in autonomous robotic manipulation. Existing solutions to the problem of affordance detection rely on convolutional neural networks. However, these networks do not consider the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Antonio Rodríguez-Sánchez , Simon Haller-Seeber , David Peer , Chris Engelhardt , Jakob Mittelberger , Matteo Saveriano

Affordance grounding requires identifying where and how an agent should interact in open-world scenes, where actionable regions are often small, occluded, reflective, and visually ambiguous. Recent systems therefore combine multiple skills…

Robotics · Computer Science 2026-05-11 Haojian Huang , Jiahao Shi , Yinchuan Li , Yingcong Chen

Understanding and manipulating deformable objects (e.g., ropes and fabrics) is an essential yet challenging task with broad applications. Difficulties come from complex states and dynamics, diverse configurations and high-dimensional action…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Ruihai Wu , Chuanruo Ning , Hao Dong

Reinforcement learning algorithms struggle on tasks with complex hierarchical dependency structures. Humans and other intelligent agents do not waste time assessing the utility of every high-level action in existence, but instead only…

Machine Learning · Computer Science 2022-03-25 Robby Costales , Shariq Iqbal , Fei Sha

Robotic agents need to understand how to interact with objects in their environment, both autonomously and during human-robot interactions. Affordance detection on 3D point clouds, which identifies object regions that allow specific…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Maximilian Xiling Li , Korbinian Rudolf , Nils Blank , Rudolf Lioutikov