English
Related papers

Related papers: One-Shot Affordance Detection

200 papers

In this work, we tackle one-shot visual search of object parts. Given a single reference image of an object with annotated affordance regions, we segment semantically corresponding parts within a target scene. We propose AffCorrs, an…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Denis Hadjivelichkov , Sicelukwanda Zwane , Marc Peter Deisenroth , Lourdes Agapito , Dimitrios Kanoulas

We propose a new approach for Zero-Shot Human-Object Interaction Recognition in the challenging setting that involves interactions with unseen actions (as opposed to just unseen combinations of seen actions and objects). Our approach makes…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Alessio Sarullo , Tingting Mu

The current advances in object detection depend on large-scale datasets to get good performance. However, there may not always be sufficient samples in many scenarios, which leads to the research on few-shot detection as well as its extreme…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Tengfei Zhang , Yue Zhang , Xian Sun , Hao Sun , Menglong Yan , Xue Yang , Kun Fu

We study the problem of object detection from a novel perspective in which annotation budget constraints are taken into consideration, appropriately coined Budget Aware Object Detection (BAOD). When provided with a fixed budget, we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Alejandro Pardo , Mengmeng Xu , Ali Thabet , Pablo Arbelaez , Bernard Ghanem

The term "affordance" denotes the behavioral meaning of objects. We propose a cognitive architecture for the detection of affordances in the visual modality. This model is based on the internal simulation of movement sequences. For each…

Artificial Intelligence · Computer Science 2016-11-02 Wolfram Schenck , Hendrik Hasenbein , Ralf Möller

Affordance grounding aims to locate objects' "action possibilities" regions, which is an essential step toward embodied intelligence. Due to the diversity of interactive affordance, the uniqueness of different individuals leads to diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Hongchen Luo , Wei Zhai , Jing Zhang , Yang Cao , Dacheng Tao

Affordance refers to the perception of possible actions allowed by an object. Despite its relevance to human-computer interaction, no existing theory explains the mechanisms that underpin affordance-formation; that is, how affordances are…

Human-Computer Interaction · Computer Science 2022-01-10 Yi-Chi Liao , Kashyap Todi , Aditya Acharya , Antti Keurulainen , Andrew Howes , Antti Oulasvirta

Humans show an innate capability to identify tools to support specific actions. The association between objects parts and the actions they facilitate is usually named affordance. Being able to segment objects parts depending on the tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Claudia Cuttano , Gabriele Rosi , Gabriele Trivigno , Giuseppe Averta

Localizing functional regions of objects or affordances is an important aspect of scene understanding. In this work, we cast the problem of affordance segmentation as that of semantic image segmentation. In order to explore various levels…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 Abhilash Srikantha , Juergen Gall

When told to "cut the cake," a robot must choose the knife over nearby scissors, despite both objects affording the same cutting function. In real-world scenes, multiple objects may share identical affordances, yet only one is appropriate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jingliang Li , Jindou Jia , Tuo An , Chuhao Zhou , Xiangyu Chen , Shilin Shan , Boyu Ma , Bofan Lyu , Gen Li , Jianfei Yang

Affordance learning is a complex challenge in many applications, where existing approaches primarily focus on the geometric structures, visual knowledge, and affordance labels of objects to determine interactable regions. However, extending…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Nghia Vu , Tuong Do , Khang Nguyen , Baoru Huang , Nhat Le , Binh Xuan Nguyen , Erman Tjiputra , Quang D. Tran , Ravi Prakash , Te-Chuan Chiu , Anh Nguyen

As a common image editing operation, image composition involves integrating foreground objects into background scenes. In this paper, we expand the application of the concept of Affordance from human-centered image composition tasks to a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Jixuan He , Wanhua Li , Ye Liu , Junsik Kim , Donglai Wei , Hanspeter Pfister

This paper presents an approach for learning invariant features for object affordance understanding. One of the major problems for a robotic agent acquiring a deeper understanding of affordances is finding sensory-grounded semantics. Being…

Robotics · Computer Science 2019-01-31 Martin Hjelm , Carl Henrik Ek , Renaud Detry , Danica Kragic

One-shot object detection (OSOD) aims to detect all object instances towards the given category specified by a query image. Most existing studies in OSOD endeavor to explore effective cross-image correlation and alleviate the semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Wenwen Zhang , Xinyu Xiao , Hangguan Shan , Eryun Liu

Robotic affordances, providing information about what actions can be taken in a given situation, can aid robotic manipulation. However, learning about affordances requires expensive large annotated datasets of interactions or…

Robotics · Computer Science 2024-06-07 Pietro Mazzaglia , Taco Cohen , Daniel Dijkman

Robotic affordances, providing information about what actions can be taken in a given situation, can aid robotic manipulation. However, learning about affordances requires expensive large annotated datasets of interactions or…

Robotics · Computer Science 2024-06-14 Pietro Mazzaglia , Taco Cohen , Daniel Dijkman

Visual affordances identify regions in an image with potential interactions, offering a novel paradigm for scene understanding. Recognizing affordances allows autonomous robots to act more naturally, could enhance human-robot interactions,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Lorenzo Mur-Labadia , Ruben Martinez-Cantina , Jose J. Guerrero

Our ability to interact with the world around us relies on being able to infer what actions objects afford -- often referred to as affordances. The neural mechanisms of object-action associations are realized in the visuomotor pathway where…

Neurons and Cognition · Quantitative Biology 2020-02-24 Aria Yuan Wang , Michael J. Tarr

This paper presents a novel approach for affordance-informed robotic manipulation by introducing 3D keypoints to enhance the understanding of object parts' functionality. The proposed approach provides direct information about what the…

Object detection as a subfield within computer vision has achieved remarkable progress, which aims to accurately identify and locate a specific object from images or videos. Such methods rely on large-scale labeled training samples for each…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zhimeng Xin , Shiming Chen , Tianxu Wu , Yuanjie Shao , Weiping Ding , Xinge You