English
Related papers

Related papers: Leverage Task Context for Object Affordance Rankin…

200 papers

Lexical semantics and cognitive science point to affordances (i.e. the actions that objects support) as critical for understanding and representing nouns and verbs. However, study of these semantic features has not yet been integrated with…

Computation and Language · Computer Science 2022-07-07 Jack Merullo , Dylan Ebert , Carsten Eickhoff , Ellie Pavlick

Learning robotic manipulation tasks using reinforcement learning with sparse rewards is currently impractical due to the outrageous data requirements. Many practical tasks require manipulation of multiple objects, and the complexity of such…

Robotics · Computer Science 2019-12-24 Richard Li , Allan Jabri , Trevor Darrell , Pulkit Agrawal

The significant progress on Generative Adversarial Networks (GANs) has facilitated realistic single-object image generation based on language input. However, complex-scene generation (with various interactions among multiple objects) still…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Tianyu Hua , Hongdong Zheng , Yalong Bai , Wei Zhang , Xiao-Ping Zhang , Tao Mei

A central problem in business concerns the optimal allocation of limited resources to a set of available tasks, where the payoff of these tasks is inherently uncertain. In credit card fraud detection, for instance, a bank can only assign a…

Machine Learning · Computer Science 2022-02-10 Toon Vanderschueren , Bart Baesens , Tim Verdonck , Wouter Verbeke

As a common image editing operation, image composition involves integrating foreground objects into background scenes. In this paper, we expand the application of the concept of Affordance from human-centered image composition tasks to a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Jixuan He , Wanhua Li , Ye Liu , Junsik Kim , Donglai Wei , Hanspeter Pfister

This paper introduces a challenging object grasping task and proposes a self-supervised learning approach. The goal of the task is to grasp an object which is not feasible with a single parallel gripper, but only with harnessing environment…

Robotics · Computer Science 2021-04-06 Hengyue Liang , Xibai Lou , Yang Yang , Changhyun Choi

Convolutional Neural Networks achieve state-of-the-art accuracy in object detection tasks. However, they have large computational and energy requirements that challenge their deployment on resource-constrained edge devices. Object detection…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Marina Neseem , Sherief Reda

Fairness in ranking models is crucial, as disparities in exposure can disproportionately affect protected groups. Most fairness-aware ranking systems focus on ensuring comparable average exposure for groups across the entire ranked list,…

Machine Learning · Computer Science 2025-09-23 Boyang Zhang , Quanqi Hu , Mingxuan Sun , Qihang Lin , Tianbao Yang

Understanding 3D scene-level affordances from natural language instructions is essential for enabling embodied agents to interact meaningfully in complex environments. However, this task remains challenging due to the need for semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Lian He , Meng Liu , Qilang Ye , Yu Zhou , Xiang Deng , Gangyi Ding

Humans effortlessly identify objects by leveraging a rich understanding of the surrounding scene, including spatial relationships, material properties, and the co-occurrence of other objects. In contrast, most computational object…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Ciprian Constantinescu , Marius Leordeanu

There has been increasing awareness of ethical issues in machine learning, and fairness has become an important research topic. Most fairness efforts in computer vision have been focused on human sensing applications and preventing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Zu Kim , André Araujo , Bingyi Cao , Cam Askew , Jack Sim , Mike Green , N'Mah Fodiatu Yilla , Tobias Weyand

Object ranking or "learning to rank" is an important problem in the realm of preference learning. On the basis of training data in the form of a set of rankings of objects represented as feature vectors, the goal is to learn a ranking…

Machine Learning · Statistics 2017-12-05 Mohsen Ahmadi Fahandar , Eyke Hüllermeier

In today's technology environment, information is abundant, dynamic, and heterogeneous in nature. Automated filtering and prioritization of information is based on the distinction between whether the information adds substantial value…

Machine Learning · Computer Science 2022-02-01 Jade Freeman , Michael Rawson

Achieving precise and generalizable grasping across diverse objects and environments is essential for intelligent and collaborative robotic systems. However, existing approaches often struggle with ambiguous affordance reasoning and limited…

Robotics · Computer Science 2025-03-11 Ruixiang Wang , Huayi Zhou , Xinyue Yao , Guiliang Liu , Kui Jia

3D affordance grounding aims to highlight the actionable regions on 3D objects, which is crucial for robotic manipulation. Previous research primarily focused on learning affordance knowledge from static cues such as language and images,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Hanqing Wang , Mingyu Liu , Xiaoyu Chen , Chengwei MA , Yiming Zhong , Wenti Yin , Yuhao Liu , Zhiqing Cui , Jiahao Yuan , Lu Dai , Zhiyuan Ma , Hui Xiong

This paper addresses the gap between general-purpose text embeddings and the specific demands of item retrieval tasks. We demonstrate the shortcomings of existing models in capturing the nuances necessary for zero-shot performance on item…

Information Retrieval · Computer Science 2024-03-01 Yuxuan Lei , Jianxun Lian , Jing Yao , Mingqi Wu , Defu Lian , Xing Xie

In-context learning is a surprising and important phenomenon that emerged when modern language models were scaled to billions of learned parameters. Without modifying a large language model's weights, it can be tuned to perform various…

Computation and Language · Computer Science 2023-03-15 Noam Wies , Yoav Levine , Amnon Shashua

The multitude of data generated by sensors available on users' mobile devices, combined with advances in machine learning techniques, support context-aware services in recognizing the current situation of a user (i.e., physical context) and…

Machine Learning · Computer Science 2023-06-29 Mattia Giovanni Campana , Dimitris Chatzopoulos , Franca Delmastro , Pan Hui

Traffic scene recognition, which requires various visual classification tasks, is a critical ingredient in autonomous vehicles. However, most existing approaches treat each relevant task independently from one another, never considering the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Younkwan Lee , Jihyo Jeon , Jongmin Yu , Moongu Jeon

For robots to exhibit a high level of intelligence in the real world, they must be able to assess objects for which they have no prior knowledge. Therefore, it is crucial for robots to perceive object affordances by reasoning about physical…

Robotics · Computer Science 2020-04-09 Hongtao Wu , Deven Misra , Gregory S. Chirikjian