English
Related papers

Related papers: Object-Category Aware Reinforcement Learning

200 papers

Although foundation models (FMs) claim to be powerful, their generalization ability significantly decreases when faced with distribution shifts, weak supervision, or malicious attacks in the open world. On the other hand, most domain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Luyao Tang , Yuxuan Yuan , Chaoqi Chen , Zeyu Zhang , Yue Huang , Kun Zhang

Humans have a natural instinct to identify unknown object instances in their environments. The intrinsic curiosity about these unknown instances aids in learning about them, when the corresponding knowledge is eventually available. This…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 K J Joseph , Salman Khan , Fahad Shahbaz Khan , Vineeth N Balasubramanian

We study the offline meta-reinforcement learning (OMRL) problem, a paradigm which enables reinforcement learning (RL) algorithms to quickly adapt to unseen tasks without any interactions with the environments, making RL truly practical in…

Machine Learning · Computer Science 2021-05-07 Lanqing Li , Rui Yang , Dijun Luo

Goal-conditioned reinforcement learning (GCRL) allows agents to learn diverse objectives using a unified policy. The success of GCRL, however, is contingent on the choice of goal representation. In this work, we propose a mask-based goal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Fahim Shahriar , Cheryl Wang , Alireza Azimi , Gautham Vasan , Hany Hamed Elanwar , A. Rupam Mahmood , Colin Bellinger

Open-World Object Detection (OWOD) enriches traditional object detectors by enabling continual discovery and integration of unknown objects via human guidance. However, existing OWOD approaches frequently suffer from semantic confusion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Anay Majee , Amitesh Gangrade , Rishabh Iyer

Properly defining a reward signal to efficiently train a reinforcement learning (RL) agent is a challenging task. Designing balanced objective functions from which a desired behavior can emerge requires expert knowledge, especially for…

Machine Learning · Computer Science 2024-06-25 Timo Kaufmann , Jannis Blüml , Antonia Wüst , Quentin Delfosse , Kristian Kersting , Eyke Hüllermeier

In this paper, we consider the problem of simultaneously detecting objects and inferring their visual attributes in an image, even for those with no manual annotations provided at the training stage, resembling an open-vocabulary scenario.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Keyan Chen , Xiaolong Jiang , Yao Hu , Xu Tang , Yan Gao , Jianqi Chen , Weidi Xie

In many reinforcement learning tasks, the agent has to learn to interact with many objects of different types and generalize to unseen combinations and numbers of objects. Often a task is a composition of previously learned tasks (e.g.…

Machine Learning · Computer Science 2023-07-19 Fan Feng , Sara Magliacane

Annotating datasets for object detection is an expensive and time-consuming endeavor. To minimize this burden, active learning (AL) techniques are employed to select the most informative samples for annotation within a constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chenhongyi Yang , Lichao Huang , Elliot J. Crowley

Behavioral cloning has proven to be effective for learning sequential decision-making policies from expert demonstrations. However, behavioral cloning often suffers from the causal confusion problem where a policy relies on the noticeable…

Machine Learning · Computer Science 2021-10-28 Jongjin Park , Younggyo Seo , Chang Liu , Li Zhao , Tao Qin , Jinwoo Shin , Tie-Yan Liu

Object detection limits its recognizable categories during the training phase, in which it can not cover all objects of interest for users. To satisfy the practical necessity, the incremental learning ability of the detector becomes a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Zhenwei He , Lei Zhang

Object proposals have become an integral preprocessing steps of many vision pipelines including object detection, weakly supervised detection, object discovery, tracking, etc. Compared to the learning-free methods, learning-based proposals…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Dahun Kim , Tsung-Yi Lin , Anelia Angelova , In So Kweon , Weicheng Kuo

Object detection aims to identify instances of semantic objects of a certain class in images or videos. The success of state-of-the-art approaches is attributed to the significant progress of object proposal and convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-03-02 Feng Gao , Yihang Lou , Yan Bai , Shiqi Wang , Tiejun Huang , Ling-Yu Duan

Document images often have intricate layout structures, with numerous content regions (e.g. texts, figures, tables) densely arranged on each page. This makes the manual annotation of layout datasets expensive and inefficient. These…

Machine Learning · Computer Science 2021-03-31 Zejiang Shen , Jian Zhao , Melissa Dell , Yaoliang Yu , Weining Li

LiDAR-based 3D object detection has recently seen significant advancements through active learning (AL), attaining satisfactory performance by training on a small fraction of strategically selected point clouds. However, in real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhuoxiao Chen , Yadan Luo , Zixin Wang , Zijian Wang , Xin Yu , Zi Huang

Object-centric learning (OCL) extracts the representation of objects with slots, offering an exceptional blend of flexibility and interpretability for abstracting low-level perceptual features. A widely adopted method within OCL is slot…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Ke Fan , Zechen Bai , Tianjun Xiao , Tong He , Max Horn , Yanwei Fu , Francesco Locatello , Zheng Zhang

Object-Centric Learning (OCL) aims to discover objects in images or videos by reconstructing the input. Representative methods achieve this by reconstructing the input as its Variational Autoencoder (VAE) discrete representations, which…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Rongzhen Zhao , Vivienne Wang , Juho Kannala , Joni Pajarinen

We propose a framework to continuously learn object-centric representations for visual learning and understanding. Existing object-centric representations either rely on supervisions that individualize objects in the scene, or perform…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Chuanyu Pan , Yanchao Yang , Kaichun Mo , Yueqi Duan , Leonidas Guibas

Object-centric learning (OCL) aims to learn representations of individual objects within visual scenes without manual supervision, facilitating efficient and effective visual reasoning. Traditional OCL methods primarily employ bottom-up…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Dongwon Kim , Seoyeon Kim , Suha Kwak

Context-based offline meta-reinforcement learning (OMRL) methods have achieved appealing success by leveraging pre-collected offline datasets to develop task representations that guide policy learning. However, current context-based OMRL…

Machine Learning · Computer Science 2025-02-04 Zhengzhe Zhang , Wenjia Meng , Haoliang Sun , Gang Pan