English
Related papers

Related papers: Object-Category Aware Reinforcement Learning

200 papers

Object detection models shipped with camera-equipped edge devices cannot cover the objects of interest for every user. Therefore, the incremental learning capability is a critical feature for a robust and personalized object detection…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Dawei Li , Serafettin Tasci , Shalini Ghosh , Jingwen Zhu , Junting Zhang , Larry Heck

Recently, by introducing large-scale dataset and strong transformer network, video-language pre-training has shown great success especially for retrieval. Yet, existing video-language transformer models do not explicitly fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Alex Jinpeng Wang , Yixiao Ge , Guanyu Cai , Rui Yan , Xudong Lin , Ying Shan , Xiaohu Qie , Mike Zheng Shou

Despite the recent advances in the field of object detection, common architectures are still ill-suited to incrementally detect new categories over time. They are vulnerable to catastrophic forgetting: they forget what has been already…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Fabio Cermelli , Antonino Geraci , Dario Fontanel , Barbara Caputo

Object-Centric Learning (OCL) aggregates image or video feature maps into object-level feature vectors, termed \textit{slots}. It's self-supervision of reconstructing the input from slots struggles with complex object textures, thus Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Rongzhen Zhao , Vivienne Wang , Juho Kannala , Joni Pajarinen

The field of Continual Learning investigates the ability to learn consecutive tasks without losing performance on those previously learned. Its focus has been mainly on incremental classification tasks. We believe that research in continual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Angelo G. Menezes , Gustavo de Moura , Cézanne Alves , André C. P. L. F. de Carvalho

A novel method, the Pareto Envelope Augmented with Reinforcement Learning (PEARL), has been developed to address the challenges posed by multi-objective problems, particularly in the field of engineering where the evaluation of candidate…

Machine Learning · Computer Science 2024-03-19 Paul Seurin , Koroush Shirvan

Multi-objective reinforcement learning (MORL) extends traditional RL by seeking policies making different compromises among conflicting objectives. The recent surge of interest in MORL has led to diverse studies and solving methods, often…

Machine Learning · Computer Science 2024-02-06 Florian Felten , El-Ghazali Talbi , Grégoire Danoy

Causal dynamics models (CDMs) have demonstrated significant potential in addressing various challenges in reinforcement learning. To learn CDMs, recent studies have performed causal discovery to capture the causal dependencies among…

Machine Learning · Computer Science 2024-05-22 Zhongwei Yu , Jingqing Ruan , Dengpeng Xing

Existing object detectors often struggle to generalize across domains while adapting to emerging novel categories. Adaptive open-set object detection (AOOD) addresses this challenge by training on base categories in the source domain and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuqi Ji , Junjie Ke , Lihuo He , Lizhi Wang , Xinbo Gao

This paper presents a detailed study of improving visual representations for vision language (VL) tasks and develops an improved object detection model to provide object-centric representations of images. Compared to the most widely used…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Pengchuan Zhang , Xiujun Li , Xiaowei Hu , Jianwei Yang , Lei Zhang , Lijuan Wang , Yejin Choi , Jianfeng Gao

Recognizing and reasoning about occluded (partially or fully hidden) objects is vital to understanding visual scenes, as occlusions frequently occur in real-world environments and act as obstacles for spatial comprehension. To test models'…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Atin Pothiraj , Elias Stengel-Eskin , Jaemin Cho , Mohit Bansal

Object-aware reasoning in vision-language tasks poses significant challenges for current models, particularly in handling unseen objects, reducing hallucinations, and capturing fine-grained relationships in complex visual scenes. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Antonio Carlos Rivera , Anthony Moore , Steven Robinson

Open-world object detection (OWOD) requires incrementally detecting known categories while reliably identifying unknown objects. Existing methods primarily focus on improving unknown recall, yet overlook interpretability, often leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Xueqiang Lv , Shizhou Zhang , Yinghui Xing , Di Xu , Peng Wang , Yanning Zhang

Sample efficiency and exploration remain critical challenges in Deep Reinforcement Learning (DRL), particularly in complex domains. Offline RL, which enables agents to learn optimal policies from static, pre-collected datasets, has emerged…

Machine Learning · Computer Science 2025-12-23 Gaurav Chaudhary , Wassim Uddin Mondal , Laxmidhar Behera

Ordinal regression refers to classifying object instances into ordinal categories. Ordinal regression is crucial for applications in various areas like facial age estimation, image aesthetics assessment, and even cancer staging, due to its…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jinhong Wang , Jintai Chen , Jian Liu , Dongqi Tang , Danny Z. Chen , Jian Wu

Offline Reinforcement Learning (ORL) enablesus to separately study the two interlinked processes of reinforcement learning: collecting informative experience and inferring optimal behaviour. The second step has been widely studied in the…

Object detection is a critical component of transportation systems, particularly for applications such as autonomous driving, traffic monitoring, and infrastructure maintenance. Traditional object detection methods often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Taqwa Alhadidi , Ahmed Jaber , Shadi Jaradat , Huthaifa I Ashqar , Mohammed Elhenawy

Inverse reinforcement learning (IRL) aims to explicitly infer an underlying reward function based on collected expert demonstrations. Considering that obtaining expert demonstrations can be costly, the focus of current IRL techniques is on…

Machine Learning · Computer Science 2023-10-16 Lu Li , Yuxin Pan , Ruobing Chen , Jie Liu , Zilin Wang , Yu Liu , Zhiheng Li

For object detection detectors, enhancing model performance hinges on the ability to simultaneously consider inconsistencies across tasks and focus on difficult-to-train samples. Achieving this necessitates incorporating information from…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Yanquan Huang , Liu Wei Zhen , Yun Hao , Mengyuan Zhang , Qingyao Wu , Zikun Deng , Xueming Liu , Hong Deng

Weakly supervised learning has emerged as a compelling tool for object detection by reducing the need for strong supervision during training. However, major challenges remain: (1) differentiation of object instances can be ambiguous; (2)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Zhongzheng Ren , Zhiding Yu , Xiaodong Yang , Ming-Yu Liu , Yong Jae Lee , Alexander G. Schwing , Jan Kautz