English
Related papers

Related papers: Modality-Buffet for Real-Time Object Detection

200 papers

Reinforcement Learning (RL) aims at learning an optimal behavior policy from its own experiments and not rule-based control methods. However, there is no RL algorithm yet capable of handling a task as difficult as urban driving. We present…

Machine Learning · Computer Science 2020-03-17 Marin Toromanoff , Emilie Wirbel , Fabien Moutarde

In an autonomous driving system, it is essential to recognize vehicles, pedestrians and cyclists from images. Besides the high accuracy of the prediction, the requirement of real-time running brings new challenges for convolutional network…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Yueming Zhang , Xiaolin Song , Bing Bai , Tengfei Xing , Chao Liu , Xin Gao , Zhihui Wang , Yawei Wen , Haojin Liao , Guoshan Zhang , Pengfei Xu

In this paper, the main task we aim to tackle is the multi-instance semi-supervised video object segmentation across a sequence of frames where only the first-frame box-level ground-truth is provided. Detection-based algorithms are widely…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Mingjie Sun , Jimin Xiao , Eng Gee Lim , Bingfeng Zhang , Yao Zhao

Object localization has been a crucial task in computer vision field. Methods of localizing objects in an image have been proposed based on the features of the attended pixels. Recently researchers have proposed methods to formulate object…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Manoosh Samiei , Ruofeng Li

In partially observable (PO) environments, deep reinforcement learning (RL) agents often suffer from unsatisfactory performance, since two problems need to be tackled together: how to extract information from the raw observations to solve…

Machine Learning · Computer Science 2019-12-25 Dongqi Han , Kenji Doya , Jun Tani

Reinforcement learning (RL) agents need to be robust to variations in safety-critical environments. While system identification methods provide a way to infer the variation from online experience, they can fail in settings where fast…

Machine Learning · Computer Science 2022-03-07 Annie Xie , Shagun Sodhani , Chelsea Finn , Joelle Pineau , Amy Zhang

Current end-to-end deep Reinforcement Learning (RL) approaches require jointly learning perception, decision-making and low-level control from very sparse reward signals and high-dimensional inputs, with little capability of incorporating…

Machine Learning · Computer Science 2019-10-10 Vibhavari Dasagi , Robert Lee , Serena Mou , Jake Bruce , Niko Sünderhauf , Jürgen Leitner

Deep reinforcement learning (DRL) agents are often sensitive to visual changes that were unseen in their training environments. To address this problem, we leverage the sequential nature of RL to learn robust representations that encode…

Artificial Intelligence · Computer Science 2022-07-15 Jiameng Fan , Wenchao Li

Reinforcement Learning (RL) is a general framework concerned with an agent that seeks to maximize rewards in an environment. The learning typically happens through trial and error using explorative methods, such as epsilon-greedy. There are…

Machine Learning · Computer Science 2022-10-06 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

Learning by interaction is the key to skill acquisition for most living organisms, which is formally called Reinforcement Learning (RL). RL is efficient in finding optimal policies for endowing complex systems with sophisticated behavior.…

Robotics · Computer Science 2025-11-21 Karim Farid , Nourhan Sakr

Temporal abstractions in the form of options have been shown to help reinforcement learning (RL) agents learn faster. However, despite prior work on this topic, the problem of discovering options through interaction with an environment…

Machine Learning · Computer Science 2021-02-16 Vivek Veeriah , Tom Zahavy , Matteo Hessel , Zhongwen Xu , Junhyuk Oh , Iurii Kemaev , Hado van Hasselt , David Silver , Satinder Singh

In this paper, we aim to design an efficient real-time object detector that exceeds the YOLO series and is easily extensible for many object recognition tasks such as instance segmentation and rotated object detection. To obtain a more…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Chengqi Lyu , Wenwei Zhang , Haian Huang , Yue Zhou , Yudong Wang , Yanyi Liu , Shilong Zhang , Kai Chen

Multimodal object detection has shown promise in remote sensing. However, multimodal data frequently encounter the problem of low-quality, wherein the modalities lack strict cell-to-cell alignment, leading to mismatch between different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Hafsa El Hafyani , Bastien Pasdeloup , Camille Yver , Pierre Romenteau

Model-based Deep Reinforcement Learning (RL) assumes the availability of a model of an environment's underlying transition dynamics. This model can be used to predict future effects of an agent's possible actions. When no such model is…

Machine Learning · Computer Science 2021-12-15 Andreas Sedlmeier , Michael Kölle , Robert Müller , Leo Baudrexel , Claudia Linnhoff-Popien

Deploying reinforcement learning agents in the real world can be challenging due to the risks associated with learning through trial and error. We propose a task-agnostic method that leverages small sets of safe and unsafe demonstrations to…

Machine Learning · Computer Science 2023-05-09 André Correia , Luís Alexandre

To recognize an object in an image, the user must apply a combination of operators, where each operator has a set of parameters. These parameters must be well adjusted in order to reach good results. Usually, this adjustment is made…

Computer Vision and Pattern Recognition · Computer Science 2012-11-30 Issam Qaffou , Mohamed Sadgal , Aziz Elfazziki

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

Robotics · Computer Science 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

World models predict future transitions from observations and actions. Existing works predominantly focus on image generation only. Visual feature-based world models, on the other hand, predict future visual features instead of raw video…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Xinyu Zhang , Zhengtong Xu , Yutian Tao , Yeping Wang , Yu She , Abdeslam Boularias

In recent years, reinforcement learning (RL) has become increasingly successful in its application to science and the process of scientific discovery in general. However, while RL algorithms learn to solve increasingly complex problems,…

Object detection is an important computer vision task with plenty of real-world applications; therefore, how to enhance its robustness against adversarial attacks has emerged as a crucial issue. However, most of the previous defense methods…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Pin-Chun Chen , Bo-Han Kung , Jun-Cheng Chen