English
Related papers

Related papers: Stabilizing Deep Q-Learning with ConvNets and Visi…

200 papers

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

Machine Learning · Computer Science 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

Deep convolutional neural networks have achieved exceptional results on multiple detection and recognition tasks. However, the performance of such detectors are often evaluated in public benchmarks under constrained and non-realistic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Yuhang Lu , Touradj Ebrahimi

Conventional reinforcement learning (RL) algorithms exhibit broad generality in their theoretical formulation and high performance on several challenging domains when combined with powerful function approximation. However, developing RL…

Machine Learning · Computer Science 2023-11-07 Joseph Modayil , Zaheer Abbas

Data augmentation is practically helpful for visual recognition, especially at the time of data scarcity. However, such success is only limited to quite a few light augmentations (e.g., random crop, flip). Heavy augmentations are either…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Yalong Bai , Mohan Zhou , Wei Zhang , Bowen Zhou , Tao Mei

When learning behavior, training data is often generated by the learner itself; this can result in unstable training dynamics, and this problem has particularly important applications in safety-sensitive real-world control tasks such as…

Machine Learning · Computer Science 2019-10-10 Vibhavari Dasagi , Jake Bruce , Thierry Peynot , Jürgen Leitner

Reinforcement learning (RL) algorithms usually require a substantial amount of interaction data and perform well only for specific tasks in a fixed environment. In some scenarios such as healthcare, however, usually only few records are…

Machine Learning · Computer Science 2020-12-17 Chaochao Lu , Biwei Huang , Ke Wang , José Miguel Hernández-Lobato , Kun Zhang , Bernhard Schölkopf

Learned reweighting (LRW) approaches to supervised learning use an optimization criterion to assign weights for training instances, in order to maximize performance on a representative validation dataset. We pose and formalize the problem…

Machine Learning · Computer Science 2024-04-01 Nishant Jain , Arun S. Suggala , Pradeep Shenoy

Training a reinforcement learning (RL) agent on a real-world robotics task remains generally impractical due to sample inefficiency. Multi-task RL and meta-RL aim to improve sample efficiency by generalizing over a distribution of related…

Machine Learning · Computer Science 2022-10-21 Jacob Beck , Matthew Thomas Jackson , Risto Vuorio , Shimon Whiteson

The use of Reinforcement Learning (RL) is still restricted to simulation or to enhance human-operated systems through recommendations. Real-world environments (e.g. industrial robots or power grids) are generally designed with safety…

Machine Learning · Computer Science 2020-08-14 Mathieu Seurin , Philippe Preux , Olivier Pietquin

The standard approach to tackling computer vision problems is to train deep convolutional neural network (CNN) models using large-scale image datasets which are representative of the target task. However, in many scenarios, it is often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Alhassan Mumuni , Fuseini Mumuni , Nana Kobina Gerrar

Deep learning has shown great promise for CT image reconstruction, in particular to enable low dose imaging and integrated diagnostics. These merits, however, stand at great odds with the low availability of diverse image data which are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Arjun Krishna , Kedar Bartake , Chuang Niu , Ge Wang , Youfang Lai , Xun Jia , Klaus Mueller

Recent research has turned to Reinforcement Learning (RL) to solve challenging decision problems, as an alternative to hand-tuned heuristics. RL can learn good policies without the need for modeling the environment's dynamics. Despite this…

Machine Learning · Computer Science 2023-01-30 Pouya Hamadanian , Malte Schwarzkopf , Siddartha Sen , Mohammad Alizadeh

Training a deep neural network to maximize a target objective has become the standard recipe for successful machine learning over the last decade. These networks can be optimized with supervised learning, if the target objective is…

Machine Learning · Computer Science 2025-05-12 Bernhard Jaeger , Andreas Geiger

Modern neural networks are over-parameterized and thus rely on strong regularization such as data augmentation and weight decay to reduce overfitting and improve generalization. The dominant form of data augmentation applies invariant…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Yang Liu , Shen Yan , Laura Leal-Taixé , James Hays , Deva Ramanan

Recent advancements in off-policy Reinforcement Learning (RL) have significantly improved sample efficiency, primarily due to the incorporation of various forms of regularization that enable more gradient update steps than traditional…

Machine Learning · Computer Science 2024-06-21 Michal Nauman , Michał Bortkiewicz , Piotr Miłoś , Tomasz Trzciński , Mateusz Ostaszewski , Marek Cygan

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

Machine Learning · Computer Science 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

Data augmentation (DA) is an essential technique for training state-of-the-art deep learning systems. In this paper, we empirically show data augmentation might introduce noisy augmented examples and consequently hurt the performance on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Chengyue Gong , Dilin Wang , Meng Li , Vikas Chandra , Qiang Liu

The Vision Transformer (ViT) architecture has recently achieved competitive performance across a variety of computer vision tasks. One of the motivations behind ViTs is weaker inductive biases, when compared to convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Akash Umakantha , Joao D. Semedo , S. Alireza Golestaneh , Wan-Yi S. Lin

Data augmentation is known to improve the generalization capabilities of neural networks, provided that the set of transformations is chosen with care, a selection often performed manually. Automatic data augmentation aims at automating…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Juliette Marrie , Michael Arbel , Diane Larlus , Julien Mairal

Reasoning from diverse observations is a fundamental capability for generalist robot policies to operate in a wide range of environments. Despite recent advancements, many large-scale robotic policies still remain sensitive to key sources…

Robotics · Computer Science 2025-12-08 Jonathan Yang , Chelsea Finn , Dorsa Sadigh