English
Related papers

Related papers: Plasticity Loss in Deep Reinforcement Learning: A …

200 papers

In most machine learning training paradigms a fixed, often handcrafted, loss function is assumed to be a good proxy for an underlying evaluation metric. In this work we assess this assumption by meta-learning an adaptive loss function to…

Machine Learning · Computer Science 2019-05-16 Chen Huang , Shuangfei Zhai , Walter Talbott , Miguel Angel Bautista , Shih-Yu Sun , Carlos Guestrin , Josh Susskind

Deep Neural Networks (DNNs) rely on inherent fluctuations in their internal parameters (weights and biases) to effectively navigate the complex optimization landscape and achieve robust performance. While these fluctuations are recognized…

Machine Learning · Computer Science 2025-11-14 Darsh Pareek , Umesh Kumar , Ruthu Rao , Ravi Janjam

Similar to humans and animals, deep artificial neural networks exhibit critical periods during which a temporary stimulus deficit can impair the development of a skill. The extent of the impairment depends on the onset and length of the…

Machine Learning · Computer Science 2019-02-26 Alessandro Achille , Matteo Rovere , Stefano Soatto

The impressive lifelong learning in animal brains is primarily enabled by plastic changes in synaptic connectivity. Importantly, these changes are not passive, but are actively controlled by neuromodulation, which is itself under the…

Neural and Evolutionary Computing · Computer Science 2021-07-06 Thomas Miconi , Aditya Rawal , Jeff Clune , Kenneth O. Stanley

Deep neural networks for computer vision are deployed in increasingly safety-critical and socially-impactful applications, motivating the need to close the gap in model performance under varied, naturally occurring imaging conditions.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Nathan Drenkow , Numair Sani , Ilya Shpitser , Mathias Unberath

One surprising trait of neural networks is the extent to which their connections can be pruned with little to no effect on accuracy. But when we cross a critical level of parameter sparsity, pruning any further leads to a sudden drop in…

Machine Learning · Computer Science 2023-01-20 Junyang Cai , Khai-Nguyen Nguyen , Nishant Shrestha , Aidan Good , Ruisen Tu , Xin Yu , Shandian Zhe , Thiago Serra

Recent advancements in deep learning have been primarily driven by the use of large models trained on increasingly vast datasets. While neural scaling laws have emerged to predict network performance given a specific level of computational…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Elior Benarous , Sotiris Anagnostidis , Luca Biggio , Thomas Hofmann

Reinforcement learning is one of the core components in designing an artificial intelligent system emphasizing real-time response. Reinforcement learning influences the system to take actions within an arbitrary environment either having…

Artificial Intelligence · Computer Science 2020-02-03 Amit Kumar Mondal

Rather than proposing a new method, this paper investigates an issue present in existing learning algorithms. We study the learning dynamics of reinforcement learning (RL), specifically a characteristic coupling between learning and data…

Machine Learning · Computer Science 2019-04-26 Tom Schaul , Diana Borsa , Joseph Modayil , Razvan Pascanu

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

In order for reinforcement learning techniques to be useful in real-world decision making processes, they must be able to produce robust performance from limited data. Deep policy optimization methods have achieved impressive results on…

Machine Learning · Computer Science 2020-12-22 James Queeney , Ioannis Ch. Paschalidis , Christos G. Cassandras

Predictive coding networks are neural models that perform inference through an iterative energy minimization process, whose operations are local in space and time. While effective in shallow architectures, they suffer significant…

Machine Learning · Computer Science 2025-10-13 Chang Qi , Matteo Forasassi , Thomas Lukasiewicz , Tommaso Salvatori

We present a theoretical study of the robustness of parameterized networks to random input perturbations. Specifically, we analyze local robustness at a given network input by quantifying the probability that a small additive random…

Machine Learning · Computer Science 2026-02-24 Věra Kůrková

In contrast to the natural capabilities of humans to learn new tasks in a sequential fashion, neural networks are known to suffer from catastrophic forgetting, where the model's performances on old tasks drop dramatically after being…

Machine Learning · Computer Science 2023-04-03 Sanghwan Kim , Lorenzo Noci , Antonio Orvieto , Thomas Hofmann

An extendable, efficient and explainable Machine Learning approach is proposed to represent cyclic plasticity and replace conventional material models based on the Radial Return Mapping algorithm. High accuracy and stability by means of a…

Materials Science · Physics 2025-08-11 Stefan Hildebrand , Sandra Klinge

The substantial computational demands of modern large-scale deep learning present significant challenges for efficient training and deployment. Recent research has revealed a widespread phenomenon wherein deep networks inherently learn…

Machine Learning · Computer Science 2026-02-04 Laura Balzano , Tianjiao Ding , Benjamin D. Haeffele , Soo Min Kwon , Qing Qu , Peng Wang , Zhangyang Wang , Can Yaras

Deep reinforcement learning is the combination of reinforcement learning (RL) and deep learning. This field of research has been able to solve a wide range of complex decision-making tasks that were previously out of reach for a machine.…

Machine Learning · Computer Science 2018-12-04 Vincent Francois-Lavet , Peter Henderson , Riashat Islam , Marc G. Bellemare , Joelle Pineau

Deep neural networks are learning models with a very high capacity and therefore prone to over-fitting. Many regularization techniques such as Dropout, DropConnect, and weight decay all attempt to solve the problem of over-fitting by…

Machine Learning · Computer Science 2016-12-06 Armen Aghajanyan

Trustworthy machine learning aims at combating distributional uncertainties in training data distributions compared to population distributions. Typical treatment frameworks include the Bayesian approach, (min-max) distributionally robust…

Machine Learning · Computer Science 2025-05-05 Shixiong Wang , Haowei Wang , Xinke Li , Jean Honorio

This paper proposes a paradigm of uncertainty injection for training deep learning model to solve robust optimization problems. The majority of existing studies on deep learning focus on the model learning capability, while assuming the…

Machine Learning · Computer Science 2023-02-28 Wei Cui , Wei Yu