English
Related papers

Related papers: Neuron-level Balance between Stability and Plastic…

200 papers

Continual learning (CL) in deep neural networks (DNNs) involves incrementally accumulating knowledge in a DNN from a growing data stream. A major challenge in CL is that non-stationary data streams cause catastrophic forgetting of…

Machine Learning · Computer Science 2024-05-02 Md Yousuf Harun , Jhair Gallardo , Junyu Chen , Christopher Kanan

Deep Reinforcement Learning (RL) has emerged as a powerful paradigm for training neural policies to solve complex control tasks. However, these policies tend to be overfit to the exact specifications of the task and environment they were…

Neural and Evolutionary Computing · Computer Science 2023-09-11 Felix Chalumeau , Raphael Boige , Bryan Lim , Valentin Macé , Maxime Allard , Arthur Flajolet , Antoine Cully , Thomas Pierrot

Time-dependent data-generating distributions have proven to be difficult for gradient-based training of neural networks, as the greedy updates result in catastrophic forgetting of previously learned knowledge. Despite the progress in the…

Machine Learning · Computer Science 2023-04-03 Matthias De Lange , Gido van de Ven , Tinne Tuytelaars

Deep neural policies have recently been installed in a diverse range of settings, from biotechnology to automated financial systems. However, the utilization of deep neural networks to approximate the value function leads to concerns on the…

Machine Learning · Computer Science 2024-06-26 Ezgi Korkmaz

Many industrial machine learning (ML) systems require frequent retraining to keep up-to-date with constantly changing data. This retraining exacerbates a large challenge facing ML systems today: model training is unstable, i.e., small…

Computation and Language · Computer Science 2020-03-12 Megan Leszczynski , Avner May , Jian Zhang , Sen Wu , Christopher R. Aberger , Christopher Ré

Artificial neural networks have shown remarkable success in supervised learning when trained on a single task using a fixed dataset. However, when neural networks are trained on a reinforcement learning task, their ability to continue…

Machine Learning · Computer Science 2026-03-10 Mansi Maheshwari , John C. Raisbeck , Bruno Castro da Silva

This paper proposes a novel approach to improve the performance of distributed nonlinear control systems while preserving stability by leveraging Deep Neural Networks (DNNs). We build upon the Neural System Level Synthesis (Neur-SLS)…

Optimization and Control · Mathematics 2024-08-01 Danilo Saccani , Leonardo Massai , Luca Furieri , Giancarlo Ferrari-Trecate

Deep continual learning requires models to adapt to new tasks without retraining from scratch. However, neural networks can lose their ability to adapt to new tasks after training on previous ones, a phenomenon known as loss of plasticity.…

Machine Learning · Computer Science 2026-05-12 Jiuqi Wang , Jayanth Srinivasa , Claire Chen , Shuze Daniel Liu , Ali Payani , Shangtong Zhang

Controlling the degree of stylization in the Neural Style Transfer (NST) is a little tricky since it usually needs hand-engineering on hyper-parameters. In this paper, we propose the first deep Reinforcement Learning (RL) based architecture…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Chengming Feng , Jing Hu , Xin Wang , Shu Hu , Bin Zhu , Xi Wu , Hongtu Zhu , Siwei Lyu

Reinforcement learning (RL) is attracting attention as an effective way to solve sequential optimization problems that involve high dimensional state/action space and stochastic uncertainties. Many such problems involve constraints…

Machine Learning · Computer Science 2021-04-01 Haeun Yoo , Victor M. Zavala , Jay H. Lee

Scaling deep reinforcement learning networks is challenging and often results in degraded performance, yet the root causes of this failure mode remain poorly understood. Several recent works have proposed mechanisms to address this, but…

A growing body of evidence suggests that neural networks employed in deep reinforcement learning (RL) gradually lose their plasticity, the ability to learn from new data; however, the analysis and mitigation of this phenomenon is hampered…

Machine Learning · Computer Science 2023-10-05 Evgenii Nikishin , Junhyuk Oh , Georg Ostrovski , Clare Lyle , Razvan Pascanu , Will Dabney , André Barreto

Deep reinforcement learning (DRL) has seen remarkable success in the control of single robots. However, applying DRL to robot swarms presents significant challenges. A critical challenge is non-stationarity, which occurs when two or more…

Robotics · Computer Science 2023-08-29 Joshua Bloom , Pranjal Paliwal , Apratim Mukherjee , Carlo Pinciroli

Efficient and effective learning is one of the ultimate goals of the deep reinforcement learning (DRL), although the compromise has been made in most of the time, especially for the application of robot manipulations. Learning is always…

Machine Learning · Computer Science 2020-03-06 Yongle Luo , Kun Dong , Lili Zhao , Zhiyong Sun , Chao Zhou , Bo Song

Image restoration schemes based on the pre-trained deep models have received great attention due to their unique flexibility for solving various inverse problems. In particular, the Plug-and-Play (PnP) framework is a popular and powerful…

Image and Video Processing · Electrical Eng. & Systems 2022-07-26 Chong Wang , Rongkai Zhang , Saiprasad Ravishankar , Bihan Wen

Continual learning is the problem of sequentially learning new tasks or knowledge while protecting previously acquired knowledge. However, catastrophic forgetting poses a grand challenge for neural networks performing such learning process.…

Machine Learning · Computer Science 2020-07-01 Vithursan Thangarasa , Thomas Miconi , Graham W. Taylor

Despite the tremendous successes of deep neural networks (DNNs) in various applications, many fundamental aspects of deep learning remain incompletely understood, including DNN trainability. In a trainability study, one aims to discern what…

Machine Learning · Computer Science 2023-05-19 Yueyao Yu , Yin Zhang

While deep neural networks have surpassed human performance in multiple situations, they are prone to catastrophic forgetting: upon training a new task, they rapidly forget previously learned ones. Neuroscience studies, based on idealized…

Neural and Evolutionary Computing · Computer Science 2021-03-24 Axel Laborieux , Maxence Ernoult , Tifenn Hirtzlin , Damien Querlioz

The ability to continuously and efficiently transfer skills across tasks is a hallmark of biological intelligence and a long-standing goal in artificial systems. Reinforcement learning (RL), a dominant paradigm for learning in…

Machine Learning · Computer Science 2025-05-30 Eleni Nisioti , Joachim Winther Pedersen , Erwan Plantec , Milton L. Montero , Sebastian Risi

The current dominant paradigm in sensorimotor control, whether imitation or reinforcement learning, is to train policies directly in raw action spaces such as torque, joint angle, or end-effector position. This forces the agent to make…

Machine Learning · Computer Science 2020-12-07 Shikhar Bahl , Mustafa Mukadam , Abhinav Gupta , Deepak Pathak