English
Related papers

Related papers: Towards a practical measure of interference for re…

200 papers

Supervised Continual learning involves updating a deep neural network (DNN) from an ever-growing stream of labeled data. While most work has focused on overcoming catastrophic forgetting, one of the major motivations behind continual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Md Yousuf Harun , Jhair Gallardo , Tyler L. Hayes , Christopher Kanan

Continual learning aims to sequentially learn new tasks without forgetting previous tasks' knowledge (catastrophic forgetting). One factor that can cause forgetting is the interference between the gradients on losses from different tasks.…

Computation and Language · Computer Science 2025-12-01 Xueying Bai , Jinghuan Shang , Yifan Sun , Niranjan Balasubramanian

Recent advances in safety-critical risk-aware control are predicated on apriori knowledge of the disturbances a system might face. This paper proposes a method to efficiently learn these disturbances online, in a risk-aware context. First,…

Systems and Control · Electrical Eng. & Systems 2022-12-14 Prithvi Akella , Skylar X. Wei , Joel W. Burdick , Aaron D. Ames

Learning in artificial neural networks usually relies on continuous, externally driven weight updates, in which parameters are modified at every step in response to incoming data, error signals or reward feedback. In this setting, routine…

Neurons and Cognition · Quantitative Biology 2026-05-13 Arturo Tozzi

One of the biggest hurdles robotics faces is the facet of sophisticated and hard-to-engineer behaviors. Reinforcement learning offers a set of tools, and a framework to address this problem. In parallel, the misgivings of robotics offer a…

Robotics · Computer Science 2022-10-17 Akash Nagaraj , Mukund Sood , Bhagya M Patil

Machine learning is the study of computer algorithms that can automatically improve based on data and experience. Machine learning algorithms build a model from sample data, called training data, to make predictions or judgments without…

Neural networks often suffer from catastrophic interference (CI): performance on previously learned tasks drops off significantly when learning a new task. This contrasts strongly with humans, who can continually learn new tasks without…

Machine Learning · Computer Science 2024-08-28 Atith Gandhi , Raj Sanjay Shah , Vijay Marupudi , Sashank Varma

The paper investigates the performance of state-of-the-art low-parameter deep neural networks for computer vision, focusing on bottleneck architectures and their behavior using superlinear activation functions. We address interference in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Lilian Hollard , Lucas Mohimont , Nathalie Gaveau , Luiz-Angelo Steffenel

We investigate the impact of entropy change in deep learning systems by noise injection at different levels, including the embedding space and the image. The series of models that employ our methodology are collectively known as Noisy…

Artificial Intelligence · Computer Science 2025-09-09 Xiaowei Yu , Zhe Huang , Minheng Chen , Lu Zhang , Tianming Liu , Dajiang Zhu

This work describes a technique for active rejection of multiple independent and time-correlated stochastic disturbances for a nonlinear flexible inverted pendulum with cart system with uncertain model parameters. The control law is…

Systems and Control · Electrical Eng. & Systems 2024-04-09 Vincent W. Hill

A central problem in the operation of large wireless networks is how to deal with interference -- the unwanted signals being sent by transmitters that a receiver is not interested in. This thesis looks at ways of combating such…

Information Theory · Computer Science 2011-09-07 Matthew Aldridge

Adversarial training is an effective learning technique to improve the robustness of deep neural networks. In this study, the influence of adversarial training on deep learning models in terms of fairness, robustness, and generalization is…

Machine Learning · Computer Science 2023-05-19 Xiaoling Zhou , Nan Yang , Ou Wu

In order to gain access to networks, different types of intrusion attacks have been designed, and the attackers are working on improving them. Computer networks have become increasingly important in daily life due to the increasing reliance…

Cryptography and Security · Computer Science 2022-12-09 Mohammad Hossein Modirrousta , Parisa Forghani Arani , Mahdi Aliyari Shoorehdeli

This paper reports on advances to the state-of-the-art deep-learning disruption prediction models based on the Fusion Recurrent Neural Network (FRNN) originally introduced a 2019 Nature publication. In particular, the predictor now features…

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

The growing threat of low-cost kamikaze drone swarms poses a critical challenge to modern defense systems demanding rapid and strategic decision-making to prioritize interceptions across multiple effectors and high-value target zones. In…

Machine Learning · Computer Science 2025-09-23 Alessandro Palmas

Recently, researchers have made significant progress combining the advances in deep learning for learning feature representations with reinforcement learning. Some notable examples include training agents to play Atari games based on raw…

Machine Learning · Computer Science 2016-05-30 Yan Duan , Xi Chen , Rein Houthooft , John Schulman , Pieter Abbeel

Due to its perceptual limitations, an agent may have too little information about the state of the environment to act optimally. In such cases, it is important to keep track of the observation history to uncover hidden state. Recent deep…

Machine Learning · Computer Science 2021-02-18 Miguel Suau , Jinke He , Elena Congeduti , Rolf A. N. Starre , Aleksander Czechowski , Frans A. Oliehoek

This research delves deeply into Meta Reinforcement Learning (Meta RL) through a exploration focusing on defining generalization limits and ensuring convergence. By employing a approach this article introduces an innovative theoretical…

Machine Learning · Computer Science 2024-05-24 Cangqing Wang , Mingxiu Sui , Dan Sun , Zecheng Zhang , Yan Zhou

The theory of deep learning focuses almost exclusively on supervised learning, non-convex optimization using stochastic gradient descent, and overparametrized neural networks. It is common belief that the optimizer dynamics, network…

Machine Learning · Computer Science 2022-02-18 Xinyi Chen , Edgar Minasyan , Jason D. Lee , Elad Hazan