English
Related papers

Related papers: Avalanche: A PyTorch Library for Deep Continual Le…

200 papers

Recently, the increasing use of deep reinforcement learning for flow control problems has led to a new area of research, focused on the coupling and the adaptation of the existing algorithms to the control of numerical fluid dynamics…

Computational Physics · Physics 2024-04-19 Jonathan Viquerat , Philippe Meliga , Pablo Jeken , Elie Hachem

Particle Accelerators are high power complex machines. To ensure uninterrupted operation of these machines, thousands of pieces of equipment need to be synchronized, which requires addressing many challenges including design, optimization…

Machine Learning · Computer Science 2025-04-08 Kishansingh Rajput , Sen Lin , Auralee Edelen , Willem Blokland , Malachi Schram

Differentiable sparse linear algebra is foundational for scientific machine learning, yet PyTorch lacks a unified library for it: \texttt{torch.sparse} provides only low-level kernels and a non-differentiable, CPU-only \texttt{spsolve}, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-07 Mingyuan Chi , Shizheng Wen

Recent advances in artificial intelligence research have led to a profusion of studies that apply deep learning to problems in image analysis and natural language processing among others. Additionally, the availability of open-source…

Reinforcement learning is increasingly finding success across domains where the problem can be represented as a Markov decision process. Evolutionary computation algorithms have also proven successful in this domain, exhibiting similar…

Machine Learning · Computer Science 2022-01-25 Rohan Tangri , Danilo P. Mandic , Anthony G. Constantinides

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

With the rapid advancements of deep learning in the past decade, it can be foreseen that deep learning will be continuously deployed in more and more safety-critical applications such as autonomous driving and robotics. In this context,…

Hardware Architecture · Computer Science 2022-04-06 Cheng Liu , Zhen Gao , Siting Liu , Xuefei Ning , Huawei Li , Xiaowei Li

Background and motivation: Deep Reinforcement Learning (Deep RL) is a rapidly developing field. Historically most application has been made to games (such as chess, Atari games, and go). Deep RL is now reaching the stage where it may offer…

Machine Learning · Computer Science 2021-01-14 Michael Allen , Kerry Pearn , Tom Monks

Continual learning is increasingly sought after in real world machine learning applications, as it enables learning in a more human-like manner. Conventional machine learning approaches fail to achieve this, as incrementally updating the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Joe Khawand , Peter Hanappe , David Colliaux

Deep learning methods have shown strong performance in solving tasks for historical document image analysis. However, despite current libraries and frameworks, programming an experiment or a set of experiments and executing them can be…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Lars Vögtlin , Anna Scius-Bertrand , Paul Maergner , Andreas Fischer , Rolf Ingold

Supervised Continual learning involves updating a deep neural network (DNN) from an ever-growing stream of labeled data. While most work has focused on overcoming catastrophic forgetting, one of the major motivations behind continual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Md Yousuf Harun , Jhair Gallardo , Tyler L. Hayes , Christopher Kanan

We introduce ContinualFlow, a principled framework for targeted unlearning in generative models via Flow Matching. Our method leverages an energy-based reweighting loss to softly subtract undesired regions of the data distribution without…

Machine Learning · Computer Science 2025-06-24 Lorenzo Simone , Davide Bacciu , Shuangge Ma

In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information without forgetting old knowledge (i.e., Catastrophic…

Deep transfer learning techniques try to tackle the limitations of deep learning, the dependency on extensive training data and the training costs, by reusing obtained knowledge. However, the current DTL techniques suffer from either…

Machine Learning · Computer Science 2023-05-12 Mohammadreza Iman , John A. Miller , Khaled Rasheed , Robert M. Branch , Hamid R. Arabnia

This paper presents Tunnel, a simple, open source, reinforcement learning training environment for high performance aircraft. It integrates the F16 3D nonlinear flight dynamics into OpenAI Gymnasium python package. The template includes…

Artificial Intelligence · Computer Science 2025-05-06 Greg Search

Active learning (AL) is a prominent technique for reducing the annotation effort required for training machine learning models. Deep learning offers a solution for several essential obstacles to deploying AL in practice but introduces many…

Computation and Language · Computer Science 2022-05-10 Akim Tsvigun , Artem Shelmanov , Gleb Kuzmin , Leonid Sanochkin , Daniil Larionov , Gleb Gusev , Manvel Avetisian , Leonid Zhukov

With deep learning models rapidly growing in size, systems-level solutions for large-model training are required. We present Amazon SageMaker model parallelism, a software library that integrates with PyTorch, and enables easy training of…

This work describes the TrueLearn Python library, which contains a family of online learning Bayesian models for building educational (or more generally, informational) recommendation systems. This family of models was designed following…

Information Retrieval · Computer Science 2023-09-22 Yuxiang Qiu , Karim Djemili , Denis Elezi , Aaneel Shalman , María Pérez-Ortiz , Sahan Bulathwela

Continual learning (CL) provides a framework for training models in ever-evolving environments. Although re-occurrence of previously seen objects or tasks is common in real-world problems, the concept of repetition in the data stream is not…

Third-party resources ($e.g.$, samples, backbones, and pre-trained models) are usually involved in the training of deep neural networks (DNNs), which brings backdoor attacks as a new training-phase threat. In general, backdoor attackers…

Cryptography and Security · Computer Science 2023-02-06 Yiming Li , Mengxi Ya , Yang Bai , Yong Jiang , Shu-Tao Xia