English
Related papers

Related papers: Training instability in deep learning follows low-…

200 papers

Machine unlearning aims to remove the influence of specific training data from pre-trained models without retraining from scratch, and is increasingly important for large language models (LLMs) due to safety, privacy, and legal concerns.…

Computation and Language · Computer Science 2026-03-17 Ruihao Pan , Suhang Wang

Many real-world systems problems require reasoning about the long term consequences of actions taken to configure and manage the system. These problems with delayed and often sequentially aggregated reward, are often inherently…

Machine Learning · Computer Science 2019-09-06 Ameer Haj-Ali , Nesreen K. Ahmed , Ted Willke , Joseph Gonzalez , Krste Asanovic , Ion Stoica

The task of modelling and forecasting a dynamical system is one of the oldest problems, and it remains challenging. Broadly, this task has two subtasks - extracting the full dynamical information from a partial observation; and then…

Dynamical Systems · Mathematics 2022-08-16 Tyrus Berry , Suddhasattwa Das

Learning a stable Linear Dynamical System (LDS) from data involves creating models that both minimize reconstruction error and enforce stability of the learned representation. We propose a novel algorithm for learning stable LDSs. Using a…

Machine Learning · Computer Science 2020-11-19 Giorgos Mamakoukas , Orest Xherija , T. D. Murphey

Reinforcement learning is a general methodology of adaptive optimal control that has attracted much attention in various fields ranging from video game industry to robot manipulators. Despite its remarkable performance demonstrations, plain…

Dynamical Systems · Mathematics 2022-06-14 Pavel Osinenko , Grigory Yaremenko , Ilya Osokin

We propose a novel way to integrate control techniques with reinforcement learning (RL) for stability, robustness, and generalization: leveraging contraction theory to realize modularity in neural control, which ensures that combining…

Machine Learning · Computer Science 2023-11-08 Bing Song , Jean-Jacques Slotine , Quang-Cuong Pham

The recent advancements in Deep Learning models and techniques have led to significant strides in performance across diverse tasks and modalities. However, while the overall capabilities of models show promising growth, our understanding of…

Artificial Intelligence · Computer Science 2025-04-04 Erik Arakelyan

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

In recommender systems, users always choose the favorite items to rate, which leads to data missing not at random and poses a great challenge for unbiased evaluation and learning of prediction models. Currently, the doubly robust (DR)…

Machine Learning · Computer Science 2023-08-25 Haoxuan Li , Chunyuan Zheng , Peng Wu

We study the recently introduced stability training as a general-purpose method to increase the robustness of deep neural networks against input perturbations. In particular, we explore its use as an alternative to data augmentation and…

Machine Learning · Computer Science 2019-11-14 Jan Laermann , Wojciech Samek , Nils Strodthoff

Understanding the learning dynamics of neural networks is one of the key issues for the improvement of optimization algorithms as well as for the theoretical comprehension of why deep neural nets work so well today. In this paper, we…

Machine Learning · Statistics 2021-03-18 Zhenyu Liao , Romain Couillet

In this research, we address critical concerns related to the numerical instability observed in 16-bit computations of machine learning models. Such instability, particularly when employing popular optimization algorithms like Adam, often…

Machine Learning · Computer Science 2025-06-18 Juyoung Yun

Robust imitation learning using disturbance injections overcomes issues of limited variation in demonstrations. However, these methods assume demonstrations are optimal, and that policy stabilization can be learned via simple augmentations.…

Robotics · Computer Science 2022-05-10 Hirotaka Tahara , Hikaru Sasaki , Hanbit Oh , Brendan Michael , Takamitsu Matsubara

Non-linear dynamical systems represent a compact, flexible, and robust tool for reactive motion generation. The effectiveness of dynamical systems relies on their ability to accurately represent stable motions. Several approaches have been…

Robotics · Computer Science 2020-06-01 Matteo Saveriano

Robustness to noise is of utmost importance in reinforcement learning systems, particularly in military contexts where high stakes and uncertain environments prevail. Noise and uncertainty are inherent features of military operations,…

Machine Learning · Computer Science 2023-11-16 Lorenzo Nodari , Federico Cerutti

Reproducibility is an increasing concern in Artificial Intelligence (AI), particularly in the area of Deep Learning (DL). Being able to reproduce DL models is crucial for AI-based systems, as it is closely tied to various tasks like…

Machine Learning · Computer Science 2022-02-08 Boyuan Chen , Mingzhi Wen , Yong Shi , Dayi Lin , Gopi Krishnan Rajbahadur , Zhen Ming , Jiang

Efficient skill acquisition, representation, and on-line adaptation to different scenarios has become of fundamental importance for assistive robotic applications. In the past decade, dynamical systems (DS) have arisen as a flexible and…

Robotics · Computer Science 2020-03-27 Matteo Saveriano , Dongheui Lee

Incorporating a priori physics knowledge into machine learning leads to more robust and interpretable algorithms. In this work, we combine deep learning techniques and classic numerical methods for differential equations to address two…

Machine Learning · Computer Science 2026-05-04 Caitlin Ho , Andrea Arnold

As machine learning models become increasingly prevalent in critical decision-making models and systems in fields like finance, healthcare, etc., ensuring their robustness against adversarial attacks and changes in the input data is…

Machine Learning · Statistics 2024-08-05 Arun Prakash R , Anwesha Bhattacharyya , Joel Vaughan , Vijayan N. Nair

Many safety-critical scientific and engineering systems evolve according to differential-algebraic equations (DAEs), where dynamical behavior is constrained by physical laws and admissibility conditions. In practice, these systems operate…

Machine Learning · Computer Science 2026-04-14 Minxing Zheng , Zewei Deng , Liyan Xie , Shixiang Zhu