English
Related papers

Related papers: Detecting Potential Instabilities of Numerical Alg…

200 papers

Motivated by a variety of applications, high-dimensional time series have become an active topic of research. In particular, several methods and finite-sample theories for individual stable autoregressive processes with known lag have…

Statistics Theory · Mathematics 2023-03-06 Somnath Chakraborty , Johannes Lederer , Rainer von Sachs

The majority of machine learning methods can be regarded as the minimization of an unavailable risk function. To optimize the latter, given samples provided in a streaming fashion, we define a general stochastic Newton algorithm and its…

Statistics Theory · Mathematics 2023-06-30 Claire Boyer , Antoine Godichon-Baggioni

Despite their widespread use, training deep Transformers can be unstable. Layer normalization, a standard component, improves training stability, but its placement has often been ad-hoc. In this paper, we conduct a principled study on the…

Machine Learning · Computer Science 2025-10-14 Kelvin Kan , Xingjian Li , Benjamin J. Zhang , Tuhin Sahai , Stanley Osher , Krishna Kumar , Markos A. Katsoulakis

To predict allowable time-step size for the fully discretized nonlinear differential equations, a stability theory is developed using exact determination of an infinite perturbation series. Mathematical induction is used to determine the…

Numerical Analysis · Mathematics 2013-11-05 Arash Ghasemi , Kidambi Sreenivas , Lafayette K. Taylor

Exponential generalization bounds with near-tight rates have recently been established for uniformly stable learning algorithms. The notion of uniform stability, however, is stringent in the sense that it is invariant to the data-generating…

Machine Learning · Statistics 2022-06-09 Xiao-Tong Yuan , Ping Li

Nowadays we are witnessing a transformation of the business processes towards a more computation driven approach. The ever increasing usage of Machine Learning techniques is the clearest example of such trend. This sort of revolution is…

Machine Learning · Computer Science 2022-03-18 Giorgio Visani , Enrico Bagli , Federico Chesani , Alessandro Poluzzi , Davide Capuzzo

Motivated by questions in robust control and switched linear dynamical systems, we consider the problem checking whether all convex combinations of k matrices in R^{n x n} are stable. In particular, we are interested whether there exist…

Optimization and Control · Mathematics 2009-01-15 L. Gurvits , A. Olshevsky

Stable matching is a fundamental problem studied both in economics and computer science. The task is to find a matching between two sides of agents that have preferences over who they want to be matched with. A matching is stable if no pair…

Computer Science and Game Theory · Computer Science 2024-03-11 Juho Hirvonen , Sara Ranjbaran

Adversarial examples resulting from instability of current computer vision models are an extremely important topic due to their potential to compromise any application. In this paper we demonstrate that instability is inevitable due to a)…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Oliver Turnbull , George Cevora

We consider a neural network architecture designed to solve inverse problems where the degradation operator is linear and known. This architecture is constructed by unrolling a forward-backward algorithm derived from the minimization of an…

Optimization and Control · Mathematics 2025-10-02 Emilie Chouzenoux , Cecile Della Valle , Jean-Christophe Pesquet

We examine the stability of loss-minimizing training processes that are used for deep neural networks (DNN) and other classifiers. While a classifier is optimized during training through a so-called loss function, the performance of…

Analysis of PDEs · Mathematics 2020-10-05 Leonid Berlyand , Pierre-Emmanuel Jabin , C. Alex Safsten

We consider the spatial central force problem with a real analytic potential. We prove that for all analytic potentials, but the Keplerian and the Harmonic ones, the Hamiltonian fulfills a nondegeneracy property needed for the applicability…

Mathematical Physics · Physics 2019-09-20 Dario Bambusi , Alessandra Fusé , Marco Sansottera

Many statistical estimators are defined as the fixed point of a data-dependent operator, with estimators based on minimizing a cost function being an important special case. The limiting performance of such estimators depends on the…

Machine Learning · Computer Science 2022-03-22 Nhat Ho , Koulik Khamaru , Raaz Dwivedi , Martin J. Wainwright , Michael I. Jordan , Bin Yu

Deep neural networks have become invaluable tools for supervised machine learning, e.g., classification of text or images. While often offering superior results over traditional techniques and successfully expressing complicated patterns in…

Machine Learning · Computer Science 2019-02-19 Eldad Haber , Lars Ruthotto

Stacking is a general approach for combining multiple models toward greater predictive accuracy. It has found various application across different domains, ensuing from its meta-learning nature. Our understanding, nevertheless, on how and…

Machine Learning · Computer Science 2019-01-29 Nino Arsov , Martin Pavlovski , Ljupco Kocarev

We study the stability of static, spherically symmetric solutions of Rastall's theory in the presence of a scalar field with respect to spherically symmetric perturbations. It is shown that the stability analysis is inconsistent in the…

General Relativity and Quantum Cosmology · Physics 2021-02-24 K. A. Bronnikov , Júlio C. Fabris , Oliver F. Piattella , Denis C. Rodrigues , Edison C. O. Santos

Neural-based, data-driven analysis and control of dynamical systems have been recently investigated and have shown great promise, e.g. for safety verification or stability analysis. Indeed, not only do neural networks allow for an entirely…

Optimization and Control · Mathematics 2023-12-14 Virginie Debauche , Alec Edwards , Raphael M. Jungers , Alessandro Abate

The randomized Kaczmarz method and its accelerated variants are a powerful class of iterative methods for solving large-scale linear systems, offering guaranteed convergence with low per-iteration cost. However, their numerical stability…

Numerical Analysis · Mathematics 2026-05-19 Michał Dereziński , Ethan N. Epperly , Deanna Needell , Alexander Xue

In this paper, we consider a matroid generalization of the stable matching problem. In particular, we consider the setting where preferences may contain ties. For this generalization, we propose a polynomial-time algorithm for the problem…

Computer Science and Game Theory · Computer Science 2026-01-19 Naoyuki Kamiyama

We introduce a method for learning provably stable deep neural network based dynamic models from observed data. Specifically, we consider discrete-time stochastic dynamic models, as they are of particular interest in practical applications…

Machine Learning · Computer Science 2021-03-30 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , Johan U. Backström , R. Bhushan Gopaluni