English
Related papers

Related papers: Optimal robust exact first-order differentiators w…

200 papers

We present the first study of robustness of systems that are both timed as well as reactive (I/O). We study the behavior of such timed I/O systems in the presence of "uncertain inputs" and formalize their robustness using the analytic…

Formal Languages and Automata Theory · Computer Science 2015-06-04 Thomas A. Henzinger , Jan Otop , Roopsha Samanta

We investigate the problem of checking if a finite-state transducer is robust to uncertainty in its input. Our notion of robustness is based on the analytic notion of Lipschitz continuity --- a transducer is K-(Lipschitz) robust if the…

Formal Languages and Automata Theory · Computer Science 2014-10-08 Thomas A. Henzinger , Jan Otop , Roopsha Samanta

The ODE method has been a workhorse for algorithm design and analysis since the introduction of the stochastic approximation. It is now understood that convergence theory amounts to establishing robustness of Euler approximations for ODEs,…

Optimization and Control · Mathematics 2020-10-02 Shuhang Chen , Adithya Devraj , Andrey Bernstein , Sean Meyn

We consider in this paper a class of single-ratio fractional minimization problems, in which the numerator part of the objective is the sum of a nonsmooth nonconvex function and a smooth nonconvex function while the denominator part is a…

Optimization and Control · Mathematics 2020-12-23 Na Zhang , Qia Li

Many iterative optimization algorithms involve compositions of special cases of Lipschitz continuous operators, namely firmly nonexpansive, averaged and nonexpansive operators. The structure and properties of the compositions are of…

Optimization and Control · Mathematics 2020-01-01 Pontus Giselsson , Walaa M. Moursi

Continuous speech can be converted into a discrete sequence by deriving discrete units from the hidden features of self-supervised learned (SSL) speech models. Although SSL models are becoming larger and trained on more data, they are often…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Jakob Poncelet , Yujun Wang , Hugo Van hamme

First order optimization algorithms play a major role in large scale machine learning. A new class of methods, called adaptive algorithms, were recently introduced to adjust iteratively the learning rate for each coordinate. Despite great…

Machine Learning · Computer Science 2019-10-01 André Belotto da Silva , Maxime Gazeau

This paper addresses explainability of the operator-regularization approach under the use of monotone Lipschitz-gradient (MoL-Grad) denoiser -- an operator that can be expressed as the Lipschitz continuous gradient of a differentiable…

Optimization and Control · Mathematics 2025-09-26 Masahiro Yukawa , Isao Yamada

We provide two solutions to the heretofore open problem of stabilization of systems with arbitrarily long delays at the input and output of a nonlinear system using output feedback only. Both of our solutions are global, employ the…

Optimization and Control · Mathematics 2011-08-24 Iasson Karafyllis , Miroslav Krstic

This paper rigorously solves the challenging problem of recognizing periodic patterns under rigid motion in Euclidean geometry. The 3-dimensional case is practically important for justifying the novelty of solid crystalline materials…

Metric Geometry · Mathematics 2025-10-30 Olga Anosova , Daniel Widdowson , Vitaliy Kurlin

As deep neural networks can easily overfit noisy labels, robust training in the presence of noisy labels is becoming an important challenge in modern deep learning. While existing methods address this problem in various directions, they…

Machine Learning · Computer Science 2022-11-30 Jongwoo Ko , Bongsoo Yi , Se-Young Yun

Validation is a major challenge in differentiable programming. The state of the art is based on algorithmic differentiation. Consistency of first-order tangent and adjoint programs is defined by a well-known first-order differential…

Numerical Analysis · Mathematics 2021-01-12 Uwe Naumann

Sign-based stochastic methods have gained attention due to their ability to achieve robust performance despite using only the sign information for parameter updates. However, the current convergence analysis of sign-based methods relies on…

Machine Learning · Computer Science 2023-10-24 Tao Sun , Congliang Chen , Peng Qiao , Li Shen , Xinwang Liu , Dongsheng Li

The Loschmidt echo is a popular quantity that allows making predictions about the stability of quantum states under time evolution. In our work, we present an approach that allows us to find a differential equation that can be used to…

Statistical Mechanics · Physics 2025-01-08 Michael Vogl

Recently emerging large-scale biomedical data pose exciting opportunities for scientific discoveries. However, the ultrahigh dimensionality and non-negligible measurement errors in the data may create difficulties in estimation. There are…

Methodology · Statistics 2022-10-28 Xin Ma , Suprateek Kundu

This paper considers the nonconvex nonsmooth problem in which the objective function is Lipschitz continuous. We focus on the stochastic setting where the algorithm can access stochastic function value evaluations with heavy-tailed noise,…

Machine Learning · Computer Science 2026-05-26 Zhuanghua Liu , Luo Luo

Prescribed-time algorithms based on time-varying gains may have remarkable properties, such as regulation in a user-prescribed finite time that is the same for every nonzero initial condition and that holds even under matched disturbances.…

Systems and Control · Electrical Eng. & Systems 2023-12-18 Rodrigo Aldana-López , Richard Seeber , Hernan Haimovich , David Gómez-Gutiérrez

Differentiable simulators promise faster computation time for reinforcement learning by replacing zeroth-order gradient estimates of a stochastic objective with an estimate based on first-order gradients. However, it is yet unclear what…

Machine Learning · Computer Science 2022-08-23 H. J. Terry Suh , Max Simchowitz , Kaiqing Zhang , Russ Tedrake

This paper presents a high-order differentiator for delayed measurement signal. The proposed differentiator not only can correct the delay in signal, but aslo can estimate the undelayed derivatives. The differentiator consists of two-step…

Systems and Control · Computer Science 2011-03-08 Xinhua Wang , Hai Lin

Deep learning has achieved remarkable success across a wide range of domains, significantly expanding the frontiers of what is achievable in artificial intelligence. Yet, despite these advances, critical challenges remain -- most notably,…

Machine Learning · Computer Science 2026-02-05 Róisín Luo