English
Related papers

Related papers: Approximation of Lyapunov Functions from Noisy Dat…

200 papers

We analyze approximation rates of deep ReLU neural networks for Sobolev-regular functions with respect to weaker Sobolev norms. First, we construct, based on a calculus of ReLU networks, artificial neural networks with ReLU activation…

Functional Analysis · Mathematics 2019-02-22 Ingo Gühring , Gitta Kutyniok , Philipp Petersen

Iterative gradient-based optimization algorithms are widely used to solve difficult or large-scale optimization problems. There are many algorithms to choose from, such as gradient descent and its accelerated variants such as Polyak's Heavy…

Optimization and Control · Mathematics 2023-09-21 Bryan Van Scoy , Laurent Lessard

Despite recent advances in regularisation theory, the issue of parameter selection still remains a challenge for most applications. In a recent work the framework of statistical learning was used to approximate the optimal Tikhonov…

Machine Learning · Statistics 2019-05-30 Ernesto de Vito , Zeljko Kereta , Valeria Naumova

Nonlinear dynamical systems are ubiquitous in nature and they are hard to forecast. Not only they may be sensitive to small perturbations in their initial conditions, but they are often composed of processes acting at multiple scales.…

Chaotic Dynamics · Physics 2025-10-06 Chenyu Dong , Davide Faranda , Adriano Gualandi , Valerio Lucarini , Gianmarco Mengaldo

Stochastic approximation is a powerful class of algorithms with celebrated success. However, a large body of previous analysis focuses on stochastic approximations driven by contractive operators, which is not applicable in some important…

Machine Learning · Computer Science 2025-11-21 Ethan Blaser , Shangtong Zhang

The article proposes an approach to complete-type and related Lyapunov-Krasovskii functionals that neither requires knowledge of the delay-Lyapunov matrix function nor does it involve linear matrix inequalities. The approach is based on…

Systems and Control · Electrical Eng. & Systems 2023-12-27 Tessina H. Scholl , Veit Hagenmeyer , Lutz Gröll

In this work we present a low-rank algorithm for computing low-rank approximations of large-scale Lyapunov operator $\varphi$-functions. These computations play a crucial role in implementing of matrix-valued exponential integrators for…

Numerical Analysis · Mathematics 2025-01-07 Dongping Li , Xiuying Zhang , Hongjiong Tian

We present a method for improving a Non Local Means operator by computing its low-rank approximation. The low-rank operator is constructed by applying a filter to the spectrum of the original Non Local Means operator. This results in an…

Computer Vision and Pattern Recognition · Computer Science 2014-12-08 Victor May , Yosi Keller , Nir Sharon , Yoel Shkolnisky

Neural networks are widely used to approximate unknown functions in control. A common neural network architecture uses a single hidden layer (i.e. a shallow network), in which the input parameters are fixed in advance and only the output…

Machine Learning · Computer Science 2024-10-08 Andrew Lamperski , Siddharth Salapaka

This work proposes a learning-based statistical refinement method for improving the denoising results of a given denoiser without knowing the precise noise distribution or accessing clean images or calibration data. While there are many…

Machine Learning · Computer Science 2026-05-07 Rihuan Ke

In this work, the issue of estimation of reachable sets in continuous bimodal piecewise affine systems is studied. A new method is proposed, in the framework of ellipsoidal bounding, using piecewise quadratic Lyapunov functions. Although…

Systems and Control · Electrical Eng. & Systems 2021-06-15 Thuan Le Quang , Nam Phan Thanh , Simone Baldi

This paper discusses the problem of estimating a stochastic signal from nonlinear uncertain observations with time-correlated additive noise described by a first-order Markov process. Random deception attacks are assumed to be launched by…

Signal Processing · Electrical Eng. & Systems 2024-05-09 R. Caballero-Águila , J. Hu , J. Linares-Pérez

In this paper we discuss approximation of partially smooth functions. The problem arises naturally in the study of laminated currents.

Dynamical Systems · Mathematics 2015-06-26 John Fornaess , Yinxia Wang , Erlend Fornaess Wold

We propose to approximate the conditional expectation of a spatial random variable given its nearest-neighbour observations by an additive function. The setting is meaningful in practice and requires no unilateral ordering. It is capable of…

Statistics Theory · Mathematics 2016-03-28 Zudi Lu , Arvid Lundervold , Dag Tjøstheim , Qiwei Yao

A general framework with a series of different methods is proposed to improve the estimate of convex function (or functional) values when only noisy observations of the true input are available. Technically, our methods catch the bias…

Methodology · Statistics 2022-09-15 Chao Ma , Lexing Ying

Approximating a function $f(x)$ on $[-1,1]$ based on $N+1$ samples is a classical problem in numerical analysis. If the samples come with heteroskedastic noise depending on $x$ of variance $\sigma(x)^2$, an $O(N\log N)$ algorithm for this…

Numerical Analysis · Mathematics 2025-08-13 Yuji Nakatsukasa , Yifu Zhang

We provide performance guarantees for a variant of simulation-based policy iteration for controlling Markov decision processes that involves the use of stochastic approximation algorithms along with state-of-the-art techniques that are…

Machine Learning · Computer Science 2022-10-17 Anna Winnicki , R. Srikant

Analysis of transient stability of strongly nonlinear post-fault dynamics is one of the most computationally challenging parts of Dynamic Security Assessment. This paper proposes a novel approach for assessment of transient stability of the…

Systems and Control · Computer Science 2017-11-01 Thanh Long Vu , Konstantin Turitsyn

This paper is concerned with numerical algorithms for gain function approximation in the feedback particle filter. The exact gain function is the solution of a Poisson equation involving a probability-weighted Laplacian. The problem is to…

Probability · Mathematics 2016-03-18 Amirhossein Taghvaei , Prashant G. Mehta

We generalize Newton-type methods for minimizing smooth functions to handle a sum of two convex functions: a smooth function and a nonsmooth function with a simple proximal mapping. We show that the resulting proximal Newton-type methods…

Machine Learning · Statistics 2014-03-19 Jason D. Lee , Yuekai Sun , Michael A. Saunders