English
Related papers

Related papers: Adaptive Finite-Difference Interval Estimation for…

200 papers

Accurately extracting driving events is the way to maximize computational efficiency and anomaly detection performance in the tire frictional nose-based anomaly detection task. This study proposes a concise and highly useful method for…

Machine Learning · Computer Science 2022-12-05 YeongHyeon Park , Myung Jin Kim , Won Seok Park

Finite differences, as a subclass of direct methods in the calculus of variations, consist in discretizing the objective functional using appropriate approximations for derivatives that appear in the problem. This article generalizes the…

Optimization and Control · Mathematics 2013-08-09 Shakoor Pooseh , Ricardo Almeida , Delfim F. M. Torres

Models incorporating uncertain inputs, such as random forces or material parameters, have been of increasing interest in PDE-constrained optimization. In this paper, we focus on the efficient numerical minimization of a convex and smooth…

Optimization and Control · Mathematics 2021-06-18 Caroline Geiersbach , Winnifried Wollner

We study a diagnosis scheme to reliably detect the active mode of discrete-time, switched affine systems in the presence of measurement noise and asynchronous switching. The proposed scheme consists of two parts: (i) the construction of a…

Systems and Control · Electrical Eng. & Systems 2023-01-02 Jingwei Dong , Arman Sharifi Kolarijani , Peyman Mohajerin Esfahani

An open problem in optimization with noisy information is the computation of an exact minimizer that is independent of the amount of noise. A standard practice in stochastic approximation algorithms is to use a decreasing step-size. This…

Optimization and Control · Mathematics 2021-02-24 Anastasia Borovykh , Nikolas Kantas , Panos Parpas , Grigorios A. Pavliotis

It is proved that one cannot approximate stably the first derivative of a smooth function given noisy values of this function and a bound on this function and its first derivative. Such an approximation is shown to be possible if an a…

Mathematical Physics · Physics 2007-05-23 A. G. Ramm

This paper considers non-smooth optimization problems where we seek to minimize the pointwise maximum of a continuously parameterized family of functions. Since the objective function is given as the solution to a maximization problem,…

Optimization and Control · Mathematics 2026-01-12 Dimitris Boskos , Jorge Cortés , Sonia Martínez

We address the problem of zero-order optimization from noisy observations for an objective function satisfying the Polyak-{\L}ojasiewicz or the strong convexity condition. Additionally, we assume that the objective function has an additive…

Machine Learning · Statistics 2025-09-03 Arya Akhavan , Alexandre B. Tsybakov

In this paper, we prove new complexity bounds for zeroth-order methods in non-convex optimization with inexact observations of the objective function values. We use the Gaussian smoothing approach of Nesterov and Spokoiny [2015] and extend…

Optimization and Control · Mathematics 2021-01-14 Innokentiy Shibaev , Pavel Dvurechensky , Alexander Gasnikov

We pose the approximation problem for scalar nonnegative input-output systems via impulse response convolutions of finite order, i.e. finite order moving averages, based on repeated observations of input/output signal pairs. The problem is…

Optimization and Control · Mathematics 2023-02-27 Lorenzo Finesso , Peter Spreij

This work investigates finite differences and the use of interpolation models to obtain approximations to the first and second derivatives of a function. Here, it is shown that if a particular set of points is used in the interpolation…

Optimization and Control · Mathematics 2020-01-24 Ian D. Coope , Rachael Tappenden

We present an adaptive smoother for linear state-space models with unknown process and measurement noise covariances. The proposed method utilizes the variational Bayes technique to perform approximate inference. The resulting smoother is…

Systems and Control · Computer Science 2023-07-19 Tohid Ardeshiri , Emre Özkan , Umut Orguner , Fredrik Gustafsson

Numerous Optimization Algorithms have a time-varying update rule thanks to, for instance, a changing step size, momentum parameter or, Hessian approximation. In this paper, we apply unrolled or automatic differentiation to a time-varying…

Optimization and Control · Mathematics 2024-10-28 Sheheryar Mehmood , Peter Ochs

This paper discusses model order reduction of LTI systems over limited frequency intervals within the framework of balanced truncation. Two new \emph{frequency-dependent balanced truncation} methods were developed, one is \emph{SF-type…

Systems and Control · Computer Science 2016-02-16 Xin Du , Peter Benner

This article is devoted to the numerical study of various finite difference approximations to the stochastic Burgers equation. Of particular interest in the one-dimensional case is the situation where the driving noise is white both in…

Probability · Mathematics 2013-09-20 Martin Hairer , Jochen Voss

We show when maximizing a properly defined $f$-divergence measure with respect to a classifier's predictions and the supervised labels is robust with label noise. Leveraging its variational form, we derive a nice decoupling property for a…

Machine Learning · Computer Science 2021-08-20 Jiaheng Wei , Yang Liu

In the automotive industry, predicting noise during design cycle is a necessary step. Well-known methods exist to answer this issue in low frequency domain. Among these, Finite Element Methods, adapted to closed domains, are quite easy to…

Computational Engineering, Finance, and Science · Computer Science 2008-12-18 Marianne Viallet , Gérald Poumérol , Olivier Dessombz , Louis Jezequel

We address the problem of minimizing a smooth function $f^0(x)$ over a compact set $D$ defined by smooth functional constraints $f^i(x)\leq 0,~ i = 1,\ldots, m$ given noisy value measurements of $f^i(x)$. This problem arises in…

Optimization and Control · Mathematics 2019-12-20 Ilnura Usmanova , Andreas Krause , Maryam Kamgarpour

We study the classical problem of approximating a non-decreasing function $f: \mathcal{X} \to \mathcal{Y}$ in $L^p(\mu)$ norm by sequentially querying its values, for known compact real intervals $\mathcal{X}$, $\mathcal{Y}$ and a known…

Machine Learning · Computer Science 2023-09-15 Pierre Gaillard , Sébastien Gerchinovitz , Étienne de Montbrun

We study derivative-free methods for policy optimization over the class of linear policies. We focus on characterizing the convergence rate of these methods when applied to linear-quadratic systems, and study various settings of driving…

Machine Learning · Computer Science 2020-05-19 Dhruv Malik , Ashwin Pananjady , Kush Bhatia , Koulik Khamaru , Peter L. Bartlett , Martin J. Wainwright