English
Related papers

Related papers: An arbitrary-order predefined-time exact different…

200 papers

We present a stochastic constrained output-feedback data-driven predictive control scheme for linear time-invariant systems subject to bounded additive disturbances. The approach uses data-driven predictors based on an extension of Willems'…

Systems and Control · Electrical Eng. & Systems 2025-10-07 Johannes Teutsch , Sebastian Kerz , Dirk Wollherr , Marion Leibold

Stochastic Gradient Descent (SGD) is an important algorithm in machine learning. With constant learning rates, it is a stochastic process that, after an initial phase of convergence, generates samples from a stationary distribution. We show…

Machine Learning · Statistics 2017-09-12 Stephan Mandt , Matthew D. Hoffman , David M. Blei

This paper studies the super-twisting algorithm (STA) for adaptive sliding mode design. The proposed method tunes the two gains of STA on line simultaneously such that a second order sliding mode can take place with small rectifying gains.…

Systems and Control · Computer Science 2018-05-22 Xiaogang Xiong , Shyam Kamal , Shanhai Jin

Lipschitz one-dimensional constrained global optimization (GO) problems where both the objective function and constraints can be multiextremal and non-differentiable are considered in this paper. Problems, where the constraints are verified…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev , Dmitri E. Kvasov , Falah M. H. Khalaf

In this study, we propose a new method for constructing UCB-type algorithms for stochastic multi-armed bandits based on general convex optimization methods with an inexact oracle. We derive the regret bounds corresponding to the convergence…

Machine Learning · Computer Science 2024-02-13 Yuriy Dorn , Aleksandr Katrutsa , Ilgam Latypov , Andrey Pudovikov

We study the problem of approximately recovering a probability distribution given noisy measurements of its Chebyshev polynomial moments. This problem arises broadly across algorithms, statistics, and machine learning. By leveraging a…

Data Structures and Algorithms · Computer Science 2026-05-20 Cameron Musco , Christopher Musco , Lucas Rosenblatt , Apoorv Vikram Singh

We consider the long-time behavior of an explicit tamed exponential Euler scheme applied to a class of parabolic semilinear stochastic partial differential equations driven by additive noise, under a one-sided Lipschitz continuity…

Numerical Analysis · Mathematics 2020-10-02 Charles-Edouard Bréhier

Convergence of Extremum Seeking (ES) algorithms has been established in the limit of small gains. Using averaging theory and contraction analysis, we propose a framework for computing explicit bounds on the departure of the ES scheme from…

Optimization and Control · Mathematics 2013-03-20 Gabriel Bousquet , Jean-Jacques Slotine

We propose a novel time-splitting scheme for a class of semilinear stochastic evolution equations driven by cylindrical fractional noise. The nonlinearity is decomposed as the sum of a one-sided, non-globally, Lipschitz continuous function,…

Numerical Analysis · Mathematics 2025-12-11 Xiao-Li Ding , Charles-Edouard Bréhier , Dehua Wang

In this paper, we focus on non-asymptotic bounds related to the Euler scheme of an ergodic diffusion with a possibly multiplicative diffusion term (non-constant diffusion coefficient). More precisely, the objective of this paper is to…

Probability · Mathematics 2022-09-23 Gilles Pages , Fabien Panloup

The goal of ordinal embedding is to represent items as points in a low-dimensional Euclidean space given a set of constraints in the form of distance comparisons like "item $i$ is closer to item $j$ than item $k$". Ordinal constraints like…

Machine Learning · Statistics 2016-06-24 Lalit Jain , Kevin Jamieson , Robert Nowak

A method of analyzing time bounds for randomized distributed algorithms is presented, in the context of a new and general framework for describing and reasoning about randomized algorithms. The method consists of proving auxiliary…

Combinatorics · Mathematics 2016-09-06 Nancy Lynch , Isaac Saias , Roberto Segala

Deterministic timed automata are strictly less expressive than their non-deterministic counterparts, which are again less expressive than those with silent transitions. As a consequence, timed automata are in general non-determinizable.…

Formal Languages and Automata Theory · Computer Science 2015-08-17 Florian Lorber , Amnon Rosenmann , Dejan Nickovic , Bernhard Aichernig

An explicit first-order drift-randomized Milstein scheme for a regime switching stochastic differential equation is proposed and its bi-stability and rate of strong convergence are investigated for a non-differentiable drift coefficient.…

Probability · Mathematics 2025-03-11 Divyanshu Vashistha , Chaman Kumar

Gradient-descent based iterative algorithms pervade a variety of problems in estimation, prediction, learning, control, and optimization. Recently iterative algorithms based on higher-order information have been explored in an attempt to…

Machine Learning · Computer Science 2021-03-25 Spencer McDonald , Yingnan Cui , Joseph E. Gaudio , Anuradha M. Annaswamy

We study the learnability of linear separators in $\Re^d$ in the presence of bounded (a.k.a Massart) noise. This is a realistic generalization of the random classification noise model, where the adversary can flip each example $x$ with…

Machine Learning · Computer Science 2015-03-13 Pranjal Awasthi , Maria-Florina Balcan , Nika Haghtalab , Ruth Urner

Stochastic optimization via Stochastic Gradient Descent (SGD) is a fundamental problem in statistics and optimization. This paper revisits Stochastic Gradient Descent (SGD) for strongly convex objectives, establishing tight, uniform-in-time…

Optimization and Control · Mathematics 2026-03-19 Kang Chen , Yasong Feng , Tianyu Wang

The prescribed-time stabilization problem for a general class of nonlinear systems with unknown input gain and appended dynamics (with unmeasured state) is addressed. Unlike the asymptotic stabilization problem, the prescribed-time…

Optimization and Control · Mathematics 2021-08-10 Prashanth Krishnamurthy , Farshad Khorrami

We study the problem of non-stationary Lipschitz bandits, where the number of actions is infinite and the reward function, satisfying a Lipschitz assumption, can change arbitrarily over time. We design an algorithm that adaptively tracks…

Machine Learning · Statistics 2025-10-23 Nicolas Nguyen , Solenne Gaucher , Claire Vernade

In this paper, we prove convergence rates for time discretisation schemes for semi-linear stochastic evolution equations with additive or multiplicative Gaussian noise, where the leading operator $A$ is the generator of a strongly…

Numerical Analysis · Mathematics 2024-12-19 Katharina Klioba , Mark Veraar