English
Related papers

Related papers: Gradient-Based Stochastic Extremum-Seeking Control…

200 papers

Stochastic coordinate descent algorithms are efficient methods in which each iterate is obtained by fixing most coordinates at their values from the current iteration, and approximately minimizing the objective with respect to the remaining…

Machine Learning · Statistics 2025-04-02 Eméric Gbaguidi

This paper introduces a new proximal stochastic gradient method with variance reduction and stabilization for minimizing the sum of a convex stochastic function and a group sparsity-inducing regularization function. Since the method may be…

Optimization and Control · Mathematics 2023-02-15 Yutong Dai , Guanyi Wang , Frank E. Curtis , Daniel P. Robinson

This paper focuses on time-varying delayed stochastic differential systems with stochastically switching parameters formulated by a unified switching behavior combining a discrete adapted process and a Cox process. Unlike prior studies…

Dynamical Systems · Mathematics 2024-01-30 Xinyu Wu , Zidong Wang , Wenlian Lu

We provide tight finite-time convergence bounds for gradient descent and stochastic gradient descent on quadratic functions, when the gradients are delayed and reflect iterates from $\tau$ rounds ago. First, we show that without stochastic…

Optimization and Control · Mathematics 2018-06-28 Yossi Arjevani , Ohad Shamir , Nathan Srebro

Safety in stochastic control systems, which are subject to random noise with a known probability distribution, aims to compute policies that satisfy predefined operational constraints with high confidence throughout the uncertain evolution…

Systems and Control · Electrical Eng. & Systems 2025-11-12 Saber Omidi , Marek Petrik , Se Young Yoon , Momotaz Begum

Computational multi-scale methods capitalize on a large time-scale separation to efficiently simulate slow dynamics over long time intervals. For stochastic systems, one often aims at resolving the statistics of the slowest dynamics. This…

Numerical Analysis · Mathematics 2021-05-14 Kristian Debrabant , Giovanni Samaey , Przemysław Zieliński

Although input-gradients techniques have evolved to mitigate and tackle the challenges associated with gradients, modern gradient-weighted CAM approaches still rely on vanilla gradients, which are inherently susceptible to the saturation…

Machine Learning · Computer Science 2024-06-27 Vincenzo Buono , Peyman Sheikholharam Mashhadi , Mahmoud Rahat , Prayag Tiwari , Stefan Byttner

Though switched dynamical systems have shown great utility in modeling a variety of physical phenomena, the construction of an optimal control of such systems has proven difficult since it demands some type of optimal mode scheduling. In…

Optimization and Control · Mathematics 2014-02-04 Ramanarayan Vasudevan , Humberto Gonzalez , Ruzena Bajcsy , S. Shankar Sastry

We consider chance-constrained problems with discrete random distribution. We aim for problems with a large number of scenarios. We propose a novel method based on the stochastic gradient descent method which performs updates of the…

Optimization and Control · Mathematics 2019-05-28 Lukáš Adam , Martin Branda

We consider split-step Milstein methods for the solution of stiff stochastic differential equations with an emphasis on systems driven by multi-channel noise. We show their strong order of convergence and investigate mean-square stability…

Numerical Analysis · Mathematics 2014-11-27 V. Reshniak , A. Q. M. Khaliq , D. A. Voss , G. Zhang

Many machine learning applications and tasks rely on the stochastic gradient descent (SGD) algorithm and its variants. Effective step length selection is crucial for the success of these algorithms, which has motivated the development of…

Machine Learning · Computer Science 2023-05-18 Shigeng Sun , Yuchen Xie

The problem of suboptimality under bounded disturbances for the adaptive systems based on speed-graadient approach is discussed. A formulation of the estimated optimality of nonlinear nonlinearly parametrized adaptive control systems is…

Optimization and Control · Mathematics 2025-03-27 Alexander Fradkov

This work provides the first finite-time convergence guarantees for linearly constrained stochastic bilevel optimization using only first-order methods, requiring solely gradient information without any Hessian computations or second-order…

Optimization and Control · Mathematics 2025-11-18 Cac Phan , Kai Wang

(Mini-batch) Stochastic Gradient Descent is a popular optimization method which has been applied to many machine learning applications. But a rather high variance introduced by the stochastic gradient in each step may slow down the…

Machine Learning · Computer Science 2018-10-09 Jingchang Liu , Linli Xu

This study focuses on event-triggered control of nonlinear discrete-time systems with time delays. Based on a Lyapunov-Krasovskii type input-to-state stability result, we propose a novel event-triggered control algorithm that works as…

Optimization and Control · Mathematics 2022-12-16 Kexue Zhang , Elena Braverman , Bahman Gharesifard

The design of reliable indicators to anticipate critical transitions in complex systems is an im portant task in order to detect a coming sudden regime shift and to take action in order to either prevent it or mitigate its consequences. We…

Data Analysis, Statistics and Probability · Physics 2022-12-14 Martin Heßler , Oliver Kamps

This paper aims to introduce a design methodology to stabilize a chain of integrators in a fixed-time with predefined Upper Bound for the Settling-Time (UBST). This approach is based on time-varying gains (time-base generator) that become…

Optimization and Control · Mathematics 2020-04-30 David Gómez-Gutiérrez

We demonstrate that time-delayed feedback control can be improved by adaptively tuning the feedback gain. This adaptive controller is applied to the stabilization of an unstable fixed point and an unstable periodic orbit embedded in a…

Adaptation and Self-Organizing Systems · Physics 2016-08-10 Judith Lehnert , Philipp Hövel , Valentin Flunkert , Peter Yu. Guzenko , Alexander L. Fradkov , Eckehard Schöll

In the present work, sufficient conditions for global stabilization of nonlinear uncertain systems by means of discrete-delay static output feedback are presented. Illustrating examples show the efficiency of the proposed control strategy.

Optimization and Control · Mathematics 2008-02-29 Iasson Karafyllis

We propose a novel feedback controller for a class of uncertain higher-order nonlinear systems, subject to delays in both state measurement and control input signals. Building on the prescribed performance control framework, a…

Optimization and Control · Mathematics 2025-09-11 Thomas Berger , Lampros N. Bikas , Jan Hachmeister , George A. Rovithakis