English
Related papers

Related papers: Generalized Multi-Constraint Extremum Seeking

200 papers

The EM (Expectation-Maximization) algorithm is regarded as an MM (Majorization-Minimization) algorithm for maximum likelihood estimation of statistical models. Expanding this view, this paper demonstrates that by choosing an appropriate…

Optimization and Control · Mathematics 2026-02-12 Kensuke Asai , Jun-ya Gotoh

In this work we introduce the concept of an Underestimate Sequence (UES), which is motivated by Nesterov's estimate sequence. Our definition of a UES utilizes three sequences, one of which is a lower bound (or under-estimator) of the…

Optimization and Control · Mathematics 2021-02-16 Majid Jahani , Naga Venkata C. Gudapati , Chenxin Ma , Rachael Tappenden , Martin Takáč

This paper investigates multivariable extremum seeking using unit-vector control. By employing the gradient algorithm and a polytopic embedding of the unknown Hessian matrix, we establish sufficient conditions, expressed as linear matrix…

Optimization and Control · Mathematics 2025-04-11 Enzo Ferreira Tomaz Silva , Pedro Henrique Silva Coutinho , Tiago Roux Oliveira , Miroslav Krstić

This paper proposes a new algorithm for solving constrained global optimization problems where both the objective function and constraints are one-dimensional non-differentiable multiextremal Lipschitz functions. Multiextremal constraints…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev

Control-affine Extremum Seeking Control (ESC) systems have been increasingly studied and applied in the last decade. In a recent effort, many control-affine ESC structures have been generalized in a unifying class and their stability was…

Optimization and Control · Mathematics 2023-05-02 Sameer Pokhrel , Sameh A. Eisa

We study the problem of global extremum seeking in the presence of local extrema. We investigate two different perturbation-based methods: 1) a well-known classical extremum seeking scheme for steady-state output optimization, and 2) a…

Optimization and Control · Mathematics 2026-03-04 Raik Suttner , Christian Ebenbauer , Sergey Dashkovskiy

We present multivariable extremum seeking (ES) designs that achieve unbiased convergence to the optimum. Two designs are introduced: one with exponential unbiased convergence (unbiased extremum seeker, uES) and the other with…

Optimization and Control · Mathematics 2024-01-02 Cemal Tugrul Yilmaz , Mamadou Diagne , Miroslav Krstic

The Expectation--Maximization (EM) algorithm is a simple meta-algorithm that has been used for many years as a methodology for statistical inference when there are missing measurements in the observed data or when the data is composed of…

Machine Learning · Statistics 2022-11-15 Hideitsu Hino , Shotaro Akaho , Noboru Murata

A recently introduced general-purpose heuristic for finding high-quality solutions for many hard optimization problems is reviewed. The method is inspired by recent progress in understanding far-from-equilibrium phenomena in terms of {\em…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Stefan Boettcher , Allon G. Percus

The paper deals with the extremum seeking problem for a class of cost functions depending only on a part of state variables of a control system. This problem is related to the concept of partial asymptotic stability and analyzed by…

Optimization and Control · Mathematics 2020-02-07 Victoria Grushkovskaya , Alexander Zuyev

In this paper, we describe a broad class of control functions for extremum seeking problems. We show that it unifies and generalizes existing extremum seeking strategies which are based on Lie bracket approximations, and allows to design…

Optimization and Control · Mathematics 2019-02-08 Victoria Grushkovskaya , Alexander Zuyev , Christian Ebenbauer

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

Optimization and Control · Mathematics 2013-10-03 Victor Picheny

This paper discusses the design of an extremum seeking controller that relies on a monitoring function for a class of SISO uncertain nonlinear systems characterized by arbitrary and uncertain relative degree. Our demonstration illustrates…

Optimization and Control · Mathematics 2024-05-28 Nerito Oliveira Aminde , Tiago Roux Oliveira , Liu Hsu

The EM algorithm is a generic tool that offers maximum likelihood solutions when datasets are incomplete with data values missing at random or completely at random. At least for its simplest form, the algorithm can be rewritten in terms of…

Methodology · Statistics 2025-09-25 Daniel A. Griffith

We propose a new design strategy for extremum seeking control for a multi-dimensional single-integrator system in the presence of local extrema. The proposed method employs suitably designed sinusoidal dither signals, which force the…

Optimization and Control · Mathematics 2026-03-03 Raik Suttner , Christian Ebenbauer , Sergey Dashkovskiy

This paper proposes a novel distributed optimization framework that addresses time-varying optimization problems without requiring explicit derivative information of the objective functions. Traditional distributed methods often rely on…

Optimization and Control · Mathematics 2025-09-29 Xuebin Li , Xuefei Yang , Emilia Fridman , Mamadou Diagne , Jiebao Sun

We propose a new family of fairness definitions for classification problems that combine some of the best properties of both statistical and individual notions of fairness. We posit not only a distribution over individuals, but also a…

Machine Learning · Computer Science 2019-12-18 Michael Kearns , Aaron Roth , Saeed Sharifi-Malvajerdi

Extremum seeking feedback is a powerful method to steer a dynamical system to an extremum of a partially or completely unknown map. It often requires advanced system-theoretic tools to understand the qualitative behavior of extremum seeking…

Dynamical Systems · Mathematics 2012-12-07 Hans-Bernd Dürr , Miloš S. Stanković , Christian Ebenbauer , Karl H. Johansson

Reinforcement learning for control over continuous spaces typically uses high-entropy stochastic policies, such as Gaussian distributions, for local exploration and estimating policy gradient to optimize performance. Many robotic control…

Machine Learning · Computer Science 2024-04-03 Ya-Chien Chang , Sicun Gao

The paper deals with a well-known extremum seeking scheme by proving uniformity properties with respect to the amplitudes of the dither signal and of the cost function. Those properties are then used to show that the scheme guarantees the…

Optimization and Control · Mathematics 2022-06-07 Nicola Mimmo , Lorenzo Marconi , Giuseppe Notarstefano