English
Related papers

Related papers: A Gradient-Based Optimization Method Using the Koo…

200 papers

Learning-based methods have gained attention as general-purpose solvers due to their ability to automatically learn problem-specific heuristics, reducing the need for manually crafted heuristics. However, these methods often face…

Machine Learning · Computer Science 2024-10-03 Yuma Ichikawa , Yamato Arai

Koopman operator theory has been successfully applied to problems from various research areas such as fluid dynamics, molecular dynamics, climate science, engineering, and biology. Applications include detecting metastable or coherent sets,…

Quantum Physics · Physics 2022-07-13 Stefan Klus , Feliks Nüske , Sebastian Peitz

Dynamical systems provide a comprehensive way to study complex and changing behaviors across various sciences. Many modern systems are too complicated to analyze directly or we do not have access to models, driving significant interest in…

Dynamical Systems · Mathematics 2024-07-10 Matthew J. Colbrook , Igor Mezić , Alexei Stepanenko

We propose and analyze an adaptive step-size variant of the Davis-Yin three operator splitting. This method can solve optimization problems composed by a sum of a smooth term for which we have access to its gradient and an arbitrary number…

Optimization and Control · Mathematics 2018-08-02 Fabian Pedregosa , Gauthier Gidel

Distributed optimization enables networked agents to cooperatively solve a global optimization problem even with each participating agent only having access to a local partial view of the objective function. Despite making significant…

Optimization and Control · Mathematics 2022-10-04 Yongqiang Wang , Tamer Başar

In this paper, we study the standard formulation of an optimization problem when the computation of gradient is not available. Such a problem can be classified as a "black box" optimization problem, since the oracle returns only the value…

Optimization and Control · Mathematics 2024-09-30 Aleksandr Lobanov , Nail Bashirov , Alexander Gasnikov

This work is devoted to solving the composite optimization problem with the mixture oracle: for the smooth part of the problem, we have access to the gradient, and for the non-smooth part, only the one-point zero-order oracle is available.…

Optimization and Control · Mathematics 2025-07-23 Aleksandr Beznosikov , Ivan Stepanov , Artyom Voronov , Alexander Gasnikov

In this paper, we propose a conditional gradient method for solving constrained vector optimization problems with respect to a partial order induced by a closed, convex and pointed cone with nonempty interior. When the partial order under…

Optimization and Control · Mathematics 2022-04-12 Wang Chen , Xinmin Yang , Yong Zhao

It seems that in the current age, computers, computation, and data have an increasingly important role to play in scientific research and discovery. This is reflected in part by the rise of machine learning and artificial intelligence,…

Machine Learning · Computer Science 2024-05-15 Ronan Keane

We introduce a practical method for incorporating equality and inequality constraints in global optimization methods based on stochastic interacting particle systems, specifically consensus-based optimization (CBO) and ensemble Kalman…

Optimization and Control · Mathematics 2021-11-05 J. A. Carrillo , C. Totzeck , U. Vaes

We consider the problem of supply and demand balancing that is stated as a minimization problem for the total expected revenue function describing the behavior of both consumers and suppliers. In the considered market model we assume that…

Optimization and Control · Mathematics 2021-06-29 Dmitry Pasechnyuk , Pavel Dvurechensky , Sergey Omelchenko , Alexander Gasnikov

This paper proposes a method to identify a Koopman model of a feedback-controlled system given a known controller. The Koopman operator allows a nonlinear system to be rewritten as an infinite-dimensional linear system by viewing it in…

Systems and Control · Electrical Eng. & Systems 2024-05-13 Steven Dahdah , James Richard Forbes

Recent years have seen rapid advances in the data-driven analysis of dynamical systems based on Koopman operator theory and related approaches. On the other hand, low-rank tensor product approximations -- in particular the tensor train (TT)…

Numerical Analysis · Mathematics 2021-08-11 Feliks Nüske , Patrick Gelß , Stefan Klus , Cecilia Clementi

Gradient-based optimization methods are the most popular choice for finding local optima for classical minimization and saddle point problems. Here, we highlight a systemic issue of gradient dynamics that arise for saddle point problems,…

Machine Learning · Computer Science 2019-02-15 Leonard Adolphs , Hadi Daneshmand , Aurelien Lucchi , Thomas Hofmann

Agent-based models (ABMs) provide an intuitive and powerful framework for studying social dynamics by modeling the interactions of individuals from the perspective of each individual. In addition to simulating and forecasting the dynamics…

Dynamical Systems · Mathematics 2024-02-22 Jan-Hendrik Niemann , Stefan Klus , Nataša Djurdjevac Conrad , Christof Schütte

A majority of methods from dynamical systems analysis, especially those in applied settings, rely on Poincar\'e's geometric picture that focuses on "dynamics of states". While this picture has fueled our field for a century, it has shown…

Dynamical Systems · Mathematics 2013-01-01 Marko Budišić , Ryan M. Mohr , Igor Mezić

Stochastic Gradient (SG) is the defacto iterative technique to solve stochastic optimization (SO) problems with a smooth (non-convex) objective $f$ and a stochastic first-order oracle. SG's attractiveness is due in part to its simplicity of…

Optimization and Control · Mathematics 2024-03-08 David Newton , Raghu Bollapragada , Raghu Pasupathy , Nung Kwan Yip

Representing nonlinear dynamical systems using the Koopman Operator and its spectrum has distinct advantages in terms of linear interpretability of the model as well as in analysis and control synthesis through the use of well-studied…

Systems and Control · Electrical Eng. & Systems 2024-11-26 Shankar A. Deka , Umesh Vaidya

We study the Optimal Control Problem (OCP) for regular linear differential-algebraic systems (DAEs). To this end, we introduce the input index, which allows, on the one hand, to characterize the space of consistent initial values in terms…

Optimization and Control · Mathematics 2022-02-08 Achim Ilchmann , Leslie Leben , Jonas Witschel , Karl Worthmann

System identification based on Koopman operator theory has grown in popularity recently. Spectral properties of the Koopman operator of a system were proven to relate to properties like invariant sets, stability, periodicity, etc. of the…

Optimization and Control · Mathematics 2021-10-27 Nibodh Boddupalli