English
Related papers

Related papers: Exponential Convergence and stability of Howards's…

200 papers

Driven by the need to solve increasingly complex optimization problems in signal processing and machine learning, there has been increasing interest in understanding the behavior of gradient-descent algorithms in non-convex environments.…

Optimization and Control · Mathematics 2019-07-04 Stefan Vlaski , Ali H. Sayed

We study optimal control of diffusions with slow and fast variables and address a question raised by practitioners: is it possible to first eliminate the fast variables before solving the optimal control problem and then use the optimal…

Optimization and Control · Mathematics 2014-06-16 Wei Zhang , Juan C. Latorre , Grigorios A. Pavliotis , Carsten Hartmann

Considering generating samples with high rewards, we focus on optimizing deep neural networks parameterized stochastic differential equations (SDEs), the advanced generative models with high expressiveness, with policy gradient, the leading…

Machine Learning · Computer Science 2024-06-27 Xiangxin Zhou , Liang Wang , Yichi Zhou

We apply diffusion strategies to develop a fully-distributed cooperative reinforcement learning algorithm in which agents in a network communicate only with their immediate neighbors to improve predictions about their environment. The…

Multiagent Systems · Computer Science 2014-11-06 Sergio Valcarcel Macua , Jianshu Chen , Santiago Zazo , Ali H. Sayed

Time-varying stochastic optimization problems frequently arise in machine learning practice (e.g. gradual domain shift, object tracking, strategic classification). Although most problems are solved in discrete time, the underlying process…

Machine Learning · Computer Science 2023-02-24 Subha Maity , Debarghya Mukherjee , Moulinath Banerjee , Yuekai Sun

Exploiting a fluid dynamic formulation for which a probabilistic counterpart might not be available, we extend the theory of Schroedinger bridges to the case of inertial particles with losses and general, possibly singular diffusion…

Mathematical Physics · Physics 2014-10-08 Yongxin Chen , Tryphon T. Georgiou , Michele Pavon

In this paper we deal with stochastic optimization problems where the data distributions change in response to the decision variables. Traditionally, the study of optimization problems with decision-dependent distributions has assumed…

Optimization and Control · Mathematics 2023-10-05 Zifan Wang , Changxin Liu , Thomas Parisini , Michael M. Zavlanos , Karl H. Johansson

We present a methodology for obtaining explicit solutions to infinite time horizon optimal stopping problems involving general, one-dimensional, It\^o diffusions, payoff functions that need not be smooth and state-dependent discounting.…

Computational Finance · Quantitative Finance 2012-10-10 Timothy C. Johnson

Time plays an essential role in the diffusion of information, influence and disease over networks. In many cases we only observe when a node copies information, makes a decision or becomes infected -- but the connectivity, transmission…

Social and Information Networks · Computer Science 2011-05-05 Manuel Gomez Rodriguez , David Balduzzi , Bernhard Schölkopf

The distributed optimization problem is set up in a collection of nodes interconnected via a communication network. The goal is to find the minimizer of a global objective function formed by the addition of partial functions locally known…

Optimization and Control · Mathematics 2022-06-07 Damián Marelli , Yong Xu , Minyue Fu , Zenghong Huang

Robust imitation learning using disturbance injections overcomes issues of limited variation in demonstrations. However, these methods assume demonstrations are optimal, and that policy stabilization can be learned via simple augmentations.…

Robotics · Computer Science 2022-05-10 Hirotaka Tahara , Hikaru Sasaki , Hanbit Oh , Brendan Michael , Takamitsu Matsubara

We study the problem of robust influence maximization in dynamic diffusion networks. In line with recent works, we consider the scenario where the network can undergo insertion and removal of nodes and edges, in discrete time steps, and the…

Databases · Computer Science 2024-12-17 Arkaprava Saha , Bogdan Cautis , Xiaokui Xiao , Laks V. S. Lakshmanan

We introduce the first direct policy search algorithm which provably converges to the globally optimal $\textit{dynamic}$ filter for the classical problem of predicting the outputs of a linear dynamical system, given noisy, partial…

Optimization and Control · Mathematics 2022-03-01 Jack Umenberger , Max Simchowitz , Juan C. Perdomo , Kaiqing Zhang , Russ Tedrake

In this work, solution of the finite horizon hybrid optimal control problem as the central element of the receding horizon optimal control (model predictive control) is investigated based on the indirect approach. The response of a hybrid…

Systems and Control · Computer Science 2020-09-24 Babak Tavassoli

We propose a novel continuous-time algorithm for inequality-constrained convex optimization inspired by proportional-integral control. Unlike the popular primal-dual gradient dynamics, our method includes a proportional term to control the…

Optimization and Control · Mathematics 2024-09-12 V. Cerone , S. M. Fosson , S. Pirrera , D. Regruto

In the paper, we propose solving optimization problems (OPs) and understanding the Newton method from the optimal control view. We propose a new optimization algorithm based on the optimal control problem (OCP). The algorithm features…

Optimization and Control · Mathematics 2025-04-01 Huanshui Zhang , Hongxia Wang

Motivated by applications in machine learning and statistics, we study distributed optimization problems over a network of processors, where the goal is to optimize a global objective composed of a sum of local functions. In these problems,…

Optimization and Control · Mathematics 2019-05-14 Thinh T. Doan , Carolyn L. Beck , R. Srikant

In this paper, we consider a class of continuous-time, continuous-space stochastic optimal control problems. Building upon recent advances in Markov chain approximation methods and sampling-based algorithms for deterministic path planning,…

Robotics · Computer Science 2012-02-27 Vu Anh Huynh , Sertac Karaman , Emilio Frazzoli

Model-free reinforcement learning attempts to find an optimal control action for an unknown dynamical system by directly searching over the parameter space of controllers. The convergence behavior and statistical properties of these…

Optimization and Control · Mathematics 2021-03-17 Hesameddin Mohammadi , Armin Zare , Mahdi Soltanolkotabi , Mihailo R. Jovanović

Machine learned partial differential equation (PDE) solvers trade the reliability of standard numerical methods for potential gains in accuracy and/or speed. The only way for a solver to guarantee that it outputs the exact solution is to…

Numerical Analysis · Mathematics 2023-03-30 Nick McGreivy , Ammar Hakim