English
Related papers

Related papers: Discrete-Time Maximum Likelihood Neural Distributi…

200 papers

The non-smooth finite-sum minimization is a fundamental problem in machine learning. This paper develops a distributed stochastic proximal-gradient algorithm with random reshuffling to solve the finite-sum minimization over time-varying…

Optimization and Control · Mathematics 2022-10-11 Xia Jiang , Xianlin Zeng , Jian Sun , Jie Chen , Lihua Xie

This paper proposes a data-driven framework to solve time-varying optimization problems associated with unknown linear dynamical systems. Making online control decisions to regulate a dynamical system to the solution of an optimization…

Optimization and Control · Mathematics 2021-09-08 Gianluca Bianchin , Miguel Vaquero , Jorge Cortes , Emiliano Dall'Anese

In this paper we deal with stochastic optimization problems where the data distributions change in response to the decision variables. Traditionally, the study of optimization problems with decision-dependent distributions has assumed…

Optimization and Control · Mathematics 2023-10-05 Zifan Wang , Changxin Liu , Thomas Parisini , Michael M. Zavlanos , Karl H. Johansson

Stochastic and (distributionally) robust optimization problems often become computationally challenging as the number of scenarios or data points increases. Scenario reduction is therefore a key technique for improving tractability. We…

Optimization and Control · Mathematics 2026-03-10 Kevin-Martin Aigner , Sebastian Denzler , Frauke Liers , Sebastian Pokutta , Kartikey Sharma

Diffusion on complex networks is often modeled as a stochastic process. Yet, recent work on strategic diffusion emphasizes the decision power of agents and treats diffusion as a strategic problem. Here we study the computational aspects of…

Computational Complexity · Computer Science 2020-01-31 Marcin Waniek , Khaled Elbassioni , Flavio L. Pinheiro , Cesar A. Hidalgo , Aamena Alshamsi

Distributionally robust optimization (DRO) studies decision problems under uncertainty where the probability distribution governing the uncertain problem parameters is itself uncertain. A key component of any DRO model is its ambiguity set,…

Optimization and Control · Mathematics 2025-05-28 Daniel Kuhn , Soroosh Shafiee , Wolfram Wiesemann

Mathematical theory of selection is developed within the frameworks of general models of inhomogeneous populations with continuous time. Methods that allow us to study the distribution dynamics under natural selection and to construct…

Populations and Evolution · Quantitative Biology 2009-12-22 Georgy P. Karev

The paper is devoted to deriving necessary optimality conditions in a general optimal control problem for dynamical systems governed by controlled sweeping processes with hard-constrained control actions entering both polyhedral moving sets…

Optimization and Control · Mathematics 2021-03-17 Tan H. Cao , Giovanni Colombo , Boris S. Mordukhovich , Dao Nguyen

Distributed training in deep learning (DL) is common practice as data and models grow. The current practice for distributed training of deep neural networks faces the challenges of communication bottlenecks when operating at scale, and…

Machine Learning · Computer Science 2020-12-21 Shubhankar Gahlot , Junqi Yin , Mallikarjun Shankar

Nonlinear optimization-based control policies, such as those those arising in nonlinear Model Predictive Control, have seen remarkable success in recent years. These policies require solving computationally demanding nonlinear optimization…

Optimization and Control · Mathematics 2025-12-02 Riccardo Zuliani , Efe C. Balta , John Lygeros

Many real-world decision-making problems face the off-dynamics challenge: the agent learns a policy in a source domain and deploys it in a target domain with different state transitions. The distributionally robust Markov decision process…

Machine Learning · Computer Science 2025-05-26 Zhishuai Liu , Pan Xu

Trajectory optimization and model predictive control are essential techniques underpinning advanced robotic applications, ranging from autonomous driving to full-body humanoid control. State-of-the-art algorithms have focused on data-driven…

Systems and Control · Electrical Eng. & Systems 2021-11-15 Hany Abdulsamad , Tim Dorau , Boris Belousov , Jia-Jie Zhu , Jan Peters

This paper proposes a model predictive controller for discrete-time linear systems with additive, possibly unbounded, stochastic disturbances and subject to chance constraints. By computing a polytopic probabilistic positively invariant set…

Optimization and Control · Mathematics 2024-09-23 Kai Wang , Kiet Tuan Hoang , Sébastien Gros

Attempts from different disciplines to provide a fundamental understanding of deep learning have advanced rapidly in recent years, yet a unified framework remains relatively limited. In this article, we provide one possible way to align…

Machine Learning · Computer Science 2019-10-01 Guan-Horng Liu , Evangelos A. Theodorou

This paper proposes an accelerated consensus-based distributed iterative algorithm for resource allocation and scheduling. The proposed gradient-tracking algorithm introduces an auxiliary variable to add momentum towards the optimal state.…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Mohammadreza Doostmohammadian , Zulfiya R. Gabidullina , Hamid R. Rabiee

The distributionally robust Markov Decision Process (MDP) approach asks for a distributionally robust policy that achieves the maximal expected total reward under the most adversarial distribution of uncertain parameters. In this paper, we…

Systems and Control · Computer Science 2018-10-10 Zhi Chen , Pengqian Yu , William B. Haskell

In this work, we consider the problem of steering the first two moments of the uncertain state of an unknown discrete-time stochastic nonlinear system to a given terminal distribution in finite time. Toward that goal, first, a…

Optimization and Control · Mathematics 2021-04-05 Alexandros Tsolovikos , Efstathios Bakolas

The optimal control of a mechanical system is of crucial importance in many realms. Typical examples are the determination of a time-minimal path in vehicle dynamics, a minimal energy trajectory in space mission design, or optimal motion…

Optimization and Control · Mathematics 2008-10-09 S. Ober-Bloebaum , O. Junge , J. E. Marsden

We study the problem of distribution shift generally arising in machine-learning augmented hybrid simulation, where parts of simulation algorithms are replaced by data-driven surrogates. We first establish a mathematical framework to…

Numerical Analysis · Mathematics 2025-06-17 Jiaxi Zhao , Qianxiao Li

Recently, there has been a growing interest in distributionally robust optimization (DRO) as a principled approach to data-driven decision making. In this paper, we consider a distributionally robust two-stage stochastic optimization…

Optimization and Control · Mathematics 2020-12-07 Zhe Zhang , Shabbir Ahmed , Guanghui Lan