English
Related papers

Related papers: Optimal steering to invariant distributions for ne…

200 papers

We tackle a nonlinear optimal control problem for a stochastic differential equation in Euclidean space and its state-linear counterpart for the Fokker-Planck-Kolmogorov equation in the space of probabilities. Our approach is founded on a…

Optimization and Control · Mathematics 2024-09-23 Roman Chertovskih , Nikolay Pogodaev , Maxim Staritsyn , A. Pedro Aguiar

Consider longitudinal networks whose edges turn on and off according to a discrete-time Markov chain with exponential-family transition probabilities. We characterize when their joint distributions are also exponential families with the…

Methodology · Statistics 2024-03-12 William K. Schwartz , Sonja Petrović , Hemanshu Kaul

Diffusion on complex networks is often modeled as a stochastic process. Yet, recent work on strategic diffusion emphasizes the decision power of agents and treats diffusion as a strategic problem. Here we study the computational aspects of…

Computational Complexity · Computer Science 2020-01-31 Marcin Waniek , Khaled Elbassioni , Flavio L. Pinheiro , Cesar A. Hidalgo , Aamena Alshamsi

We study the limit behaviour of a generally non-linear ordinary differential equation whose solution is a superadditive generalisation of a stochastic matrix, and provide necessary and sufficient conditions for this solution to be ergodic,…

Probability · Mathematics 2016-09-21 Jasper De Bock

Replacing positivity constraints by an entropy barrier is popular to approximate solutions of linear programs. In the special case of the optimal transport problem, this technique dates back to the early work of Schr\"odinger. This approach…

Analysis of PDEs · Mathematics 2017-01-10 Guillaume Carlier , Vincent Duval , Gabriel Peyré , Bernhard Schmitzer

We propose as a generalization of an idea of Ruelle to describe turbulent fluid flow a chaotic hypothesis for reversible dissipative many particle systems in nonequilibrium stationary states in general. This implies an extension of the…

chao-dyn · Physics 2009-10-28 G. Gallavotti , E. G. D. Cohen

Series of univariate distributions indexed by equally spaced time points are ubiquitous in applications and their analysis constitutes one of the challenges of the emerging field of distributional data analysis. To quantify such…

Methodology · Statistics 2023-05-23 Changbo Zhu , Hans-Georg Müller

In this paper, we establish a general stochastic maximum principle for optimal control for systems described by a continuous-time Markov regime-switching stochastic recursive utilities model. The control domain is postulated not to be…

Optimization and Control · Mathematics 2019-05-02 Liangquan Zhang , Xun Li

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower

There are well-established connections between combinatorial optimization, optimal transport theory and Hydrodynamics, through the linear assignment problem in combinatorics, the Monge-Kantorovich problem in optimal transport theory and the…

Analysis of PDEs · Mathematics 2014-10-02 Yann Brenier

We consider the problem of approximating the stationary distribution of an ergodic Markov chain given a set of sampled transitions. Classical simulation-based approaches assume access to the underlying process so that trajectories of…

Machine Learning · Computer Science 2020-03-03 Junfeng Wen , Bo Dai , Lihong Li , Dale Schuurmans

In this paper, we study the optimal control problem for steering the state covariance of a discrete-time linear stochastic system over a finite time horizon. First, we establish the existence and uniqueness of the optimal control law for a…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Fengjiao Liu , George Rapakoulias , Panagiotis Tsiotras

In this work we are interested in the modelling and control of opinion dynamics spreading on a time evolving network with scale-free asymptotic degree distribution. The mathematical model is formulated as a coupling of an opinion alignment…

Optimization and Control · Mathematics 2015-11-03 Giacomo Albi , Lorenzo Pareschi , Mattia Zanella

We consider a class of optimal control problems for measure-valued nonlinear transport equations describing traffic flow problems on networks. The objective isto minimise/maximise macroscopic quantities, such as traffic volume or average…

Optimization and Control · Mathematics 2019-11-11 Simone Cacace , Fabio Camilli , Raul De Maio , Andrea Tosin

We show how to map the states of an ergodic Markov chain to Euclidean space so that the squared distance between states is the expected commuting time. We find a minimax characterization of commuting times, and from this we get monotonicity…

Probability · Mathematics 2017-10-27 Peter G. Doyle , Jean Steiner

We consider ergodic backward stochastic differential equations in a discrete time setting, where noise is generated by a finite state Markov chain. We show existence and uniqueness of solutions, along with a comparison theorem. To obtain…

Probability · Mathematics 2015-09-02 Andrew L. Allan , Samuel N. Cohen

We consider the problem of steering a linear stochastic system between two end-point degenerate Gaussian distributions in finite time. This accounts for those situations in which some but not all of the state entries are uncertain at the…

Optimization and Control · Mathematics 2020-06-18 Valentina Ciccone , Yongxin Chen , Tryphon T. Georgiou , Michele Pavon

We propose a new framework to estimate the evolution of an ensemble of indistinguishable agents on a hidden Markov chain using only aggregate output data. This work can be viewed as an extension of the recent developments in optimal mass…

Optimization and Control · Mathematics 2021-07-01 Isabel Haasler , Axel Ringh , Yongxin Chen , Johan Karlsson

The equilibrium distributions of a Markovian model describing the interaction of several classes of permanent connections in a network are analyzed. It has been introduced by Graham and Robert. For this model each of the connections has a…

Networking and Internet Architecture · Computer Science 2015-05-13 Carl Graham , Philippe Robert , Maaike Verloop

In sustained growth with random dynamics stationary distributions can exist without detailed balance. This suggests thermodynamical behavior in fast growing complex systems. In order to model such phenomena we apply both a discrete and a…

Statistical Mechanics · Physics 2017-03-22 Tamás Biró , Zoltán Néda