English
Related papers

Related papers: Optimal control in Markov decision processes via d…

200 papers

In this brief, we consider the constrained optimization problem underpinning model predictive control (MPC). We show that this problem can be decomposed into an unconstrained optimization problem with the same cost function as the original…

Optimization and Control · Mathematics 2020-08-18 Uroš Kalabić , Ilya Kolmanovsky

In systems of programmable matter, we are given a collection of simple computation elements (or particles) with limited (constant-size) memory. We are interested in when they can self-organize to solve system-wide problems of movement,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-27 Sarah Cannon , Joshua J. Daymude , Dana Randall , Andréa W. Richa

We consider stochastic optimal control of linear dynamical systems with additive non-Gaussian disturbance. We propose a novel, sampling-free approach, based on Fourier transformations and convex optimization, to cast the stochastic optimal…

Optimization and Control · Mathematics 2020-10-06 Vignesh Sivaramakrishnan , Abraham P. Vinod , Meeko M. K. Oishi

This paper studies the approximation of optimal control policies by quantized (discretized) policies for a very general class of Markov decision processes (MDPs). The problem is motivated by applications in networked control systems,…

Optimization and Control · Mathematics 2015-05-14 Naci Saldi , Serdar Yüksel , Tamás Linder

We propose a general framework for creating parameterized control schemes for decentralized multi-robot systems. A variety of tasks can be seen in the decentralized multi-robot literature, each with many possible control schemes. For…

Robotics · Computer Science 2022-03-24 Stephen Jacobs , R. Michael Butts , Yu Gu , Ali Baheri , Guilherme A. S. Pereira

This paper develops a controller synthesis method for distributed LQG control problems under output-feedback. We consider a system consisting of three interconnected linear subsystems with a delayed information sharing structure. While the…

Systems and Control · Computer Science 2013-09-18 Hamid Reza Feyzmahdavian , Ather Gattami , Mikael Johansson

Discrete-time stochastic systems are an essential modelling tool for many engineering systems. We consider stochastic control systems that are evolving over continuous spaces. For this class of models, methods for the formal verification…

Systems and Control · Computer Science 2018-11-29 Sofie Haesaert , Sadegh Soudjani

Load management is being recognized as an important option for active user participation in the energy market. Traditional load management methods usually require a centralized powerful control center and a two-way communication network…

Signal Processing · Electrical Eng. & Systems 2018-05-09 Wei Zhang , Yinliang Xu , Sisi Li , MengChu Zhou , Wenxin Liu , Ying Xu

This paper is concerned with the linear quadratic (LQ) optimal control of continuous-time system with terminal state constraint. In particular, multiple agents exist in the system which can only access partial information of the matrix…

Optimization and Control · Mathematics 2025-10-21 Wenjing Yang , Zhaorong Zhang , Juanjuan Xu

In this paper we consider a general, challenging distributed optimization set-up arising in several important network control applications. Agents of a network want to minimize the sum of local cost functions, each one depending on a local…

Systems and Control · Computer Science 2018-06-15 Ivano Notarnicola , Giuseppe Notarstefano

We solve a linear quadratic optimal control problem for sampled-data systems with stochastic delays. The delays are stochastically determined by the last few delays. The proposed optimal controller can be efficiently computed by iteratively…

Optimization and Control · Mathematics 2018-05-18 Masashi Wakaiki , Masaki Ogura , Joao P. Hespanha

We study distributed optimization in a cooperative multi-agent setting, where agents have to agree on the usage of shared resources and can communicate via a time-varying network to this purpose. Each agent has its own decision variables…

Optimization and Control · Mathematics 2017-04-20 Alessandro Falsone , Kostas Margellos , Simone Garatti , Maria Prandini

Inspired by biological swarms, robotic swarms are envisioned to solve real-world problems that are difficult for individual agents. Biological swarms can achieve collective intelligence based on local interactions and simple rules; however,…

Robotics · Computer Science 2017-09-21 Qiyang Li , Xintong Du , Yizhou Huang , Quinlan Sykora , Angela P. Schoellig

We consider the distributed control synthesis problem for systems with locks. The goal is to find local controllers so that the global system does not deadlock. With no restriction this problem is undecidable even for three processes each…

Logic in Computer Science · Computer Science 2025-09-10 Hugo Gimbert , Corto Mascle , Anca Muscholl , Igor Walukiewicz

Filtering---estimating the state of a partially observable Markov process from a sequence of observations---is one of the most widely studied problems in control theory, AI, and computational statistics. Exact computation of the posterior…

Artificial Intelligence · Computer Science 2013-01-07 Bhaskara Marthi , Hanna Pasula , Stuart Russell , Yuval Peres

Motivated by the post-disaster distribution system restoration problem, in this paper, we study the problem of synthesizing the optimal policy for a Markov Decision Process (MDP) from a sequence of goal sets. For each goal set, our aim is…

Systems and Control · Electrical Eng. & Systems 2024-04-09 İlker Işık , Onur Yigit Arpali , Ebru Aydin Gol

We study the problem of controlling multi-agent systems under a set of signal temporal logic tasks. Signal temporal logic is a formalism that is used to express time and space constraints for dynamical systems. Recent methods to solve the…

Systems and Control · Electrical Eng. & Systems 2020-11-26 Lars Lindemann , Dimos V. Dimarogonas

Real-time visual analysis tasks, like tracking and recognition, require swift execution of computationally intensive algorithms. Visual sensor networks can be enabled to perform such tasks by augmenting the sensor network with processing…

Computer Vision and Pattern Recognition · Computer Science 2017-05-24 Emil Eriksson , György Dán , Viktoria Fodor

We introduce the concept of structured synthesis for Markov decision processes where the structure is induced from finitely many pre-specified options for a system configuration. The resulting synthesis problem is in general a nonlinear…

Software Engineering · Computer Science 2018-07-18 Nils Jansen , Laura Humphrey , Jana Tumova , Ufuk Topcu

This paper presents a method to approximately solve stochastic optimal control problems in which the cost function and the system dynamics are polynomial. For stochastic systems with polynomial dynamics, the moments of the state can be…

Optimization and Control · Mathematics 2017-02-24 Andrew Lamperski , Khem Raj Ghusinga , Abhyudai Singh