English
Related papers

Related papers: A Strong Duality Result for Constrained POMDPs wit…

200 papers

We consider nonlinear model predictive control (MPC) with multiple competing cost functions. In each step of the scheme, a multiobjective optimal control problem with a nonlinear system and terminal conditions is solved. We propose an…

Optimization and Control · Mathematics 2022-07-01 Gabriele Eichfelder , Lars Grüne , Lisa Krügel , Jonas Schießl

In this paper we consider infinite horizon discounted dynamic programming problems with finite state and control spaces, partial state observations, and a multiagent structure. We discuss and compare algorithms that simultaneously or…

Robotics · Computer Science 2020-11-10 Sushmita Bhattacharya , Siva Kailas , Sahil Badyal , Stephanie Gil , Dimitri Bertsekas

The paper is dedicated to the study of strong duality for a problem of linear copositive programming. Based on the recently introduced concept of the set of normalized immobile indices, an extended dual problem is deduced. The dual problem…

Optimization and Control · Mathematics 2020-04-24 Olga Kostyukova , Tatiana Tchemisova

This paper considers the estimation of Shannon entropy for discrete distributions with countably infinite support. While minimax rates for finite-support distributions are established, infinite-support distributions present distinct…

Statistics Theory · Mathematics 2025-12-03 Octavio César Mesner

This paper aims to address distributed optimization problems over directed and time-varying networks, where the global objective function consists of a sum of locally accessible convex objective functions subject to a feasible set…

Optimization and Control · Mathematics 2020-07-14 Xiuxian Li , Gang Feng , Lihua Xie

We develop a dual-control method for approximating investment strategies in incomplete environments that emerge from the presence of trading constraints. Convex duality enables the approximate technology to generate lower and upper bounds…

Mathematical Finance · Quantitative Finance 2019-10-29 Thijs Kamma , Antoon Pelsser

We investigate the distributed multi-agent sharing optimization problem in a directed graph, with a composite objective function consisting of a smooth function plus a convex (possibly non-smooth) function shared by all agents. While…

Optimization and Control · Mathematics 2024-06-21 Sajad Zandi , Mehdi Korki

This work proposes a decision-making framework for partially observable systems in continuous time with discrete state and action spaces. As optimal decision-making becomes intractable for large state spaces we employ approximation methods…

Machine Learning · Computer Science 2024-03-01 Yannick Eich , Bastian Alt , Heinz Koeppl

Decentralized partially observable Markov decision processes (Dec-POMDPs) are rich models for cooperative decision-making under uncertainty, but are often intractable to solve optimally (NEXP-complete). The transition and observation…

Artificial Intelligence · Computer Science 2012-10-19 Jilles S. Dibangoye , Christopher Amato , Arnoud Doniec

Geometric duality theory for multiple objective linear programming problems turned out to be very useful for the development of efficient algorithms to generate or approximate the whole set of nondominated points in the outcome space. This…

Optimization and Control · Mathematics 2011-09-19 Frank Heyde

We establish a rigorous duality theory, under No Unbounded Profit with Bounded Risk, for an infinite horizon problem of optimal consumption in the presence of an income stream that can terminate randomly at an exponentially distributed…

Mathematical Finance · Quantitative Finance 2021-11-30 Ashley Davey , Michael Monoyios , Harry Zheng

This paper is devoted to studying constrained continuous-time Markov decision processes (MDPs) in the class of randomized policies depending on state histories. The transition rates may be unbounded, the reward and costs are admitted to be…

Probability · Mathematics 2012-01-04 Xianping Guo , Xinyuan Song

A standard objective in partially-observable Markov decision processes (POMDPs) is to find a policy that maximizes the expected discounted-sum payoff. However, such policies may still permit unlikely but highly undesirable outcomes, which…

Artificial Intelligence · Computer Science 2017-01-31 Krishnendu Chatterjee , Petr Novotný , Guillermo A. Pérez , Jean-François Raskin , Đorđe Žikelić

This paper studies the approximation of optimal control policies by quantized (discretized) policies for a very general class of Markov decision processes (MDPs). The problem is motivated by applications in networked control systems,…

Optimization and Control · Mathematics 2015-05-14 Naci Saldi , Serdar Yüksel , Tamás Linder

We show that, in many settings, the worst-case performance of a distributed optimization algorithm is independent of the number of agents in the system, and can thus be computed in the fundamental case with just two agents. This result…

Optimization and Control · Mathematics 2025-11-03 Sebastien Colla , Julien M. Hendrickx

This article investigates a distributed aggregative optimization problem subject to coupled affine inequality constraints, in which local objective functions depend not only on their own decision variables but also on an aggregation of all…

Optimization and Control · Mathematics 2023-06-13 Kaixin Du , Min Meng

In optimization the duality gap between the primal and the dual problems is a measure of the suboptimality of any primal-dual point. In classical mechanics the equations of motion of a system can be derived from the Hamiltonian function,…

Optimization and Control · Mathematics 2019-11-19 Brendan O'Donoghue , Chris J. Maddison

A finite-horizon optimal estimation problem for discrete-time linear systems is formulated and solved. The formulation is a natural extension of that which yields a deadbeat observer. The resultant observer is the dual of the controller…

Dynamical Systems · Mathematics 2013-07-08 S. Emre Tuna

A dual control problem is presented for the optimal stochastic control of a system governed by partial differential equations. Relationships between the optimal values of the original and the dual problems are investigated and two duality…

Optimization and Control · Mathematics 2017-05-03 Shinji Tanimoto

We study the presence of abelian discrete symmetries in globally consistent orientifold compactifications based on rational conformal field theory. We extend previous work [1] by allowing the discrete symmetries to be a linear combination…

High Energy Physics - Theory · Physics 2015-02-11 Pascal Anastasopoulos , Robert Richter , A. N. Schellekens