English
Related papers

Related papers: Multi-objective dynamic programming with limited p…

200 papers

Optimizing the performance of many objectives (instantiated by tasks or clients) jointly with a few Pareto stationary solutions (models) is critical in machine learning. However, previous multi-objective optimization methods often focus on…

Machine Learning · Computer Science 2024-03-08 Ziyue Li , Tian Li , Virginia Smith , Jeff Bilmes , Tianyi Zhou

Decision diagrams (DDs) have emerged as a state-of-the-art method for exact multiobjective integer linear programming. When the DD is too large to fit into memory or the decision-maker prefers a fast approximation to the Pareto frontier,…

Artificial Intelligence · Computer Science 2026-03-20 Rahul Patel , Elias B. Khalil , David Bergman

We consider lexicographic bi-objective problems on Markov Decision Processes (MDPs), where we optimize one objective while guaranteeing optimality of another. We propose a two-stage technique for solving such problems when the objectives…

Computer Science and Game Theory · Computer Science 2023-08-17 Damien Busatto-Gaston , Debraj Chakraborty , Anirban Majumdar , Sayan Mukherjee , Guillermo A. Pérez , Jean-François Raskin

Euclidean Markov decision processes are a powerful tool for modeling control problems under uncertainty over continuous domains. Finite state imprecise, Markov decision processes can be used to approximate the behavior of these infinite…

Artificial Intelligence · Computer Science 2020-06-29 Manfred Jaeger , Giorgio Bacci , Giovanni Bacci , Kim Guldstrand Larsen , Peter Gjøl Jensen

In this paper, we develop approximate dynamic programming methods for stochastic systems modeled as Markov Decision Processes, given both soft performance criteria and hard constraints in a class of probabilistic temporal logic called…

Optimization and Control · Mathematics 2018-10-08 Lening Li , Jie Fu

Existing studies on dynamic multi-objective optimization focus on problems with time-dependent objective functions, while the ones with a changing number of objectives have rarely been considered in the literature. Instead of changing the…

Neural and Evolutionary Computing · Computer Science 2017-02-20 Renzhi Chen , Ke Li , Xin Yao

Markov decision problems (MDPs) provide the foundations for a number of problems of interest to AI researchers studying automated planning and reinforcement learning. In this paper, we summarize results regarding the complexity of solving…

Artificial Intelligence · Computer Science 2013-02-21 Michael L. Littman , Thomas L. Dean , Leslie Pack Kaelbling

We present a new inverse optimization methodology for multi-objective convex optimization that accommodates an input solution that may not be Pareto optimal and determines a weight vector that produces a Pareto optimal solution that…

Optimization and Control · Mathematics 2017-06-22 Timothy C. Y. Chan , Taewoo Lee

Evolutionary multi-objective algorithms have successfully been used in the context of Pareto optimization where a given constraint is relaxed into an additional objective. In this paper, we explore the use of 3-objective formulations for…

Neural and Evolutionary Computing · Computer Science 2023-04-19 Frank Neumann , Carsten Witt

We develop two adaptive discretization algorithms for convex semi-infinite optimization, which terminate after finitely many iterations at approximate solutions of arbitrary precision. In particular, they terminate at a feasible point of…

Optimization and Control · Mathematics 2022-01-14 Jochen Schmid , Miltiadis Poursanidis

In many real-world applications, the Pareto Set (PS) of a continuous multiobjective optimization problem can be a piecewise continuous manifold. A decision maker may want to find a solution set that approximates a small part of the PS and…

Neural and Evolutionary Computing · Computer Science 2024-04-02 Ping Guo , Qingfu Zhang , Xi Lin

This paper considers the problem of maximizing multiple linear functions over the probability simplex. A classification of feasible points is indicated. A necessary and sufficient condition for a member of each class to be an efficient…

Optimization and Control · Mathematics 2024-12-30 Anas Mifrani

Markov decision problems are most commonly solved via dynamic programming. Another approach is Bellman residual minimization, which directly minimizes the squared Bellman residual objective function. However, compared to dynamic…

Machine Learning · Computer Science 2026-04-28 Donghwan Lee , Hyukjun Yang

The aim of this paper is to approximate a finite-state Markov process by another process with fewer states, called herein the approximating process. The approximation problem is formulated using two different methods. The first method,…

Markov decision processes (MDPs) describe sequential decision-making processes; MDP policies return for every state in that process an advised action. Classical algorithms can efficiently compute policies that are optimal with respect to,…

Logic in Computer Science · Computer Science 2025-05-23 Roman Andriushchenko , Milan Češka , Sebastian Junges , Filip Macák

Multiple-objective optimization (MOO) aims to simultaneously optimize multiple conflicting objectives and has found important applications in machine learning, such as minimizing classification loss and discrepancy in treating different…

Machine Learning · Computer Science 2022-09-16 Eric Enouen , Katja Mathesius , Sean Wang , Arielle Carr , Sihong Xie

We propose a new method for optimistic planning in infinite-horizon discounted Markov decision processes based on the idea of adding regularization to the updates of an otherwise standard approximate value iteration procedure. This…

Machine Learning · Computer Science 2023-06-16 Antoine Moulin , Gergely Neu

We study the optimization of the expected long-term reward in finite partially observable Markov decision processes over the set of stationary stochastic policies. In the case of deterministic observations, also known as state aggregation,…

Optimization and Control · Mathematics 2022-11-18 Mareike Dressler , Marina Garrote-López , Guido Montúfar , Johannes Müller , Kemal Rose

This paper studies a class of multi-robot coordination problems where a team of robots aim to reach their goal regions with minimum time and avoid collisions with obstacles and other robots. A novel numerical algorithm is proposed to…

Optimization and Control · Mathematics 2020-09-02 Guoxiang Zhao , Minghui Zhu

This paper addresses the challenge of dynamic multi-objective optimization problems (DMOPs) by introducing novel approaches for accelerating prediction strategies within the evolutionary algorithm framework. Since the objectives of DMOPs…

Neural and Evolutionary Computing · Computer Science 2024-11-14 Ru Lei , Lin Li , Rustam Stolkin , Bin Feng