English
Related papers

Related papers: Multi-Objective Controller Synthesis with Uncertai…

200 papers

Multi-agent planning under stochastic dynamics is usually formalised using decentralized (partially observable) Markov decision processes ( MDPs) and reachability or expected reward specifications. In this paper, we propose a different…

Logic in Computer Science · Computer Science 2025-02-20 Francesco Pontiggia , Filip Macák , Roman Andriushchenko , Michele Chiari , Milan Češka

Mathematical models simulate various events under different conditions, enabling an early overview of the system to be implemented in practice, reducing the waste of resources and in less time. In project optimization, these models play a…

Optimization and Control · Mathematics 2021-05-11 Gustavo Barbosa Libotte , Fran Sérgio Lobato , Francisco Duarte Moura Neto , Gustavo Mendes Platt

Reactive synthesis algorithms allow automatic construction of policies to control an environment modeled as a Markov Decision Process (MDP) that are optimal with respect to high-level temporal logic specifications. However, they assume that…

Formal Languages and Automata Theory · Computer Science 2022-05-31 Rajeev Alur , Suguman Bansal , Osbert Bastani , Kishor Jothimurugan

We present a method for synthesizing controllers to steer trajectories from an initial set to a target set on a finite time horizon. The proposed control synthesis problem is decomposed into two steps. The first step under-approximates the…

Systems and Control · Computer Science 2018-10-02 He Yin , Andrew Packard , Murat Arcak , Pete Seiler

The goal of a traditional Markov decision process (MDP) is to maximize expected cumulative reward over a defined horizon (possibly infinite). In many applications, however, a decision maker may be interested in optimizing a specific…

Artificial Intelligence · Computer Science 2025-10-16 Xiaocheng Li , Huaiyang Zhong , Margaret L. Brandeau

We introduce a new incremental preference elicitation procedure able to deal with noisy responses of a Decision Maker (DM). The originality of the contribution is to propose a Bayesian approach for determining a preferred solution in a…

Artificial Intelligence · Computer Science 2020-07-30 Nadjet Bourdache , Patrice Perny , Olivier Spanjaard

In this paper, we consider the problem of multi-objective optimal control of a dynamical system with additive and multiplicative noises with given second moments and arbitrary probability distributions. The objectives are given by quadratic…

Optimization and Control · Mathematics 2014-02-17 Ather Gattami

With the increasing ubiquity of multi-capable, general-purpose robots arises the need for enabling non-expert users to command these robots to perform complex high-level tasks. To this end, high-level robot control has seen the application…

Robotics · Computer Science 2014-09-05 Vasumathi Raman , Hadas Kress-Gazit

We study the synthesis of a policy in a Markov decision process (MDP) following which an agent reaches a target state in the MDP while minimizing its total discounted cost. The problem combines a reachability criterion with a discounted…

Optimization and Control · Mathematics 2021-03-18 Yagiz Savas , Christos K. Verginis , Michael Hibbard , Ufuk Topcu

A novel reinforcement learning scheme to synthesize policies for continuous-space Markov decision processes (MDPs) is proposed. This scheme enables one to apply model-free, off-the-shelf reinforcement learning algorithms for finite MDPs to…

Systems and Control · Electrical Eng. & Systems 2020-03-03 Abolfazl Lavaei , Fabio Somenzi , Sadegh Soudjani , Ashutosh Trivedi , Majid Zamani

Animating human-scene interactions such as pick-and-place tasks in cluttered, complex layouts is a challenging task, with objects of a wide variation of geometries and articulation under scenarios with various obstacles. The main difficulty…

Graphics · Computer Science 2025-10-07 Jintao Lu , He Zhang , Yuting Ye , Takaaki Shiratori , Sebastian Starke , Taku Komura

Multi-objective multi-armed bandit (MO-MAB) problems traditionally aim to achieve Pareto optimality. However, real-world scenarios often involve users with varying preferences across objectives, resulting in a Pareto-optimal arm that may…

Machine Learning · Computer Science 2025-11-18 Linfeng Cao , Ming Shi , Ness B. Shroff

Aligning large language models (LLMs) with human preferences is critical for enhancing LLMs' safety, helpfulness, humor, faithfulness, etc. Current reinforcement learning from human feedback (RLHF) mainly focuses on a fixed reward learned…

Machine Learning · Computer Science 2026-04-07 Qiang He , Yucheng Yang , Tianyi Zhou , Meng Fang , Mykola Pechenizkiy , Setareh Maghsudi

The objective of the multi-condition human motion synthesis task is to incorporate diverse conditional inputs, encompassing various forms like text, music, speech, and more. This endows the task with the capability to adapt across multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zeyu Ling , Bo Han , Yongkang Wong , Mohan Kangkanhalli , Weidong Geng

Software implementations of controllers for physical systems are at the core of many embedded systems. The design of controllers uses the theory of dynamical systems to construct a mathematical control law that ensures that the controlled…

Systems and Control · Computer Science 2012-04-16 Rupak Majumdar , Indranil Saha , Majid Zamani

This paper investigates adaptive model predictive control (MPC) for a class of constrained linear systems with unknown model parameters. This is also posed as the dual control problem consisting of system identification and regulation. We…

Optimization and Control · Mathematics 2020-11-24 Kunwu Zhang , Yang Shi

Many decision-making problems feature multiple objectives. In such problems, it is not always possible to know the preferences of a decision-maker for different objectives. However, it is often possible to observe the behavior of…

Artificial Intelligence · Computer Science 2023-04-28 Junlin Lu , Patrick Mannion , Karl Mason

This paper addresses the problem of control synthesis for nonlinear optimal control problems in the presence of state and input constraints. The presented approach relies upon transforming the given problem into an infinite-dimensional…

Optimization and Control · Mathematics 2017-03-03 Pengcheng Zhao , Shankar Mohan , Ram Vasudevan

Many decision-making problems feature multiple objectives where it is not always possible to know the preferences of a human or agent decision-maker for different objectives. However, demonstrated behaviors from the decision-maker are often…

Artificial Intelligence · Computer Science 2024-10-01 Junlin Lu , Patrick Mannion , Karl Mason

In the Markov decision process model, policies are usually evaluated by expected cumulative rewards. As this decision criterion is not always suitable, we propose in this paper an algorithm for computing a policy optimal for the quantile…

Artificial Intelligence · Computer Science 2016-12-02 Hugo Gilbert , Paul Weng , Yan Xu