English
Related papers

Related papers: Dynamic Decision Process Modeling and Relation-lin…

200 papers

Markov Decision Processes (MDPs) have been used to formulate many decision-making problems in science and engineering. The objective is to synthesize the best decision (action selection) policies to maximize expected rewards (minimize…

Optimization and Control · Mathematics 2015-07-08 Mahmoud El Chamie , Behcet Acikmese

Identifying a coupled dynamical system out of many plausible candidates, each of which could serve as the underlying generator of some observed measurements, is a profoundly ill posed problem that commonly arises when modelling real world…

Neurons and Cognition · Quantitative Biology 2019-09-17 Amirhossein Jafarian , Peter Zeidman , Vladimir Litvak , Karl Friston

A key motivation in the development of Distributed Model Predictive Control (DMPC) is to accelerate centralized Model Predictive Control (MPC) for large-scale systems. DMPC has the prospect of scaling well by parallelizing computations…

Optimization and Control · Mathematics 2025-04-16 Gösta Stomberg , Maurice Raetsch , Alexander Engelmann , Timm Faulwasser

We discuss the problems of modeling, control, and decision support in complex dynamic systems from a general system theoretic point of view. The main characteristics of complex systems and of system approach to complex system study are…

Systems and Control · Computer Science 2013-12-30 Armen Bagdasaryan

Distributed model predictive control methods for uncertain systems often suffer from considerable conservatism and can tolerate only small uncertainties due to the use of robust formulations that are amenable to distributed design and…

Systems and Control · Electrical Eng. & Systems 2022-03-03 Simon Muntwiler , Kim P. Wabersich , Lukas Hewing , Melanie N. Zeilinger

In many operations management problems, we need to make decisions sequentially to minimize the cost while satisfying certain constraints. One modeling approach to study such problems is constrained Markov decision process (CMDP). When…

Optimization and Control · Mathematics 2021-01-27 Yi Chen , Jing Dong , Zhaoran Wang

Performance improvement in supply chains, taking into account customer demand in the tactical planning process is essential. It is more and more difficult for the customers to ensure a certain level of demand over a medium term horizon as…

Optimization and Control · Mathematics 2008-10-23 François Galasso , Caroline Thierry

The field of Multi-Agent System (MAS) is an active area of research within Artificial Intelligence, with an increasingly important impact in industrial and other real-world applications. Within a MAS, autonomous agents interact to pursue…

Artificial Intelligence · Computer Science 2018-05-11 Ferdinando Fioretto , Enrico Pontelli , William Yeoh

General purpose intelligent learning agents cycle through (complex,non-MDP) sequences of observations, actions, and rewards. On the other hand, reinforcement learning is well-developed for small finite state Markov Decision Processes…

Artificial Intelligence · Computer Science 2009-12-30 Marcus Hutter

Recent research in decision theoretic planning has focussed on making the solution of Markov decision processes (MDPs) more feasible. We develop a family of algorithms for structured reachability analysis of MDPs that are suitable when an…

Artificial Intelligence · Computer Science 2013-04-24 Craig Boutilier , Ronen I. Brafman , Christopher W. Geib

In important applications involving multi-task networks with multiple objectives, agents in the network need to decide between these multiple objectives and reach an agreement about which single objective to follow for the network. In this…

Optimization and Control · Mathematics 2018-12-27 Sahar Khawatmi , Abdelhak M. Zoubir , Ali H. Sayed

We present the Multiple Criteria Decision Analysis Methods Selection Software (MCDA-MSS). This decision support system helps analysts answering a recurring question in decision science: Which is the most suitable Multiple Criteria Decision…

Artificial Intelligence · Computer Science 2021-06-15 Marco Cinelli , Miłosz Kadziński , Grzegorz Miebs , Michael Gonzalez , Roman Słowiński

This paper presents two new approaches to decomposing and solving large Markov decision problems (MDPs), a partial decoupling method and a complete decoupling method. In these approaches, a large, stochastic decision problem is divided into…

Artificial Intelligence · Computer Science 2013-02-01 Ron Parr

This paper considers a distributed decision-making approach for manufacturing task assignment and condition-based machine health maintenance. Our approach considers information sharing between the task assignment and health management…

Artificial Intelligence · Computer Science 2025-10-22 Ali Nasir , Samir Mekid , Zaid Sawlan , Omar Alsawafy

For tasks where the dynamics of multiple agents are physically coupled, e.g., in cooperative manipulation, the coordination between the individual agents becomes crucial, which requires exact knowledge of the interaction dynamics. This…

Robotics · Computer Science 2022-06-29 Pablo Budde gen. Dohmann , Armin Lederer , Marcel Dißemond , Sandra Hirche

Markov decision processes (MDPs) are used to model a wide variety of applications ranging from game playing over robotics to finance. Their optimal policy typically maximizes the expected sum of rewards given at each step of the decision…

Machine Learning · Computer Science 2025-05-26 Maximilian Nägele , Jan Olle , Thomas Fösel , Remmy Zen , Florian Marquardt

Dynamic Causal Modeling (DCM) is a Bayesian framework for inferring on hidden (latent) neuronal states, based on measurements of brain activity. Since its introduction in 2003 for functional magnetic resonance imaging data, DCM has been…

Quantitative Methods · Quantitative Biology 2021-04-08 Inês Pereira , Stefan Frässle , Jakob Heinzle , Dario Schöbi , Cao Tri Do , Moritz Gruber , Klaas E. Stephan

Coordination of distributed agents is required for problems arising in many areas, including multi-robot systems, networking and e-commerce. As a formal framework for such problems, we use the decentralized partially observable Markov…

Artificial Intelligence · Computer Science 2014-01-16 Daniel S. Bernstein , Christopher Amato , Eric A. Hansen , Shlomo Zilberstein

We study the offline data-driven sequential decision making problem in the framework of Markov decision process (MDP). In order to enhance the generalizability and adaptivity of the learned policy, we propose to evaluate each policy by a…

Statistics Theory · Mathematics 2021-11-11 Zhengling Qi , Peng Liao

Because failures in distribution systems caused by extreme weather events directly result in consumers' outages, this paper proposes a state-based decision-making model with the objective of mitigating loss of load to improve the…

Optimization and Control · Mathematics 2019-04-02 Chong Wang , Ping Ju , Shunbo Lei , Zhaoyu Wang , Yunhe Hou