English
Related papers

Related papers: Inference and dynamic decision-making for deterior…

200 papers

This paper studies the performative policy learning problem, where agents adjust their features in response to a released policy to improve their potential outcomes, inducing an endogenous distribution shift. There has been growing interest…

Machine Learning · Computer Science 2025-02-25 Qianyi Chen , Ying Chen , Bo Li

We study systems of interacting reinforced stochastic processes, where agents' decisions evolve under reinforcement, network-mediated interactions, and environmental influences. In competitive environments with irreducible networks, we…

Probability · Mathematics 2025-09-18 Michele Aleandri , Paolo Dai Pra , Ida Germana Minelli

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

Machine Learning · Computer Science 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

In our previous work, we proposed a systematic cross-layer framework for dynamic multimedia systems, which allows each layer to make autonomous and foresighted decisions that maximize the system's long-term performance, while meeting the…

Machine Learning · Computer Science 2013-06-06 Nicholas Mastronarde , Mihaela van der Schaar

Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.g., demand or travel times in delivery problems). A common strategy in such cases is…

Distributed model predictive control (MPC) has been proven a successful method in regulating the operation of large-scale networks of constrained dynamical systems. This paper is concerned with cooperative distributed MPC in which the…

Optimization and Control · Mathematics 2021-06-29 Georgios Darivianakis , Angelos Georghiou , John Lygeros

Estimation of physical quantities is at the core of most scientific research and the use of quantum devices promises to enhance its performances. In real scenarios, it is fundamental to consider that the resources are limited and Bayesian…

Fast and robust dynamic state estimation (DSE) is essential for accurately capturing the internal dynamic processes of power systems, and it serves as the foundation for reliably implementing real-time dynamic modeling, monitoring, and…

Systems and Control · Electrical Eng. & Systems 2025-01-07 Jianhua Pei , Ping Wang , Jingyu Wang , Dongyuan Shi

1. Understanding the mechanisms underlying biological systems, and ultimately, predicting their behaviours in a changing environment requires overcoming the gap between mathematical models and experimental or observational data.…

Quantitative Methods · Quantitative Biology 2017-04-19 Philipp H Boersch-Supan , Sadie J Ryan , Leah R Johnson

Finding tight bounds on the optimal solution is a critical element of practical solution methods for discrete optimization problems. In the last decade, decision diagrams (DDs) have brought a new perspective on obtaining upper and lower…

Artificial Intelligence · Computer Science 2019-02-28 Quentin Cappart , Emmanuel Goutierre , David Bergman , Louis-Martin Rousseau

The conservation of hydrological resources involves continuously monitoring their contamination. A multi-agent system composed of autonomous surface vehicles is proposed in this paper to efficiently monitor the water quality. To achieve a…

Artificial Intelligence · Computer Science 2024-01-10 Samuel Yanes Luis , Dmitriy Shutin , Juan Marchal Gómez , Daniel Gutiérrez Reina , Sergio Toral Marín

We develop a new method which extends Dynamic Mode Decomposition (DMD) to incorporate the effect of control to extract low-order models from high-dimensional, complex systems. DMD finds spatial-temporal coherent modes, connects local-linear…

Optimization and Control · Mathematics 2014-09-24 Joshua L. Proctor , Steven L. Brunton , J. Nathan Kutz

Informed and robust decision making in the face of uncertainty is critical for robots that perform physical tasks alongside people. We formulate this as Bayesian Reinforcement Learning over latent Markov Decision Processes (MDPs). While…

Robotics · Computer Science 2020-02-11 Gilwoo Lee , Brian Hou , Sanjiban Choudhury , Siddhartha S. Srinivasa

Several machine learning and deep learning frameworks have been proposed to solve remaining useful life estimation and failure prediction problems in recent years. Having access to the remaining useful life estimation or likelihood of…

Machine Learning · Computer Science 2021-10-01 Hamed Khorasgani , Haiyan Wang , Chetan Gupta , Ahmed Farahat

Although Reinforcement Learning (RL) agents are effective in well-defined environments, they often struggle to generalize their learned policies to dynamic settings due to their reliance on trial-and-error interactions. Recent work has…

Machine Learning · Computer Science 2025-08-26 Zhihao Dou , Dongfei Cui , Jun Yan , Weida Wang , Benteng Chen , Haoming Wang , Zeke Xie , Shufei Zhang

Robustness of decision rules to shifts in the data-generating process is crucial to the successful deployment of decision-making systems. Such shifts can be viewed as interventions on a causal graph, which capture (possibly hypothetical)…

Artificial Intelligence · Computer Science 2021-05-20 Benjie Wang , Clare Lyle , Marta Kwiatkowska

This paper introduces Bayesian frameworks for tackling various aspects of multi-criteria decision-making (MCDM) problems, leveraging a probabilistic interpretation of MCDM methods and challenges. By harnessing the flexibility of Bayesian…

Artificial Intelligence · Computer Science 2025-08-08 Majid Mohammadi

This paper investigates a class of optimal control problems associated with Markov processes with local state information. The decision-maker has only local access to a subset of a state vector information as often encountered in…

Systems and Control · Electrical Eng. & Systems 2020-05-12 Guanze Peng , Veeraruna Kavitha , Qunayan Zhu

Traditional continuous deep reinforcement learning (RL) algorithms employ deterministic or unimodal Gaussian actors, which cannot express complex multimodal decision distributions. This limitation can hinder their performance in…

Machine Learning · Computer Science 2025-11-04 Ziqi Wang , Jiashun Liu , Ling Pan

Optimization problems in engineering and applied mathematics are typically solved in an iterative fashion, by systematically adjusting the variables of interest until an adequate solution is found. The iterative algorithms that govern these…

Optimization and Control · Mathematics 2022-05-31 Laurent Lessard