English
Related papers

Related papers: Holistic Decision-Making in Stopping Problems: Emp…

200 papers

Robotic systems are more present in our society everyday. In human-robot environments, it is crucial that end-users may correctly understand their robotic team-partners, in order to collaboratively complete a task. To increase action…

Artificial Intelligence · Computer Science 2021-09-03 Francisco Cruz , Richard Dazeley , Peter Vamplew , Ithan Moreira

This paper considers a multiple stopping time problem for a Markov chain observed in noise, where a decision maker chooses at most L stopping times to maximize a cumulative objective. We formulate the problem as a Partially Observed Markov…

Systems and Control · Computer Science 2017-12-05 Vikram Krishnamurthy , Anup Aprem , Sujay Bhatt

The paper solves constrained Dynkin games with risk-sensitive criteria, where two players are allowed to stop at two independent Poisson random intervention times, via the theory of backward stochastic differential equations. This…

Optimization and Control · Mathematics 2020-08-06 Gechun Liang , Haodong Sun

Markov decision processes (MDP) are a well-established model for sequential decision-making in the presence of probabilities. In robust MDP (RMDP), every action is associated with an uncertainty set of probability distributions, modelling…

Artificial Intelligence · Computer Science 2024-12-16 Tobias Meggendorfer , Maximilian Weininger , Patrick Wienhöft

Gambits are central to human decision-making. Our goal is to provide a theory of Gambits. A Gambit is a combination of psychological and technical factors designed to disrupt predictable play. Chess provides an environment to study gambits…

Theoretical Economics · Economics 2022-04-14 Shiva Maharaj , Nicholas Polson , Christian Turk

In multi-period stochastic optimization problems, the future optimal decision is a random variable whose distribution depends on the parameters of the optimization problem. We analyze how the expected value of this random variable changes…

Optimization and Control · Mathematics 2020-01-28 Bar Light

This paper studies the synthesis of control policies for an agent that has to satisfy a temporal logic specification in a partially observable environment, in the presence of an adversary. The interaction of the agent (defender) with the…

Systems and Control · Computer Science 2019-03-19 Bhaskar Ramasubramanian , Andrew Clark , Linda Bushnell , Radha Poovendran

Motivation is an important factor underlying successful learning. Previous research has demonstrated the positive effects that static interactive narrative games can have on motivation. Concurrently, advances in AI have made dynamic and…

Computation and Language · Computer Science 2025-05-15 Daeun Hwang , Samuel Shields , Alex Calderwood , Shi Johnson-Bey , Michael Mateas , Noah Wardrip-Fruin , Edward F. Melcer

This paper introduces a novel framework for modeling interacting humans in a multi-stage game. This "iterated semi network-form game" framework has the following desirable characteristics: (1) Bounded rational players, (2) strategic players…

Multiagent Systems · Computer Science 2012-07-05 Ritchie Lee , David H. Wolpert , James Bono , Scott Backhaus , Russell Bent , Brendan Tracey

We introduce a new unified framework for modelling both decision problems and finite games based on quantifiers and selection functions. We show that the canonical utility maximisation is one special case of a quantifier and that our more…

Logic in Computer Science · Computer Science 2014-09-29 Jules Hedges , Paulo Oliva , Evguenia Winschel , Viktor Winschel , Philipp Zahn

In this paper, we investigate dynamic optimization problems featuring both stochastic control and optimal stopping in a finite time horizon. The paper aims to develop new methodologies, which are significantly different from those of mixed…

Portfolio Management · Quantitative Finance 2014-06-27 Xiongfei Jian , Xun Li , Fahuai Yi

Reinforcement Learning Algorithms are predominantly developed for stationary environments, and the limited literature that considers nonstationary environments often involves specific assumptions about changes that can occur in transition…

Machine Learning · Computer Science 2025-09-25 Ranga Shaarad Ayyagari , Revanth Raj Eega , Ambedkar Dukkipati

Probabilistic model checking can provide formal guarantees on the behavior of stochastic models relating to a wide range of quantitative properties, such as runtime, energy consumption or cost. But decision making is typically with respect…

Logic in Computer Science · Computer Science 2024-03-19 Ingy Elsayed-Aly , David Parker , Lu Feng

A cognitive handoff is a multipurpose handoff that achieves many desirable features simultaneously; e.g., seamlessness, autonomy, security, correctness, adaptability, etc. But, the development of cognitive handoffs is a challenging task…

We use ideas from distributed computing and game theory to study dynamic and decentralized environments in which computational nodes, or decision makers, interact strategically and with limited information. In such environments, which arise…

Computer Science and Game Theory · Computer Science 2017-04-06 Aaron D. Jaggard , Neil Lutz , Michael Schapira , Rebecca N. Wright

This paper contains a reformulation of any $n$-player finite, static game into a framework of distributed, dynamical system based on agents' payoff-based deviations. The reformulation generalizes the method employed in the second part of…

Computer Science and Game Theory · Computer Science 2017-10-19 Yuke Li , Fengjiao Liu , A. Stephen Morse

Autonomous systems can substantially enhance a human's efficiency and effectiveness in complex environments. Machines, however, are often unable to observe the preferences of the humans that they serve. Despite the fact that the human's and…

Machine Learning · Statistics 2017-05-29 Agostino Capponi , Reza Ghanadan , Matt Stern

This paper introduces application of Reflexive Game Theory to the matter of multistage decision making processes. The idea behind is that each decision making session has certain parameters like "when the session is taking place", "who are…

Multiagent Systems · Computer Science 2014-11-19 Sergey Tarasenko

We study self-triggered two-player stochastic games on Piecewise Deterministic Markov Processes (PDMPs) where each agent decides when to observe and which open-loop action to hold. Augmenting the state with clocks and committed controls…

Systems and Control · Electrical Eng. & Systems 2025-12-23 Yunian Pan , Quanyan Zhu

We consider a stochastic differential equation that is controlled by means of an additive finite-variation process. A singular stochastic controller, who is a minimizer, determines this finite-variation process, while a discretionary…

Probability · Mathematics 2015-01-20 Daniel Hernandez-Hernandez , Robert S. Simon , Mihail Zervos