English
Related papers

Related papers: Entropic Risk for Turn-Based Stochastic Games

200 papers

The goal in this paper is to approximate the Price of Stability (PoS) in stochastic Nash games using stochastic approximation (SA) schemes. PoS is amongst the most popular metrics in game theory and provides an avenue for estimating the…

Optimization and Control · Mathematics 2023-10-31 Afrooz Jalilzadeh , Farzad Yousefian , Mohammadjavad Ebrahimi

Weighted timed games are two-player zero-sum games played in a timed automaton equipped with integer weights. We consider optimal reachability objectives, in which one of the players, that we call Min, wants to reach a target location while…

Computer Science and Game Theory · Computer Science 2025-03-05 Benjamin Monmege , Julie Parreaux , Pierre-Alain Reynier

The entropic risk measure is widely used in high-stakes decision-making across economics, management science, finance, and safety-critical control systems because it captures tail risks associated with uncertain losses. However, when data…

Optimization and Control · Mathematics 2026-01-05 Utsav Sadana , Erick Delage , Angelos Georghiou

We investigate the problem of gambling with uncertainty in outcome probabilities. Stochastic optimization models are proposed for optimal investing on events with mutually exclusive outcomes when probabilities are estimated using…

Optimization and Control · Mathematics 2017-08-03 Michael R. Metel

We study time-inconsistent recursive stochastic control problems, i.e., for which the Bellman principle of optimality does not hold. For this class of problems classical optimal controls may fail to exist, or to be relevant in practice, and…

Optimization and Control · Mathematics 2024-03-14 Elisa Mastrogiacomo , Marco Tarsia

Stochastic games combine controllable and adversarial non-determinism with stochastic behavior and are a common tool in control, verification and synthesis of reactive systems facing uncertainty. Multi-objective stochastic games are natural…

Computer Science and Game Theory · Computer Science 2021-09-20 Tobias Winkler , Maximilian Weininger

Risk is a well-known turn based board game where the primary objective is nothing less than the world domination. Gameplay is based on battles between armies located in adjacent territories on the map of Earth. The combat's outcome is…

Computer Science and Game Theory · Computer Science 2012-04-19 Manu Harju

We study finite normal-form games in which payoffs are subject to random perturbations and players face uncertainty about how these shocks co-move across actions, an ambiguity that naturally arises when only realized (not counterfactual)…

Theoretical Economics · Economics 2026-02-12 Yu Gui , Bahar Taşkesen

In real-world decision-making problems, for instance in the fields of finance, robotics or autonomous driving, keeping uncertainty under control is as important as maximizing expected returns. Risk aversion has been addressed in the…

Machine Learning · Computer Science 2019-12-09 Lorenzo Bisi , Luca Sabbioni , Edoardo Vittori , Matteo Papini , Marcello Restelli

Quantitative verification techniques have been developed for the formal analysis of a variety of probabilistic models, such as Markov chains, Markov decision process and their variants. They can be used to produce guarantees on quantitative…

Logic in Computer Science · Computer Science 2019-07-18 Marta Kwiatkowska , Gethin Norman , David Parker

In a typical stochastic multi-armed bandit problem, the objective is often to maximize the expected sum of rewards over some time horizon $T$. While the choice of a strategy that accomplishes that is optimal with no additional information,…

Machine Learning · Computer Science 2023-11-01 Reda Alami , Mohammed Mahfoud , Mastane Achab

We motivate and propose a new model for non-cooperative Markov game which considers the interactions of risk-aware players. This model characterizes the time-consistent dynamic "risk" from both stochastic state transitions (inherent to the…

Computer Science and Game Theory · Computer Science 2019-11-22 Wenjie Huang , Pham Viet Hai , William B. Haskell

We develop an approach for two player constraint zero-sum and nonzero-sum stochastic differential games, which are modeled by Markov regime-switching jump-diffusion processes. We provide the relations between a usual stochastic optimal…

Optimization and Control · Mathematics 2023-01-31 Emel Savku

The classical approach to system identification is based on stochastic assumptions about the measurement error, and provides estimates that have random nature. Worst-case identification, on the other hand, only assumes the knowledge of…

Systems and Control · Computer Science 2013-06-07 Fabrizio Dabbene , Mario Sznaier , Roberto Tempo

Entropic regularization of policies in Reinforcement Learning (RL) is a commonly used heuristic to ensure that the learned policy explores the state-space sufficiently before overfitting to a local optimal policy. The primary motivation for…

Machine Learning · Computer Science 2021-01-19 Hisham Husain , Kamil Ciosek , Ryota Tomioka

We study variants of a stochastic game inspired by backgammon where players may propose to double the stake, with the game state dictated by a one-dimensional random walk. Our variants allow for different numbers of proposals and different…

Optimization and Control · Mathematics 2024-10-28 Haoru Ju , Daniel Leifer , Steven J. Miller , Sooraj A. Padmanabhan , Chenyang Sun , Luke Tichi , Benjamin Tocher , Kiley Wallace

We consider the random design regression model with square loss. We propose a method that aggregates empirical minimizers (ERM) over appropriately chosen random subsets and reduces to ERM in the extreme case, and we establish sharp oracle…

Statistics Theory · Mathematics 2017-07-04 Alexander Rakhlin , Karthik Sridharan , Alexandre B. Tsybakov

Probabilistic model checking for stochastic games enables formal verification of systems that comprise competing or collaborating entities operating in a stochastic environment. Despite good progress in the area, existing approaches focus…

Logic in Computer Science · Computer Science 2019-07-09 Marta Kwiatkowska , Gethin Norman , David Parker , Gabriel Santos

We study infinite horizon discounted-cost and ergodic-cost risk-sensitive zero-sum stochastic games for controlled continuous time Markov chains on a countable state space. For the discounted-cost game we prove the existence of value and…

Optimization and Control · Mathematics 2016-03-09 Mrinal K. Ghosh , K. Suresh Kumar , Chandan Pal

Accounting for the non-normality of asset returns remains challenging in robust portfolio optimization. In this article, we tackle this problem by assessing the risk of the portfolio through the "amount of randomness" conveyed by its…

Portfolio Management · Quantitative Finance 2018-07-03 Nathan Lassance , Frédéric Vrins