English
Related papers

Related papers: Decision making in stochastic extensive form II: S…

200 papers

Deliberating on large or continuous state spaces have been long standing challenges in reinforcement learning. Temporal Abstraction have somewhat made this possible, but efficiently planing using temporal abstraction still remains an issue.…

Artificial Intelligence · Computer Science 2017-03-21 Peeyush Kumar , Doina Precup

The coordinated and efficient distribution of limited resources by individual decisions is a fundamental, unsolved problem. When individuals compete for road capacities, time, space, money, goods, etc., they normally make decisions based on…

Statistical Mechanics · Physics 2009-11-07 Dirk Helbing , Martin Schoenhof , Daniel Kern

We show that, in a resource allocation problem, the ex ante aggregate utility of players with cumulative-prospect-theoretic preferences can be increased over deterministic allocations by implementing lotteries. We formulate an optimization…

Theoretical Economics · Economics 2020-12-07 Soham R. Phade , Venkat Anantharam

We derive a class of macroscopic differential equations that describe collective adaptation, starting from a discrete-time stochastic microscopic model. The behavior of each agent is a dynamic balance between adaptation that locally…

Adaptation and Self-Organizing Systems · Physics 2024-05-15 Yuzuru Sato , Eizo Akiyama , James P. Crutchfield

We introduce an approach to inferring the causal architecture of stochastic dynamical systems that extends rate distortion theory to use causal shielding---a natural principle of learning. We study two distinct cases of causal inference:…

Information Theory · Computer Science 2010-08-23 Susanne Still , James P. Crutchfield , Christopher J. Ellison

This paper motivates the use of random-bridges -- stochastic processes conditioned to take target distributions at fixed timepoints -- in the realm of generative modelling. Herein, random-bridges can act as stochastic transports between two…

Machine Learning · Computer Science 2026-04-07 Stefano Goria , Levent A. Mengütürk , Murat C. Mengütürk , Berkan Sesen

In the last decade, stochastic models have shown to be very useful for quantitative modelling of social processes. Here, a configurational master equation for the description of behavioral changes by pair interactions of individuals is…

Statistical Mechanics · Physics 2009-10-31 Dirk Helbing

Collective, especially group-based, managerial decision making is crucial in organizations. Using an evolutionary theoretic approach to collective decision making, agent-based simulations were conducted to investigate how human collective…

Multiagent Systems · Computer Science 2019-02-20 Shelley D. Dionne , Hiroki Sayama , Francis J. Yammarino

Stochastic portfolio theory aims at finding relative arbitrages, i.e. trading strategies which outperform the market with probability one. Functionally generated portfolios, which are deterministic functions of the market weights, are an…

Mathematical Finance · Quantitative Finance 2021-01-19 Patrick Mijatovic

Organisms and ecological groups accumulate evidence to make decisions. Classic experiments and theoretical studies have explored this process when the correct choice is fixed during each trial. However, we live in a constantly changing…

Neurons and Cognition · Quantitative Biology 2015-10-01 Alan Veliz-Cuba , Zachary P. Kilpatrick , Kresimir Josic

Stochastic dynamics govern many important processes in cellular biology, and an underlying theoretical approach describing these dynamics is desirable to address a wealth of questions in biology and medicine. Mathematical tools exist for…

Quantitative Methods · Quantitative Biology 2016-02-17 Iain G. Johnston , Nick S. Jones

In order to speed-up classification models when facing a large number of categories, one usual approach consists in organizing the categories in a particular structure, this structure being then used as a way to speed-up the prediction…

Machine Learning · Computer Science 2015-11-26 Aurélia Léon , Ludovic Denoyer

In the simplest sequential decision problem for an ergodic stochastic process X, at each time n a decision u_n is made as a function of past observations X_0,...,X_{n-1}, and a loss l(u_n,X_n) is incurred. In this setting, it is known that…

Probability · Mathematics 2015-02-04 Ramon van Handel

Snapshots of "best" (or "worst") experience are known to dominate human memory and may thus also have a significant effect on future behaviour. We consider here a model of repeated decision-making where, at every time step, an agent takes…

Statistical Mechanics · Physics 2022-02-18 Evangelos Mitsokapas , Rosemary J. Harris

Many complex systems are characterized by intriguing spatio-temporal structures. Their mathematical description relies on the analysis of appropriate correlation functions. Functional integral techniques provide a unifying formalism that…

Statistical Mechanics · Physics 2009-11-12 Uwe C. Tauber

We consider the problem of computing the set of initial states of a dynamical system such that there exists a control strategy to ensure that the trajectories satisfy a temporal logic specification with probability 1 (almost-surely). We…

Systems and Control · Computer Science 2015-02-24 Maria Svorenova , Jan Kretinsky , Martin Chmelik , Krishnendu Chatterjee , Ivana Cerna , Calin Belta

In a recent article, Krapivsky and Redner (J. Stat. Mech. 093208 (2018)) established that the distribution of the first hitting times for a diffusing particle subject to hitting an absorber is independent of the direction of the external…

Statistical Mechanics · Physics 2020-01-29 Coline Larmier , Alain Mazzolo , Andrea Zoia

We propose a new differentially-private decision forest algorithm that minimizes both the number of queries required, and the sensitivity of those queries. To do so, we build an ensemble of random decision trees that avoids querying the…

Cryptography and Security · Computer Science 2021-08-25 Sam Fletcher , Md Zahidul Islam

Motivated by applications where impatience is pervasive and evaluation times are uncertain, we study a selection model where options may expire at an unknown point in time and evaluation times are stochastic. Initially, the decision-maker…

Optimization and Control · Mathematics 2026-02-05 Yihua Xu , Rohan Ghuge , Sebastian Perez-Salazar

We introduce a class of extensive form games where players might not be able to foresee the possible consequences of their decisions and form a model of their opponents which they exploit to achieve a more profitable outcome. We improve…

Artificial Intelligence · Computer Science 2016-05-31 Paolo Turrini