English
Related papers

Related papers: Optimal models of decision-making in dynamic envir…

200 papers

In performative prediction, predictions guide decision-making and hence can influence the distribution of future data. To date, work on performative prediction has focused on finding performatively stable models, which are the fixed points…

Machine Learning · Computer Science 2021-06-17 John Miller , Juan C. Perdomo , Tijana Zrnic

We consider a model where an agent has a repeated decision to make and wishes to maximize their total payoff. Payoffs are influenced by an action taken by the agent, but also an unknown state of the world that evolves over time. Before…

Computer Science and Game Theory · Computer Science 2021-01-20 Nicole Immorlica , Ian Kash , Brendan Lucier

We present a general theoretical model for the spatio-temporal dynamics of animal contests. Inspired by interactions between physical particles, the model is formulated in terms of effective interaction potentials, which map typical…

Biological Physics · Physics 2022-12-01 Amir Haluts , Alex Jordan , Nir S. Gov

We address the problem of reinforcement learning in which observations may exhibit an arbitrary form of stochastic dependence on past observations and actions, i.e. environments more general than (PO)MDPs. The task for an agent is to attain…

Machine Learning · Computer Science 2009-12-30 Daniil Ryabko , Marcus Hutter

Learning for animals or humans is the process that leads to behaviors better adapted to the environment. This process highly depends on the individual that learns and is usually observed only through the individual's actions. This article…

Machine Learning · Statistics 2025-02-20 Julien Aubert , Louis Köhler , Luc Lehéricy , Giulia Mezzadri , Patricia Reynaud-Bouret

Conceptual view of fitness and fitness measurement of strategic decisions on information systems, technological systems and innovation are becoming more important in recent years. This paper determines some dynamics of fitness landscape…

Other Statistics · Statistics 2011-07-04 H. Kemal Ilter

This paper proposes models of learning process in teams of individuals who collectively execute a sequence of tasks and whose actions are determined by individual skill levels and networks of interpersonal appraisals and influence. The…

Social and Information Networks · Computer Science 2016-10-03 Wenjun Mei , Noah E. Friedkin , Kyle Lewis , Francesco Bullo

We consider a simulation optimization problem for a context-dependent decision-making, which aims to determine the top-m designs for all contexts. Under a Bayesian framework, we formulate the optimal dynamic sampling decision as a…

Machine Learning · Statistics 2023-06-12 Gongbo Zhang , Sihua Chen , Kuihua Huang , Yijie Peng

Animals use a combination of egocentric navigation driven by the internal integration of environmental cues, interspersed with geocentric course correction and reorientation, often with uncertainty in sensory acquisition of information,…

Biological Physics · Physics 2015-12-22 O. Peleg , L. Mahadevan

Distribution shifts have long been regarded as troublesome external forces that a decision-maker should either counteract or conform to. An intriguing feedback phenomenon termed decision dependence arises when the deployed decision affects…

Optimization and Control · Mathematics 2025-03-11 Zhiyu He , Saverio Bolognani , Florian Dörfler , Michael Muehlebach

In many two-sided markets, the parties to be matched have incomplete information about their characteristics. We consider the settings where the parties engaged are extremely patient and are interested in long-term partnerships. Hence, once…

Computer Science and Game Theory · Computer Science 2019-08-30 Kartik Ahuja , Mihaela van der Schaar

Animals are equipped with a rich innate repertoire of sensory, behavioral and motor skills, which allows them to interact with the world immediately after birth. At the same time, many behaviors are highly adaptive and can be tailored to…

Machine Learning · Computer Science 2022-05-03 Robert Tjarko Lange , Henning Sprekeler

Biological organisms adapt to changes by processing informations from different sources, most notably from their ancestors and from their environment. We review an approach to quantify these informations by analyzing mathematical models of…

Populations and Evolution · Quantitative Biology 2016-03-23 Olivier Rivoire

AI agents designed to collaborate with people benefit from models that enable them to anticipate human behavior. However, realistic models tend to require vast amounts of human data, which is often hard to collect. A good prior or…

Machine Learning · Computer Science 2022-11-22 Mesut Yang , Micah Carroll , Anca Dragan

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

Can we allow humans to pick among different, yet reasonably similar, decisions? Are we able to construct optimization problems whose outcome are sets of feasible, close-to-optimal decisions for human users to pick from, instead of a single,…

Optimization and Control · Mathematics 2024-03-07 Andrea Simonetto

In this paper, we conduct a literature review of laws of motion based on stochastic search strategies which are mainly focused on exploring highly dynamic environments. In this regard, stochastic search strategies represent an interesting…

We consider the problem of selecting deterministic or stochastic models for a biological, ecological, or environmental dynamical process. In most cases, one prefers either deterministic or stochastic models as candidate models based on…

Applications · Statistics 2015-10-26 Libo Sun , Chihoon Lee , Jennifer A. Hoeting

Efficient and robust policy transfer remains a key challenge for reinforcement learning to become viable for real-wold robotics. Policy transfer through warm initialization, imitation, or interacting over a large set of agents with…

Machine Learning · Computer Science 2021-05-12 Girish Joshi , Girish Chowdhary

Modeling how a robot interacts with the environment around it is an important prerequisite for designing control and planning algorithms. In fact, the performance of controllers and planners is highly dependent on the quality of the model.…

Machine Learning · Computer Science 2020-03-03 Clark Zhang , Arbaaz Khan , Santiago Paternain , Alejandro Ribeiro