English
Related papers

Related papers: Optimal models of decision-making in dynamic envir…

200 papers

We are interested in learning models of non-stationary environments, which can be framed as a multi-task learning problem. Model-free reinforcement learning algorithms can achieve good asymptotic performance in multi-task learning at a cost…

Machine Learning · Computer Science 2020-11-24 Elahe Aghapour , Nora Ayanian

Decision-making individuals often imitate their highest-earning fellows rather than optimize their own utilities, due to bounded rationality and incomplete information. Perpetual fluctuations between decisions have been reported as the…

Systems and Control · Electrical Eng. & Systems 2023-02-16 Yiheng Fu , Pouria Ramazi

We address the problem of reinforcement learning in which observations may exhibit an arbitrary form of stochastic dependence on past observations and actions. The task for an agent is to attain the best possible asymptotic reward where the…

Machine Learning · Computer Science 2007-05-23 Daniil Ryabko , Marcus Hutter

Traditional approaches to the design of multi-agent navigation algorithms consider the environment as a fixed constraint, despite the obvious influence of spatial constraints on agents' performance. Yet hand-designing improved environment…

Robotics · Computer Science 2022-09-26 Zhan Gao , Amanda Prorok

Recent advances in AI models have increased the integration of AI-based decision aids into the human decision making process. To fully unlock the potential of AI-assisted decision making, researchers have computationally modeled how humans…

Human-Computer Interaction · Computer Science 2024-11-19 Zhuoyan Li , Ming Yin

We study a dynamical model of a population of cooperators and defectors whose actions have long-term consequences on environmental "commons" - what we term the "resource". Cooperators contribute to restoring the resource whereas defectors…

Systems and Control · Computer Science 2025-05-06 Keith Paarporn , Ceyhun Eksin , Joshua S. Weitz , Yorai Wardi

It has long been hypothesized that operating close to the critical state is beneficial for natural and artificial systems. We test this hypothesis by evolving foraging agents controlled by neural networks that can change the system's…

Neural and Evolutionary Computing · Computer Science 2022-06-16 Jan Prosi , Sina Khajehabdollahi , Emmanouil Giannakakis , Georg Martius , Anna Levina

The process of evolutionary emergence of purposeful adaptive behavior is investigated by means of computer simulations. The model proposed implies that there is an evolving population of simple agents, which have two natural needs: energy…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Mikhail S. Burtsev , Vladimir G. Redko , Roman V. Gusarev

We analyse a non-local parabolic integro-differential equation modelling the evolutionary dynamics of a phenotypically-structured population in a changing environment. Such models arise in a variety of contexts from climate change to…

Analysis of PDEs · Mathematics 2024-07-16 Manh Hong Duong , Fabian Spill , Blaine van Rensburg

We describe theoretical bounds and a practical algorithm for teaching a model by demonstration in a sequential decision making environment. Unlike previous efforts that have optimized learners that watch a teacher demonstrate a static…

Machine Learning · Computer Science 2012-10-19 Thomas J. Walsh , Sergiu Goschin

Empirical evidence suggesting that living systems might operate in the vicinity of critical points, at the borderline between order and disorder, has proliferated in recent years, with examples ranging from spontaneous brain activity to…

Statistical Mechanics · Physics 2014-07-25 Jorge Hidalgo , Jacopo Grilli , Samir Suweis , Miguel A. Munoz , Jayanth R. Banavar , Amos Maritan

Define an environment as a set of convex constraint functions that vary arbitrarily over time and consider a cost function that is also convex and arbitrarily varying. Agents that operate in this environment intend to select actions that…

Optimization and Control · Mathematics 2016-04-08 Santiago Paternain , Alejandro Ribeiro

Thanks to recent technological advances, it is now possible to track with an unprecedented precision and for long periods of time the movement patterns of many living organisms in their habitat. The increasing amount of data available on…

Populations and Evolution · Quantitative Biology 2015-05-19 Denis Boyer , Peter D. Walsh

Humans have needs motivating their behavior according to intensity and context. However, we also create preferences associated with each action's perceived pleasure, which is susceptible to changes over time. This makes decision-making more…

Robotics · Computer Science 2024-09-05 Letícia Berto , Paula Costa , Alexandre Simões , Ricardo Gudwin , Esther Colombini

Decision-making in dynamic environments typically requires adaptive evidence accumulation that weights new evidence more heavily than old observations. Recent experimental studies of dynamic decision tasks require subjects to make decisions…

Neurons and Cognition · Quantitative Biology 2019-03-26 Nicholas W. Barendregt , Krešimir Josić , Zachary P. Kilpatrick

We are witnessing an increasing use of data-driven predictive models to inform decisions. As decisions have implications for individuals and society, there is increasing pressure on decision makers to be transparent about their decision…

Modern ecology has re-emphasized the need for a quantitative understanding of the original 'survival of the fittest theme' based on analyzis of the intricate trade-offs between competing evolutionary strategies that characterize the…

Populations and Evolution · Quantitative Biology 2015-06-16 Jacopo Grilli , Samir Suweis , Amos Maritan

Mathematical modelling and numerical simulations of interaction populations are crucial topics in systems biology. The interactions of ecological models may occur among individuals of the same species or individuals of different species.…

Quantitative Methods · Quantitative Biology 2017-09-04 Sarbaz H. A. Khoshnaw

In model-based learning, an agent's model is commonly defined over transitions between consecutive states of an environment even though planning often requires reasoning over multi-step timescales, with intermediate states either…

Machine Learning · Computer Science 2020-10-06 Alexey Zakharov , Matthew Crosby , Zafeirios Fountas

How do decisions change with the economic environment and with time? This paper studies general nonstationary stopping problems and provides the methodological tools to answer these questions. First, we identify conditions that ensure a…

Theoretical Economics · Economics 2024-08-01 Théo Durandard , Matteo Camboni