Related papers: Adaptation to time-varying environments in a react…
Humans and animals show remarkable learning efficiency, adapting to new environments with minimal experience. This capability is not well captured by standard reinforcement learning algorithms that rely on incremental value updates. Rapid…
In the natural world, life has found innumerable ways to survive and often thrive. Between and even within species, each individual is in some manner unique, and this diversity lends adaptability and robustness to life. In this work, we aim…
Diffusion models typically generate data through a fixed denoising trajectory that is shared across all samples. However, generation targets can differ in complexity, suggesting that a single pre-defined diffusion process may not be optimal…
Stochastic models in which agents interact with their neighborhood according to a network topology are a powerful modeling framework to study the emergence of complex dynamic patterns in real-world systems. Stochastic simulations are often…
Adaptation in a fluctuating environment is a process of fueling environmental information to gain fitness. Living systems have gradually developed strategies for adaptation from random and passive diversification of the phenotype to more…
We describe the results of analytic calculations and computer simulations of adaptive predictors (predictive agents) responding to an evolving chaotic environment and to one another. Our simulations are designed to quantify adaptation and…
Many complex adaptive systems contain a large diversity of specialized components. The specialization at the level of the microscopic degrees of freedom, and diversity at the level of the system as a whole are phenomena that appear during…
The global push to advance Carbon Capture and Sequestration initiatives and green energy solutions, such as geothermal, have thrust new demands upon the current state-of-the-art subsurface fluid simulators. The requirement to be able to…
Active inference helps us simulate adaptive behavior and decision-making in biological and artificial agents. Building on our previous work exploring the relationship between active inference, well-being, resilience, and sustainability, we…
Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…
Cells generally change their internal state to adapt to an environmental change, and accordingly evolve in response to the new conditions. This process involves phenotypic changes that occur over several different time scales, ranging from…
Living systems adapt to various environmental conditions by changing their internal states. Inspired by gene expression and epigenetic modification dynamics, we herein propose a generic mechanism for adaptation by combining fast oscillatory…
Populations of replicating entities frequently experience sudden or cyclical changes in environment. We explore the implications of this phenomenon via a environmental switching parameter in several common evolutionary dynamics models…
Chemical reactions involving diffusion of reactants and subsequent chemical fixation steps are generally termed "diffusion-influenced" (DI). Virtually all biochemical processes in living media can be counted among them, together with those…
We study a stochastic differential equation driven by a Poisson point process, which models continuous changes in a population's environment, as well as the stochastic fixation of beneficial mutations that might compensate for this change.…
We address the problem of reinforcement learning in which observations may exhibit an arbitrary form of stochastic dependence on past observations and actions, i.e. environments more general than (PO)MDPs. The task for an agent is to attain…
Deep reinforcement learning has proven to be a great success in allowing agents to learn complex tasks. However, its application to actual robots can be prohibitively expensive. Furthermore, the unpredictability of human behavior in…
The high sample complexity of reinforcement learning challenges its use in practice. A promising approach is to quickly adapt pre-trained policies to new environments. Existing methods for this policy adaptation problem typically rely on…
We propose a model to characterize how a diffusing population adapts under a time periodic selection, while its environment undergoes shifts and size changes, leading to significant differences with classical results on fixed domains. After…
Sequential learning systems are used in a wide variety of problems from decision making to optimization, where they provide a 'belief' (opinion) to nature, and then update this belief based on the feedback (result) to minimize (or maximize)…