English
Related papers

Related papers: A "Good" Regulator May Provide a World Model for I…

200 papers

Real-world complex systems such as ecological communities and neuron networks are essential parts of our everyday lives. These systems are composed of units which interact through intricate networks. The ability to predict sudden changes in…

Adaptation and Self-Organizing Systems · Physics 2019-07-05 Deniz Eroglu , Matteo Tanzi , Sebastian van Strien , Tiago Pereira

Learning the dynamics of a physical system wherein an autonomous agent operates is an important task. Often these systems present apparent geometric structures. For instance, the trajectories of a robotic manipulator can be broken down into…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Philippe Hansen-Estruch , Wenling Shang , Lerrel Pinto , Pieter Abbeel , Stas Tiomkin

\textit{Graph neural networks} (GNNs) are effective models for many dynamical systems consisting of entities and relations. Although most GNN applications assume a single type of entity and relation, many situations involve multiple types…

Machine Learning · Computer Science 2023-10-12 Ferran Alet , Erica Weng , Tomás Lozano Pérez , Leslie Pack Kaelbling

We propose a neural network approach to model general interaction dynamics and an adjoint based stochastic gradient descent algorithm to calibrate its parameters. The parameter calibration problem is considered as optimal control problem…

Optimization and Control · Mathematics 2021-02-01 Simone Göttlich , Claudia Totzeck

Modern ecology has re-emphasized the need for a quantitative understanding of the original 'survival of the fittest theme' based on analyzis of the intricate trade-offs between competing evolutionary strategies that characterize the…

Populations and Evolution · Quantitative Biology 2015-06-16 Jacopo Grilli , Samir Suweis , Amos Maritan

Randomness is ubiquitous in many applications across data science and machine learning. Remarkably, systems composed of random components often display emergent global behaviors that appear deterministic, manifesting a transition from…

Machine Learning · Computer Science 2025-05-16 Luca Muscarnera , Luigi Loreti , Giovanni Todeschini , Alessio Fumagalli , Francesco Regazzoni

This work proposes a novel technique Augmented Reinforcement Learning framework for the improvement of decision-making capabilities of machine learning models. The introduction of agents as external overseers checks on model decisions. The…

Machine Learning · Computer Science 2025-08-05 Sandesh Kumar Singh

This paper introduces a continuous-time constrained nonlinear control scheme which implements a model predictive control strategy as a continuous-time dynamic system. The approach is based on the idea that the solution of the optimal…

Systems and Control · Computer Science 2017-09-20 Marco M. Nicotra , Dominic Liao-McPherson , Ilya V. Kolmanovsky

Reinforcement Learning agents are expected to eventually perform well. Typically, this takes the form of a guarantee about the asymptotic behavior of an algorithm given some assumptions about the environment. We present an algorithm for a…

Machine Learning · Computer Science 2020-04-02 Michael K. Cohen , Elliot Catt , Marcus Hutter

Deep neural networks come in many sizes and architectures. The choice of architecture, in conjunction with the dataset and learning algorithm, is commonly understood to affect the learned neural representations. Yet, recent results have…

Machine Learning · Computer Science 2024-07-08 Loek van Rossem , Andrew M. Saxe

The setting of an agent making decisions under uncertainty and under dynamic constraints is common for the fields of optimal control, reinforcement learning, and recently also for online learning. In the online learning setting, the quality…

Systems and Control · Electrical Eng. & Systems 2023-04-18 Aren Karapetyan , Anastasios Tsiamis , Efe C. Balta , Andrea Iannelli , John Lygeros

We study private-good allocation under general constraints. Several prominent examples are special cases, including house allocation, roommate matching, social choice, and multiple assignment. Every individually strategy-proof and Pareto…

Theoretical Economics · Economics 2025-11-04 Joseph Root , David S. Ahn

Large Language Models (LLMs) can extend their parameter knowledge limits by adopting the Tool-Integrated Reasoning (TIR) paradigm. However, existing LLM-based agent training framework often focuses on answers' accuracy, overlooking specific…

Artificial Intelligence · Computer Science 2026-01-21 Yifei Chen , Guanting Dong , Zhicheng Dou

A generative recurrent neural network is quickly trained in an unsupervised manner to model popular reinforcement learning environments through compressed spatio-temporal representations. The world model's extracted features are fed into…

Machine Learning · Computer Science 2018-09-07 David Ha , Jürgen Schmidhuber

To coordinate with other systems, agents must be able to determine what the systems are currently doing and predict what they will be doing in the future---plan and goal recognition. There are many methods for plan and goal recognition, but…

Artificial Intelligence · Computer Science 2019-09-26 Christopher Amato , Andrea Baisero

Self-organization in complex systems is a process in which randomness is reduced and emergent structures appear that allow the system to function in a more competitive way with other states of the system or with other systems. It occurs…

Adaptation and Self-Organizing Systems · Physics 2025-06-02 Matthew J Brouillet , Georgi Yordanov Georgiev

Unambiguous identification of the rewards driving behaviours of entities operating in complex open-ended real-world environments is difficult, partly because goals and associated behaviours emerge endogenously and are dynamically updated as…

Machine Learning · Computer Science 2024-05-03 Richard M. Bailey

Active inference helps us simulate adaptive behavior and decision-making in biological and artificial agents. Building on our previous work exploring the relationship between active inference, well-being, resilience, and sustainability, we…

Artificial Intelligence · Computer Science 2024-06-13 Mahault Albarracin , Ines Hipolito , Maria Raffa , Paul Kinghorn

Developing reliable mechanisms for continuous local learning is a central challenge faced by biological and artificial systems. Yet, how the environmental factors and structural constraints on the learning network influence the optimal…

Neurons and Cognition · Quantitative Biology 2024-03-21 Emmanouil Giannakakis , Sina Khajehabdollahi , Anna Levina

An intelligent driving system should dynamically formulate appropriate driving strategies based on the current environment and vehicle status while ensuring system security and reliability. However, methods based on reinforcement learning…

Robotics · Computer Science 2025-09-11 Zuojin Tang , Xiaoyu Chen , Yongqiang Li , Jianyu Chen