English
Related papers

Related papers: A "Good" Regulator May Provide a World Model for I…

200 papers

We focus on developing efficient and reliable policy optimization strategies for robot learning with real-world data. In recent years, policy gradient methods have emerged as a promising paradigm for training control policies in simulation.…

Machine Learning · Computer Science 2023-11-07 Tyler Westenbroek , Jacob Levy , David Fridovich-Keil

Human cognition is profoundly shaped by the environments in which it unfolds. Yet, it remains an open question whether learning and decision making can be explained as a principled adaptation to the statistical structure of real-world…

Neurons and Cognition · Quantitative Biology 2025-09-04 Akshay K. Jagadish , Mirko Thalmann , Julian Coda-Forno , Marcel Binz , Eric Schulz

Neural networks can emulate nonlinear physical systems with high accuracy, yet they may produce physically-inconsistent results when violating fundamental constraints. Here, we introduce a systematic way of enforcing nonlinear analytic…

Computational Physics · Physics 2021-03-10 Tom Beucler , Michael Pritchard , Stephan Rasp , Jordan Ott , Pierre Baldi , Pierre Gentine

A robotic swarm that is required to operate for long periods in a potentially unknown environment can use both evolution and individual learning methods in order to adapt. However, the role played by the environment in influencing the…

Neural and Evolutionary Computing · Computer Science 2018-04-23 Andreas Steyven , Emma Hart , Ben Paechter

Simulation of population dynamics is a central research theme in computational biology, which contributes to understanding the interactions between predators and preys. Conventional mathematical tools of this theme, however, are incapable…

Multiagent Systems · Computer Science 2020-02-11 Jun Yamada , John Shawe-Taylor , Zafeirios Fountas

This paper considers the problem of regulating a dynamical system to equilibria that are defined as solutions of an input- and state-constrained optimization problem. To solve this regulation task, we design a state feedback controller…

Systems and Control · Electrical Eng. & Systems 2023-12-14 Yiting Chen , Liliaokeawawa Cothren , Jorge Cortes , Emiliano Dall'Anese

Interacting individuals in complex systems often give rise to coherent motion exhibiting coordinated global structures. Such phenomena are ubiquitously observed in nature, from cell migration, bacterial swarms, animal and insect groups, and…

Neural and Evolutionary Computing · Computer Science 2024-07-17 Dongjo Kim , Jeongsu Lee , Ho-Young Kim

The problem of Reinforcement Learning (RL) in an unknown nonlinear dynamical system is equivalent to the search for an optimal feedback law utilizing the simulations/ rollouts of the dynamical system. Most RL techniques search over a…

Machine Learning · Computer Science 2022-03-25 Ran Wang , Karthikeya S. Parunandi , Aayushman Sharma , Raman Goyal , Suman Chakravorty

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

In this paper we consider a recently developed distributed optimization algorithm based on gradient tracking. We propose a system theory framework to analyze its structural properties on a preliminary, quadratic optimization set-up.…

Systems and Control · Electrical Eng. & Systems 2020-06-03 Michelangelo Bin , Ivano Notarnicola , Lorenzo Marconi , Giuseppe Notarstefano

When deploying artificial agents in real-world environments where they interact with humans, it is crucial that their behavior is aligned with the values, social norms or other requirements of that environment. However, many environments…

Machine Learning · Computer Science 2023-05-05 Mattijs Baert , Pietro Mazzaglia , Sam Leroux , Pieter Simoens

Models and simulations of collective behaviours are often based on considering them as assumed by interactive particle systems. The focus is then on behavioural and interaction rules by using approaches based on artificial agents designed…

Adaptation and Self-Organizing Systems · Physics 2009-03-04 Gianfranco Minati

In sequential machine teaching, a teacher's objective is to provide the optimal sequence of inputs to sequential learners in order to guide them towards the best model. In this paper we extend this setting from current static one-data-set…

Machine Learning · Computer Science 2020-09-15 Mustafa Mert Celikok , Pierre-Alexandre Murena , Samuel Kaski

In the present day we use machine learning for sensitive tasks that require models to be both understandable and robust. Although traditional models such as decision trees are understandable, they suffer from adversarial attacks. When a…

Machine Learning · Computer Science 2020-12-21 Daniël Vos , Sicco Verwer

On-policy imitation learning algorithms such as DAgger evolve a robot control policy by executing it, measuring performance (loss), obtaining corrective feedback from a supervisor, and generating the next policy. As the loss between…

Robotics · Computer Science 2019-07-10 Jonathan N. Lee , Michael Laskey , Ajay Kumar Tanwani , Anil Aswani , Ken Goldberg

We derive the equations of motion describing the feedback control of quantum systems in the regime of "good control", in which the control is sufficient to keep the system close to the desired state. One can view this regime as the quantum…

Quantum Physics · Physics 2009-03-23 Juliang Li , Kurt Jacobs

A model of an organism as an autonomous intelligent system has been proposed. This model was used to analyze learning of an organism in various environmental conditions. Processes of learning were divided into two types: strong and weak…

Artificial Intelligence · Computer Science 2007-05-23 Alexey V. Melkikh

Making the right decision in traffic is a challenging task that is highly dependent on individual preferences as well as the surrounding environment. Therefore it is hard to model solely based on expert knowledge. In this work we use Deep…

Machine Learning · Computer Science 2020-02-04 Peter Wolf , Karl Kurzer , Tobias Wingert , Florian Kuhnt , J. Marius Zöllner

The quintessential model-based reinforcement-learning agent iteratively refines its estimates or prior beliefs about the true underlying model of the environment. Recent empirical successes in model-based reinforcement learning with…

Machine Learning · Computer Science 2022-06-07 Dilip Arumugam , Benjamin Van Roy

Social norms are powerful formalism in coordinating autonomous agents' behaviour to achieve certain objectives. In this paper, we propose a dynamic normative system to enable the reasoning of the changes of norms under different…

Artificial Intelligence · Computer Science 2016-04-19 Xiaowei Huang , Ji Ruan , Qingliang Chen , Kaile Su