English
Related papers

Related papers: A Minimum Relative Entropy Principle for Learning …

200 papers

We introduce a distributed, cooperative framework and method for Bayesian estimation and control in decentralized agent networks. Our framework combines joint estimation of time-varying global and local states with information-seeking…

Systems and Control · Computer Science 2015-09-24 Florian Meyer , Henk Wymeersch , Markus Fröhle , Franz Hlawatsch

Adaptation is used by biological sensory systems to respond to a wide range of environmental signals, by adapting their response properties to the statistics of the stimulus in order to maximize information transmission. We derive rules of…

Neurons and Cognition · Quantitative Biology 2021-04-14 Daniele Conti , Thierry Mora

Building on the idea that lack of experience is a source of errors but that experience should reduce them, we model agents' behavior using a stochastic choice model (logit quantal response), leaving endogenous the accuracy of their choices.…

General Economics · Economics 2025-05-29 Olivier Compte

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

The goal of this paper is to explore the basic Approximate Bayesian Computation (ABC) algorithm via the lens of information theory. ABC is a widely used algorithm in cases where the likelihood of the data is hard to work with or…

Methodology · Statistics 2019-08-14 Konstantinos Spiliopoulos

We consider the problem of controlling the group behavior of a large number of dynamic systems that are constantly interacting with each other. These systems are assumed to have identical dynamics (e.g., birds flock, robot swarm) and their…

Optimization and Control · Mathematics 2021-08-18 Yongxin Chen

This paper studies optimal consensus tracking problem of heterogeneous linear multi-agent systems. By introducing tracking error dynamics, the optimal tracking problem is reformulated as finding a Nash-equilibrium solution of a multi-player…

Optimization and Control · Mathematics 2019-05-21 Jilie Zhang , Zhanshan Wang , Hongwei Zhang

In stochastic optimal control (SOC), uncertainty may arise from incomplete knowledge of the true probability distribution of the underlying environment, which is known as Knightian or epistemic uncertainty. Distributionally robust optimal…

Optimization and Control · Mathematics 2026-04-10 Wentao Ma , Zhiping Chen , Huifu Xu , Enlu Zhou

Efficient approximation lies at the heart of large-scale machine learning problems. In this paper, we propose a novel, robust maximum entropy algorithm, which is capable of dealing with hundreds of moments and allows for computationally…

Machine Learning · Statistics 2019-06-05 Diego Granziol , Binxin Ru , Stefan Zohren , Xiaowen Doing , Michael Osborne , Stephen Roberts

This paper considers the problem of determining an optimal control action based on observed data. We formulate the problem assuming that the system can be modelled by a nonlinear state-space model, but where the model parameters, state and…

Optimization and Control · Mathematics 2021-07-02 Johannes N. Hendriks , James R. Z. Holdsworth , Adrian G. Wills , Thomas B. Schon , Brett Ninness

The survey is concerned with the issue of information transmission from experts to non-experts. Two main approaches to the use of experts can be traced. According to the game-theoretic approach expertise is a case of asymmetric information…

Probability · Mathematics 2008-07-21 Irene Valsecchi

Memory-based meta-learning is a powerful technique to build agents that adapt fast to any task within a target distribution. A previous theoretical study has argued that this remarkable performance is because the meta-training protocol…

Artificial Intelligence · Computer Science 2020-10-23 Vladimir Mikulik , Grégoire Delétang , Tom McGrath , Tim Genewein , Miljan Martic , Shane Legg , Pedro A. Ortega

In this article, we propose a novel pessimism-based Bayesian learning method for optimal dynamic treatment regimes in the offline setting. When the coverage condition does not hold, which is common for offline data, the existing solutions…

Machine Learning · Statistics 2023-02-23 Yunzhe Zhou , Zhengling Qi , Chengchun Shi , Lexin Li

Dropout has recently emerged as a powerful and simple method for training neural networks preventing co-adaptation by stochastically omitting neurons. Dropout is currently not grounded in explicit modelling assumptions which so far has…

Machine Learning · Statistics 2022-05-18 Tue Herlau , Morten Mørup , Mikkel N. Schmidt

In nonstationary bandit learning problems, the decision-maker must continually gather information and adapt their action selection as the latent state of the environment evolves. In each time period, some latent optimal action maximizes…

Machine Learning · Computer Science 2023-12-27 Seungki Min , Daniel Russo

Adapting a Reinforcement Learning (RL) agent to an unseen environment is a difficult task due to typical over-fitting on the training environment. RL agents are often capable of solving environments very close to the trained environment,…

Artificial Intelligence · Computer Science 2022-07-04 Olivier Moulin , Vincent Francois-Lavet , Paul Elbers , Mark Hoogendoorn

In traditional adaptive control, the certainty equivalence principle suggests a two-step design scheme. A controller is first designed for the ideal situation assuming the uncertain parameter was known and it renders a Lyapunov function.…

Systems and Control · Computer Science 2019-04-26 Imil Hamda Imran , Zhiyong Chen , Lijun Zhu , Minyue Fu

This paper derives an optimal control strategy for a simple stochastic dynamical system with constant drift and an additive control input. Motivated by the example of a physical system with an unexpected change in its dynamics, we take the…

Optimization and Control · Mathematics 2022-02-09 Daniel Gurevich , Debdipta Goswami , Charles L. Fefferman , Clarence W. Rowley

We propose a new model to assess the mastery level of a given skill efficiently. The model, called Bayesian Adaptive Mastery Assessment (BAMA), uses information on the accuracy and the response time of the answers given and infers the…

Optimization and Control · Mathematics 2021-03-08 Anni Sapountzi , Sandjai Bhulai , Ilja Cornelisz , Chris van Klaveren

A central challenge in multi-agent reinforcement learning is enabling agents to adapt to previously unseen teammates in a zero-shot fashion. Prior work in zero-shot coordination often follows a two-stage process, first generating a diverse…

Multiagent Systems · Computer Science 2026-02-16 Andrew Ni , Simon Stepputtis , Stefanos Nikolaidis , Michael Lewis , Katia P. Sycara , Woojun Kim