English
Related papers

Related papers: A Minimum Relative Entropy Principle for Learning …

200 papers

Stochastic optimal control with unknown randomness distributions has been studied for a long time, encompassing robust control, distributionally robust control, and adaptive control. We propose a new episodic Bayesian approach that…

Optimization and Control · Mathematics 2025-06-02 Alexander Shapiro , Enlu Zhou , Yifan Lin , Yuhao Wang

In this paper, we consider a best action identification problem in the stochastic linear bandit setup with a fixed confident constraint. In the considered best action identification problem, instead of minimizing the accumulative regret as…

Machine Learning · Computer Science 2018-12-04 Jun Geng , Lifeng Lai

Complex learning agents are increasingly deployed alongside existing experts, such as human operators or previously trained agents. However, it remains unclear how should learners optimally incorporate certain forms of expert data, which…

Machine Learning · Computer Science 2025-10-10 Daniel Jarne Ornia , Joel Dyer , Nicholas Bishop , Anisoara Calinescu , Michael Wooldridge

In this paper, we provide a general framework for studying multi-agent online learning problems in the presence of delays and asynchronicities. Specifically, we propose and analyze a class of adaptive dual averaging schemes in which agents…

Machine Learning · Computer Science 2022-04-19 Yu-Guan Hsieh , Franck Iutzeler , Jérôme Malick , Panayotis Mertikopoulos

Many biological and cognitive systems do not operate deep within one or other regime of activity. Instead, they are poised at critical points located at phase transitions in their parameter space. The pervasiveness of criticality suggests…

Adaptation and Self-Organizing Systems · Physics 2018-06-04 Miguel Aguilera , Manuel G. Bedia

All biological and artificial agents must learn and make decisions given limits on their ability to process information. As such, a general theory of adaptive behavior should be able to account for the complex interactions between an…

Machine Learning · Computer Science 2023-05-08 Dilip Arumugam , Mark K. Ho , Noah D. Goodman , Benjamin Van Roy

Efforts in this paper seek to combine graph theory with adaptive dynamic programming (ADP) as a reinforcement learning (RL) framework to determine forward-in-time, real-time, approximate optimal controllers for distributed multi-agent…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Huyen Dinh , Patrick Walters , Warren Dixon

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Ilya Nemenman , William Bialek , Rob de Ruyter van Steveninck

We consider the problem of making a set of states invariant for a network of controlled systems. We assume that the subsystems, initially uncoupled, must be interconnected through controllers to be designed with a constraint on the data…

Optimization and Control · Mathematics 2014-09-23 Christoph Kawan , Jean-Charles Delvenne

The paper is devoted to the approximate consensus problem for networks of nonlinear agents with switching topology, noisy and delayed measurements. In contrast to the existing stochastic approximation-based control algorithms (protocols), a…

Systems and Control · Computer Science 2013-06-17 Natalia Amelina , Alexander Fradkov , Yuming Jiang , Dimitrios J. Vergados

This paper presents an approximate method for performing Bayesian inference in models with conditional independence over a decentralized network of learning agents. The method first employs variational inference on each individual learning…

Machine Learning · Computer Science 2014-06-13 Trevor Campbell , Jonathan P. How

The Principle of Maximum Entropy is a rigorous technique for estimating an unknown distribution given partial information while simultaneously minimizing bias. However, an important requirement for applying the principle is that the…

Information Theory · Computer Science 2026-02-03 Kenneth Bogert , Matthew Kothe

A long-lived autonomous agent should be able to respond online to novel instances of tasks from a familiar domain. Acting online requires 'fast' responses, in terms of rapid convergence, especially when the task instance has a short…

Artificial Intelligence · Computer Science 2015-12-15 Benjamin Rosman , Majd Hawasly , Subramanian Ramamoorthy

It has been shown that one can accommodate data (Bayes) and constraints (MaxEnt) in one method, the method of Maximum (relative) Entropy (ME) (Giffin 2007). In this paper we show a complex agent based example of inference with two different…

Methodology · Statistics 2016-09-08 Adom Giffin

Detection rules have traditionally been designed for rational agents that minimize the Bayes risk (average decision cost). With the advent of crowd-sensing systems, there is a need to redesign binary hypothesis testing rules for behavioral…

Artificial Intelligence · Computer Science 2016-10-07 V. Sriram Siddhardh Nadendla , Swastik Brahma , Pramod K. Varshney

We consider the problem of estimating the transition dynamics $T^*$ from near-optimal expert trajectories in the context of offline model-based reinforcement learning. We develop a novel constraint-based method, Inverse Transition Learning,…

Machine Learning · Computer Science 2026-04-29 Leo Benac , Abhishek Sharma , Sonali Parbhoo , Finale Doshi-Velez

We study learning dynamics induced by strategic agents who repeatedly play a game with an unknown payoff-relevant parameter. In each step, an information system estimates a belief distribution of the parameter based on the players'…

Systems and Control · Electrical Eng. & Systems 2020-10-20 Manxi Wu , Saurabh Amin , Asuman Ozdaglar

Given a connected region in two-dimensional space where events of a certain kind occur according to a certain time-varying density, we consider the problem of setting up a network of autonomous mobile agents to detect the occurrence of…

Multiagent Systems · Computer Science 2016-07-05 Rodrigo R. Esch , Fábio Protti , Valmir C. Barbosa

This paper considers the problem of adaptively searching for an unknown target using multiple agents connected through a time-varying network topology. Agents are equipped with sensors capable of fast information processing, and we propose…

Multiagent Systems · Computer Science 2016-11-17 Theodoros Tsiligkaridis

This paper considers real-time control and learning problems for finite-dimensional linear systems under binary-valued and randomly disturbed output observations. This has long been regarded as an open problem because the exact values of…

Systems and Control · Electrical Eng. & Systems 2024-11-12 Lantian Zhang , Lei Guo
‹ Prev 1 3 4 5 6 7 10 Next ›