English
Related papers

Related papers: Endogenous Barriers to Learning

200 papers

We consider the problem of security-aware planning in an unknown stochastic environment, in the presence of attacks on control signals (i.e., actuators) of the robot. We model the attacker as an agent who has the full knowledge of the…

Robotics · Computer Science 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Miroslav Pajic

We consider the problem of contextual bandits and imitation learning, where the learner lacks direct knowledge of the executed action's reward. Instead, the learner can actively query an expert at each round to compare two actions and…

Machine Learning · Computer Science 2023-07-25 Ayush Sekhari , Karthik Sridharan , Wen Sun , Runzhe Wu

Exploration in unknown environments is a fundamental problem in reinforcement learning and control. In this work, we study task-guided exploration and determine what precisely an agent must learn about their environment in order to complete…

Machine Learning · Computer Science 2021-07-13 Andrew Wagenmaker , Max Simchowitz , Kevin Jamieson

We analyze inertial coordination games: dynamic coordination games with an endogenously changing state that depends on (i) a persistent fundamental players privately learn about over time; and (ii) past play. The speed of learning…

Theoretical Economics · Economics 2025-08-14 Andrew Koh , Ricky Li , Kei Uzui

We consider an online stochastic game with risk-averse agents whose goal is to learn optimal decisions that minimize the risk of incurring significantly high costs. Specifically, we use the Conditional Value at Risk (CVaR) as a risk measure…

Machine Learning · Computer Science 2022-06-17 Zifan Wang , Yi Shen , Michael M. Zavlanos

The effectiveness of collective decision-making is often challenged by the bounded rationality and inherent stochasticity of individual agents. We investigate this by analyzing how to aggregate decisions from n experts, each receiving a…

Computer Science and Game Theory · Computer Science 2026-03-17 Zhihuan Huang , Yichong Xia , Yuqing Kong

Decision makers often aim to learn a treatment assignment policy under a capacity constraint on the number of agents that they can treat. When agents can respond strategically to such policies, competition arises, complicating estimation of…

Machine Learning · Statistics 2025-03-31 Roshni Sahoo , Stefan Wager

People are often reluctant to sell a house, or shares of stock, below the price at which they originally bought it. While this is generally not consistent with rational utility maximization, it does reflect two strong empirical regularities…

Computer Science and Game Theory · Computer Science 2021-06-02 Jon Kleinberg , Robert Kleinberg , Sigal Oren

Reinforcement learning in multiagent systems has been studied in the fields of economic game theory, artificial intelligence and statistical physics by developing an analytical understanding of the learning dynamics (often in relation to…

Multiagent Systems · Computer Science 2019-06-25 Wolfram Barfuss , Jonathan F. Donges , Jürgen Kurths

We propose a learning dynamics to model how strategic agents repeatedly play a continuous game while relying on an information platform to learn an unknown payoff-relevant parameter. In each time step, the platform updates a belief estimate…

Multiagent Systems · Computer Science 2023-11-02 Manxi Wu , Saurabh Amin , Asuman Ozdaglar

We consider model selection for sequential decision making in stochastic environments with bandit feedback, where a meta-learner has at its disposal a pool of base learners, and decides on the fly which action to take based on the policies…

Machine Learning · Computer Science 2024-01-24 Aldo Pacchiano , Christoph Dann , Claudio Gentile

In this paper, we consider the problem of path finding for a set of homogeneous and autonomous agents navigating a previously unknown stochastic environment. In our problem setting, each agent attempts to maximize a given utility function…

Multiagent Systems · Computer Science 2022-12-06 Sheryl Paul , Jyotirmoy V. Deshmukh

A striking limitation of human cognition is our inability to execute some tasks simultaneously. Recent work suggests that such limitations can arise from a fundamental tradeoff in network architectures that is driven by the sharing of…

Neurons and Cognition · Quantitative Biology 2020-07-08 Yotam Sagiv , Sebastian Musslick , Yael Niv , Jonathan D. Cohen

We consider the problem where M agents collaboratively interact with an instance of a stochastic K-armed contextual bandit, where K>>M. The goal of the agents is to simultaneously minimize the cumulative regret over all the agents over a…

Machine Learning · Computer Science 2022-11-16 Jiabin Lin , Shana Moothedath

In this paper, we consider a learning problem among non-cooperative agents interacting in a time-varying system. Specifically, we focus on repeated linear quadratic network games, in which the network of interactions changes with time and…

Computer Science and Game Theory · Computer Science 2023-10-23 Feras Al Taha , Kiran Rokade , Francesca Parise

In this work, we investigate the problem of adapting to the presence or absence of causal structure in multi-armed bandit problems. In addition to the usual reward signal, we assume the learner has access to additional variables, observed…

Machine Learning · Computer Science 2024-07-02 Ziyi Liu , Idan Attias , Daniel M. Roy

Online decision-making can be formulated as the popular stochastic multi-armed bandit problem where a learner makes decisions (or takes actions) to maximize cumulative rewards collected from an unknown environment. This paper proposes to…

Systems and Control · Electrical Eng. & Systems 2025-11-26 Jonathan Gornet , Mehdi Hosseinzadeh , Bruno Sinopoli

We study a sequential resource allocation problem motivated by adaptive network recruitment, in which a limited budget of identical resources must be allocated over multiple rounds to individuals with stochastic referral capacity.…

Artificial Intelligence · Computer Science 2026-05-13 Yuqi Pan , Davin Choo , Haichuan Wang , Milind Tambe , Alastair van Heerden , Cheryl Johnson

We tackle a fundamental problem in empirical game-theoretic analysis (EGTA), that of learning equilibria of simulation-based games. Such games cannot be described in analytical form; instead, a black-box simulator can be queried to obtain…

Computer Science and Game Theory · Computer Science 2019-06-03 Enrique Areyan Viqueira , Cyrus Cousins , Eli Upfal , Amy Greenwald

Consider a decision-maker that can pick one out of $K$ actions to control an unknown system, for $T$ turns. The actions are interpreted as different configurations or policies. Holding the same action fixed, the system asymptotically…

Machine Learning · Computer Science 2023-02-28 Siddharth Chandak , Ilai Bistritz , Nicholas Bambos