English
Related papers

Related papers: No-Regret Strategy Solving in Imperfect-Informatio…

200 papers

Understanding a student's problem-solving strategy can have a significant impact on effective math learning using Intelligent Tutoring Systems (ITSs) and Adaptive Instructional Systems (AISs). For instance, the ITS/AIS can better…

Machine Learning · Computer Science 2023-11-14 Anup Shakya , Vasile Rus , Deepak Venugopal

We study an online forecasting setting in which, over $T$ rounds, $N$ strategic experts each report a forecast to a mechanism, the mechanism selects one forecast, and then the outcome is revealed. In any given round, each expert has a…

Machine Learning · Computer Science 2025-02-18 Junpei Komiyama , Nishant A. Mehta , Ali Mortazavi

Immersed finite element methods provide a convenient analysis framework for problems involving geometrically complex domains, such as those found in topology optimization and microstructures for engineered materials. However, their…

Numerical Analysis · Mathematics 2025-01-30 Nils Wunsch , Keenan Doble , Mathias R. Schmidt , Lise Noël , John A. Evans , Kurt Maute

We present a new algorithm based on posterior sampling for learning in constrained Markov decision processes (CMDP) in the infinite-horizon undiscounted setting. The algorithm achieves near-optimal regret bounds while being advantageous…

Machine Learning · Computer Science 2023-09-28 Danil Provodin , Pratik Gajane , Mykola Pechenizkiy , Maurits Kaptein

We study online learning settings in which experts act strategically to maximize their influence on the learning algorithm's predictions by potentially misreporting their beliefs about a sequence of binary events. Our goal is twofold.…

Machine Learning · Computer Science 2020-07-02 Rupert Freeman , David M. Pennock , Chara Podimata , Jennifer Wortman Vaughan

This paper considers repeated games in which one player has more information about the game than the other players. In particular, we investigate repeated two-player zero-sum games where only the column player knows the payoff matrix A of…

Computer Science and Game Theory · Computer Science 2023-02-16 Le Cong Dinh , Long Tran-Thanh , Tri-Dung Nguyen , Alain B. Zemkoho

This paper investigates the challenge of learning in black-box games, where the underlying utility function is unknown to any of the agents. While there is an extensive body of literature on the theoretical analysis of algorithms for…

Machine Learning · Computer Science 2024-11-15 Minbiao Han , Fengxue Zhang , Yuxin Chen

Embodied AI has made significant progress acting in unexplored environments. However, tasks such as object search have largely focused on efficient policy learning. In this work, we identify several gaps in current search methods: They…

The current state of the art in playing many important perfect information games, including Chess and Go, combines planning and deep reinforcement learning with self-play. We extend this approach to imperfect information games and present…

Artificial Intelligence · Computer Science 2018-10-26 Andy Kitchen , Michela Benedetti

We study fine-grained gap-dependent regret bounds for model-free reinforcement learning in episodic tabular Markov Decision Processes. Existing model-free algorithms achieve minimax worst-case regret, but their gap-dependent bounds remain…

Machine Learning · Statistics 2025-10-09 Haochen Zhang , Zhong Zheng , Lingzhou Xue

Estimating discrete games of complete information is often computationally difficult due to partial identification and the absence of closed-form moment characterizations. This paper proposes computationally tractable approaches to…

Econometrics · Economics 2025-10-02 Paul S. Koh

In the context of multi-player, general-sum games, there is an increasing interest in solution concepts modeling some form of communication among players, since they can lead to socially better outcomes with respect to Nash equilibria, and…

Computer Science and Game Theory · Computer Science 2019-10-15 Andrea Celli , Alberto Marchesi , Tommaso Bianchi , Nicola Gatti

The success of deep learning partially benefits from the availability of various large-scale datasets. These datasets are often crowdsourced from individual users and contain private information like gender, age, etc. The emerging privacy…

Machine Learning · Computer Science 2020-09-01 Ang Li , Yixiao Duan , Huanrui Yang , Yiran Chen , Jianlei Yang

For each of $T$ time steps, $m$ experts report probability distributions over $n$ outcomes; we wish to learn to aggregate these forecasts in a way that attains a no-regret guarantee. We focus on the fundamental and practical aggregation…

Machine Learning · Computer Science 2023-10-11 Eric Neyman , Tim Roughgarden

We establish the first uncoupled learning algorithm that attains $O(n \log^2 d \log T)$ per-player regret in multi-player general-sum games, where $n$ is the number of players, $d$ is the number of actions available to each player, and $T$…

Computer Science and Game Theory · Computer Science 2025-04-01 Ashkan Soleymani , Georgios Piliouras , Gabriele Farina

Under the uncoupled learning setup, the last-iterate convergence guarantee towards Nash equilibrium is shown to be impossible in many games. This work studies the last-iterate convergence guarantee in general games toward rationalizability,…

Computer Science and Game Theory · Computer Science 2023-12-27 Jibang Wu , Haifeng Xu , Fan Yao

Training large language model (LLM) agents for adversarial games is often driven by episodic objectives such as win rate. In long-horizon settings, however, payoffs are shaped by latent strategic externalities that evolve over time, so…

Machine Learning · Computer Science 2026-02-10 Boyang Xia , Weiyou Tian , Qingnan Ren , Jiaqi Huang , Jie Xiao , Shuo Lu , Kai Wang , Lynn Ai , Eric Yang , Bill Shi

Scarcity of data and incremental learning of new tasks pose two major bottlenecks for many modern computer vision algorithms. The phenomenon of catastrophic forgetting, i.e., the model's inability to classify previously learned data after…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanchar Palit , Biplab Banerjee , Subhasis Chaudhuri

Recent years have witnessed a burgeoning interest in federated learning (FL). However, the contexts in which clients engage in sequential learning remain under-explored. Bridging FL and continual learning (CL) gives rise to a challenging…

Machine Learning · Computer Science 2025-02-21 Abudukelimu Wuerkaixi , Sen Cui , Jingfeng Zhang , Kunda Yan , Bo Han , Gang Niu , Lei Fang , Changshui Zhang , Masashi Sugiyama

Real-world games, which concern imperfect information, multiple players, and simultaneous moves, are less frequently discussed in the existing literature of game theory. While reinforcement learning (RL) provides a general framework to…

Computer Science and Game Theory · Computer Science 2023-06-02 Runyu Lu , Yuanheng Zhu , Dongbin Zhao