English
Related papers

Related papers: Demystifying MuZero Planning: Interpreting the Lea…

200 papers

In this paper, we present a framework for multi-agent learning in a nonstationary dynamic network environment. More specifically, we examine projected gradient play in smooth monotone repeated network games in which the agents'…

Computer Science and Game Theory · Computer Science 2024-08-13 Feras Al Taha , Kiran Rokade , Francesca Parise

The utilization of artificial intelligence (AI) in card games has been a well-explored subject within AI research for an extensive period. Recent advancements have propelled AI programs to showcase expertise in intricate card games such as…

Artificial Intelligence · Computer Science 2023-12-06 Youpeng Zhao , Yudong Lu , Jian Zhao , Wengang Zhou , Houqiang Li

Intelligent agents need to generalize from past experience to achieve goals in complex environments. World models facilitate such generalization and allow learning behaviors from imagined outcomes to increase sample-efficiency. While…

Machine Learning · Computer Science 2022-02-15 Danijar Hafner , Timothy Lillicrap , Mohammad Norouzi , Jimmy Ba

AlphaZero, an approach to reinforcement learning that couples neural networks and Monte Carlo tree search (MCTS), has produced state-of-the-art strategies for traditional board games like chess, Go, shogi, and Hex. While researchers and…

Artificial Intelligence · Computer Science 2022-11-29 Charles Lovering , Jessica Zosa Forde , George Konidaris , Ellie Pavlick , Michael L. Littman

This paper studies two important signal processing aspects of equilibrium behavior in non-cooperative games arising in social networks, namely, reinforcement learning and detection of equilibrium play. The first part of the paper presents a…

Computer Science and Game Theory · Computer Science 2015-01-07 Omid Namvar Gharehshiran , William Hoiles , Vikram Krishnamurthy

The pursuit of artificial agents that can learn to master complex environments has led to remarkable successes, yet prevailing deep reinforcement learning methods often rely on immense experience, encoding their knowledge opaquely within…

Artificial Intelligence · Computer Science 2025-09-30 Sai Wang , Yu Wu , Zhongwen Xu

Game-based decision-making involves reasoning over both world dynamics and strategic interactions among the agents. Typically, empirical models capturing these respective aspects are learned and used separately. We investigate the potential…

Multiagent Systems · Computer Science 2023-05-24 Max Olan Smith , Michael P. Wellman

The success of AlphaZero (AZ) has demonstrated that neural-network-based Go AIs can surpass human performance by a large margin. Given that the state space of Go is extremely large and a human player can play the game from any legal state,…

Artificial Intelligence · Computer Science 2022-11-08 Li-Cheng Lan , Huan Zhang , Ti-Rong Wu , Meng-Yu Tsai , I-Chen Wu , Cho-Jui Hsieh

In this paper, we examine the convergence landscape of multi-agent learning under uncertainty. Specifically, we analyze two stochastic models of regularized learning in continuous games -- one in continuous and one in discrete time with the…

Computer Science and Game Theory · Computer Science 2025-12-10 Kyriakos Lotidis , Panayotis Mertikopoulos , Nicholas Bambos , Jose Blanchet

World models learn to simulate environment dynamics from experience, enabling sample-efficient reinforcement learning. But what do these models actually represent internally? We apply interpretability techniques--including linear and…

Machine Learning · Computer Science 2026-03-24 Xinyu Zhang

Complex games have long been an important benchmark for testing the progress of artificial intelligence algorithms. AlphaGo, AlphaZero, and MuZero have defeated top human players in Go and Chess, garnering widespread societal attention…

Computation and Language · Computer Science 2025-10-22 Wei Wang , Fuqing Bie , Junzhe Chen , Dan Zhang , Shiyu Huang , Evgeny Kharlamov , Jie Tang

Although AlphaZero has achieved superhuman performance in board games, recent studies reveal its limitations in handling scenarios requiring a comprehensive understanding of the entire board, such as recognizing long-sequence patterns in…

Machine Learning · Computer Science 2025-07-21 Yan-Ru Ju , Tai-Lin Wu , Chung-Chin Shih , Ti-Rong Wu

The game of Go has long served as a benchmark for artificial intelligence, demanding sophisticated strategic reasoning and long-term planning. Previous approaches such as AlphaGo and its successors, have predominantly relied on model-based…

Artificial Intelligence · Computer Science 2026-01-08 Jingbin Liu , Xuechun Wang

Model-based reinforcement learning methods typically learn models for high-dimensional state spaces by aiming to reconstruct and predict the original observations. However, drawing inspiration from model-free reinforcement learning, we…

Machine Learning · Computer Science 2019-12-10 Aaron Havens , Yi Ouyang , Prabhat Nagarajan , Yasuhiro Fujita

Localization is the problem of estimating the location of an autonomous agent from an observation and a map of the environment. Traditional methods of localization, which filter the belief based on the observations, are sub-optimal in the…

Machine Learning · Computer Science 2018-01-29 Devendra Singh Chaplot , Emilio Parisotto , Ruslan Salakhutdinov

The training dynamics of linear networks are well studied in two distinct setups: the lazy regime and balanced/active regime, depending on the initialization and width of the network. We provide a surprisingly simple unifying formula for…

Machine Learning · Computer Science 2024-10-31 Zhenfeng Tu , Santiago Aranguri , Arthur Jacot

This paper explores the use of active and passive learning, i.e.\ active and passive techniques to infer state machine models of systems, for fuzzing. Fuzzing has become a very popular and successful technique to improve the robustness of…

Software Engineering · Computer Science 2024-06-13 Cristian Daniele , Seyed Behnam Andarzian , Erik Poll

Understanding how people behave in strategic settings--where they make decisions based on their expectations about the behavior of others--is a long-standing problem in the behavioral sciences. We conduct the largest study to date of…

General Economics · Economics 2024-08-16 Jian-Qiao Zhu , Joshua C. Peterson , Benjamin Enke , Thomas L. Griffiths

Multi-agent football poses an unsolved challenge in AI research. Existing work has focused on tackling simplified scenarios of the game, or else leveraging expert demonstrations. In this paper, we develop a multi-agent system to play the…

Artificial Intelligence · Computer Science 2023-02-22 Fanqi Lin , Shiyu Huang , Tim Pearce , Wenze Chen , Wei-Wei Tu

In this paper, we propose a novel Deep Reinforcement Learning approach to address the mapless navigation problem, in which the locomotion actions of a humanoid robot are taken online based on the knowledge encoded in learned models.…

Robotics · Computer Science 2021-08-10 Andre Brandenburger , Diego Rodriguez , Sven Behnke