English
Related papers

Related papers: Visualizing MuZero Models

200 papers

In hierarchical reinforcement learning a major challenge is determining appropriate low-level policies. We propose an unsupervised learning scheme, based on asymmetric self-play from Sukhbaatar et al. (2018), that automatically learns a…

Machine Learning · Computer Science 2018-11-26 Sainbayar Sukhbaatar , Emily Denton , Arthur Szlam , Rob Fergus

In this article, we present a new machine learning model by imitation based on the linguistic description of complex phenomena. The idea consists of, first, capturing the behaviour of human players by creating a computational perception…

Machine Learning · Computer Science 2021-01-08 Clemente Rubio-Manzano , Tomas Lermanda , CLaudia Martinez , Alejandra Segura , Christian Vidal

This paper presents MuGen, a data-driven framework for learning and deploying multi-skill locomotion on humanoid robots. MuGen enables a robot to perform expressive motions like humans under the guidance of example motion sequences. To…

Robotics · Computer Science 2026-05-26 Yusen Feng , Xiang Wang , Heyuan Yao , Zixi Kang , Xinyu Huo , Boyang Yu , Pengyun Qiu , Ruijie Zhao , Baoquan Chen , Libin Liu

A key question in reinforcement learning is how an intelligent agent can generalize knowledge across different inputs. By generalizing across different inputs, information learned for one input can be immediately reused for improving…

Machine Learning · Computer Science 2020-10-06 Lucas Lehnert , Michael L. Littman

Most model-free reinforcement learning methods leverage state representations (embeddings) for generalization, but either ignore structure in the space of actions or assume the structure is provided a priori. We show how a policy can be…

Machine Learning · Computer Science 2019-05-16 Yash Chandak , Georgios Theocharous , James Kostas , Scott Jordan , Philip S. Thomas

We consider the task of building strong but human-like policies in multi-agent decision-making problems, given examples of human behavior. Imitation learning is effective at predicting human actions but may not match the strength of expert…

Multiagent Systems · Computer Science 2022-02-18 Athul Paul Jacob , David J. Wu , Gabriele Farina , Adam Lerer , Hengyuan Hu , Anton Bakhtin , Jacob Andreas , Noam Brown

Recent breakthroughs in Go play and strategic games have witnessed the great potential of reinforcement learning in intelligently scheduling in uncertain environment, but some bottlenecks are also encountered when we generalize this…

Machine Learning · Computer Science 2018-12-27 Xingxing Liang , Qi Wang , Yanghe Feng , Zhong Liu , Jincai Huang

Unsupervised multi-view representation learning has been extensively studied for mining multi-view data. However, some critical challenges remain. On the one hand, the existing methods cannot explore multi-view data comprehensively since…

Artificial Intelligence · Computer Science 2023-09-21 Wei Zhang , Zhaohong Deng , Te Zhang , Kup-Sze Choi , Shitong Wang

While representation and similarity learning have improved the sample efficiency of Reinforcement Learning (RL), they are rarely used to shape policy updates directly in the action space. To bridge this gap, a geometry-aware RL algorithm…

Machine Learning · Computer Science 2026-05-04 Stavros Orfanoudakis , Pedro P. Vergara

In the last years, the DeepMind algorithm AlphaZero has become the state of the art to efficiently tackle perfect information two-player zero-sum games with a win/lose outcome. However, when the win/lose outcome is decided by a final score…

Artificial Intelligence · Computer Science 2023-01-10 Luca Pasqualini , Gianluca Amato , Marco Fantozzi , Rosa Gini , Alessandro Marchetti , Carlo Metta , Francesco Morandin , Maurizio Parton

To enable embodied agents to operate effectively over extended timeframes, it is crucial to develop models that form and access memories to stay contextualized in their environment. In the current paradigm of training transformer-based…

Artificial Intelligence · Computer Science 2025-12-01 Gunshi Gupta , Karmesh Yadav , Zsolt Kira , Yarin Gal , Rahaf Aljundi

Fuzzing is the process of finding security vulnerabilities in input-processing code by repeatedly testing the code with modified inputs. In this paper, we formalize fuzzing as a reinforcement learning problem using the concept of Markov…

Artificial Intelligence · Computer Science 2018-01-16 Konstantin Böttinger , Patrice Godefroid , Rishabh Singh

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Multi-agent reinforcement learning (MARL) algorithms have accomplished remarkable breakthroughs in solving large-scale decision-making tasks. Nonetheless, most existing MARL algorithms are model-free, limiting sample efficiency and…

Machine Learning · Computer Science 2024-05-21 Qihan Liu , Jianing Ye , Xiaoteng Ma , Jun Yang , Bin Liang , Chongjie Zhang

Learning effective representations in image-based environments is crucial for sample efficient Reinforcement Learning (RL). Unfortunately, in RL, representation learning is confounded with the exploratory experience of the agent -- learning…

Machine Learning · Computer Science 2021-07-21 Denis Yarats , Rob Fergus , Alessandro Lazaric , Lerrel Pinto

We propose a novel policy update that combines regularized policy optimization with model learning as an auxiliary loss. The update (henceforth Muesli) matches MuZero's state-of-the-art performance on Atari. Notably, Muesli does so without…

Large-scale AI systems that combine search and learning have reached super-human levels of performance in game-playing, but have also been shown to fail in surprising ways. The brittleness of such models limits their efficacy and…

Artificial Intelligence · Computer Science 2023-02-07 Niko A. Grupen , Michael Hanlon , Alexis Hao , Daniel D. Lee , Bart Selman

Reinforcement learning methods are increasingly used to optimise dialogue policies from experience. Most current techniques are model-free: they directly estimate the utility of various actions, without explicit model of the interaction…

Artificial Intelligence · Computer Science 2013-04-09 Pierre Lison

We study how representation learning can accelerate reinforcement learning from rich observations, such as images, without relying either on domain knowledge or pixel-reconstruction. Our goal is to learn representations that both provide…

Machine Learning · Computer Science 2021-04-08 Amy Zhang , Rowan McAllister , Roberto Calandra , Yarin Gal , Sergey Levine

Recent years have witnessed significant progress in reinforcement learning, especially with Zero-like paradigms, which have greatly boosted the generalization and reasoning abilities of large-scale language models. Nevertheless, existing…

Machine Learning · Computer Science 2026-03-24 Ruitong Li , Aisheng Mo , Guowei Su , Ru Zhang , Binjie Guo , Haohan Jiang , Xurong Lin , Hongyan Wei , Jie Li , Zhiyuan Qian , Zhuhao Zhang , Xiaoyuan Cheng