English
Related papers

Related papers: Accelerating and Improving AlphaZero Using Populat…

200 papers

We propose Batch-Expansion Training (BET), a framework for running a batch optimizer on a gradually expanding dataset. As opposed to stochastic approaches, batches do not need to be resampled i.i.d. at every iteration, thus making BET more…

Machine Learning · Computer Science 2018-02-26 Michał Dereziński , Dhruv Mahajan , S. Sathiya Keerthi , S. V. N. Vishwanathan , Markus Weimer

In this work, we propose algorithms and methods that enable learning dexterous object manipulation using simulated one- or two-armed robots equipped with multi-fingered hand end-effectors. Using a parallel GPU-accelerated physics simulator…

Robotics · Computer Science 2023-05-23 Aleksei Petrenko , Arthur Allshire , Gavriel State , Ankur Handa , Viktor Makoviychuk

Artificial intelligence (AI) has achieved superhuman performance in board games such as Go, chess, and Othello (Reversi). In other words, the AI system surpasses the level of a strong human expert player in such games. In this context, it…

Machine Learning · Computer Science 2022-09-21 Kazuhisa Fujita

Training deep learning models can be computationally expensive. Prior works have shown that increasing the batch size can potentially lead to better overall throughput. However, the batch size is frequently limited by the accelerator memory…

Machine Learning · Computer Science 2023-01-25 Muralidhar Andoorveedu , Zhanda Zhu , Bojian Zheng , Gennady Pekhimenko

Generating high-quality code that solves complex programming tasks is challenging, especially with current decoder-based models that produce highly stochastic outputs. In code generation, even minor errors can easily break the entire…

Computation and Language · Computer Science 2025-04-15 Nikita Sorokin , Ivan Sedykh , Valentin Malykh

Reviewing the previous work of diversity Rein-forcement Learning,diversity is often obtained via an augmented loss function,which requires a balance between reward and diversity.Generally,diversity optimization algorithms use Multi-armed…

Machine Learning · Computer Science 2024-03-19 Jingcheng Jiang , Haiyin Piao , Yu Fu , Yihang Hao , Chuanlu Jiang , Ziqi Wei , Xin Yang

AlphaZero, an approach to reinforcement learning that couples neural networks and Monte Carlo tree search (MCTS), has produced state-of-the-art strategies for traditional board games like chess, Go, shogi, and Hex. While researchers and…

Artificial Intelligence · Computer Science 2022-11-29 Charles Lovering , Jessica Zosa Forde , George Konidaris , Ellie Pavlick , Michael L. Littman

The success of AlphaZero (AZ) has demonstrated that neural-network-based Go AIs can surpass human performance by a large margin. Given that the state space of Go is extremely large and a human player can play the game from any legal state,…

Artificial Intelligence · Computer Science 2022-11-08 Li-Cheng Lan , Huan Zhang , Ti-Rong Wu , Meng-Yu Tsai , I-Chen Wu , Cho-Jui Hsieh

The game of chess is the most widely-studied domain in the history of artificial intelligence. The strongest programs are based on a combination of sophisticated search techniques, domain-specific adaptations, and handcrafted evaluation…

In this paper, a novel racing environment for OpenAI Gym is introduced. This environment operates with continuous action- and state-spaces and requires agents to learn to control the acceleration and steering of a car while navigating a…

Machine Learning · Computer Science 2020-01-16 Mario S. Holubar , Marco A. Wiering

Playing board games is considered a major challenge for both humans and AI researchers. Because some complicated board games are quite hard to learn, humans usually begin with playing on smaller boards and incrementally advance to master…

Machine Learning · Computer Science 2021-07-20 Shai Ben-Assayag , Ran El-Yaniv

In the last years, the DeepMind algorithm AlphaZero has become the state of the art to efficiently tackle perfect information two-player zero-sum games with a win/lose outcome. However, when the win/lose outcome is decided by a final score…

Artificial Intelligence · Computer Science 2023-01-10 Luca Pasqualini , Gianluca Amato , Marco Fantozzi , Rosa Gini , Alessandro Marchetti , Carlo Metta , Francesco Morandin , Maurizio Parton

We investigate the effect of using human demonstration data in the replay buffer for Deep Reinforcement Learning. We use a policy gradient method with a modified experience replay buffer where a human demonstration experience is sampled…

Artificial Intelligence · Computer Science 2021-07-15 Dylan Klein , Akansel Cosgun

Using a model of the environment, reinforcement learning agents can plan their future moves and achieve superhuman performance in board games like Chess, Shogi, and Go, while remaining relatively sample-efficient. As demonstrated by the…

Machine Learning · Computer Science 2022-01-19 Julien Scholz , Cornelius Weber , Muhammad Burhan Hafez , Stefan Wermter

We introduce a new unsupervised pre-training method for reinforcement learning called APT, which stands for Active Pre-Training. APT learns behaviors and representations by actively searching for novel states in reward-free environments.…

Machine Learning · Computer Science 2021-10-29 Hao Liu , Pieter Abbeel

Deep Reinforcement Learning reaches a superhuman level of play in many complete information games. The state of the art algorithm for learning with zero knowledge is AlphaZero. We take another approach, Ath\'enan, which uses a different,…

Artificial Intelligence · Computer Science 2026-04-24 Quentin Cohen-Solal , Tristan Cazenave

Constructing agents with planning capabilities has long been one of the main challenges in the pursuit of artificial intelligence. Tree-based planning methods have enjoyed huge success in challenging domains, such as chess and Go, where a…

We develop a method of adapting the AlphaZero model to General Game Playing (GGP) that focuses on faster model generation and requires less knowledge to be extracted from the game rules. The dataset generation uses MCTS playing instead of…

Artificial Intelligence · Computer Science 2023-12-22 Michał Maras , Michał Kępa , Jakub Kowalski , Marek Szykuła

Despite recent innovations in network architectures and loss functions, training RNNs to learn long-term dependencies remains difficult due to challenges with gradient-based optimisation methods. Inspired by the success of Deep…

Machine Learning · Statistics 2019-05-24 Bryan Lim , Stefan Zohren , Stephen Roberts

Meta-learning models, or models that learn to learn, have been a long-desired target for their ability to quickly solve new tasks. Traditional meta-learning methods can require expensive inner and outer loops, thus there is demand for…

Neural and Evolutionary Computing · Computer Science 2021-03-12 Kevin Frans , Olaf Witkowski