English
Related papers

Related papers: Improving Robustness of AlphaZero Algorithms to Te…

200 papers

In this paper we aim to provide analysis and insights (often based on visualization), which explain the beneficial effects of on-line decision making on top of off-line training. In particular, through a unifying abstract mathematical…

Optimization and Control · Mathematics 2023-01-05 Dimitri Bertsekas

Planning and reinforcement learning are two key approaches to sequential decision making. Multi-step approximate real-time dynamic programming, a recently successful algorithm class of which AlphaZero [Silver et al., 2018] is an example,…

Artificial Intelligence · Computer Science 2020-05-18 Thomas M. Moerland , Anna Deichler , Simone Baldi , Joost Broekens , Catholijn M. Jonker

Typical constraints on embedded systems include code size limits, upper bounds on energy consumption and hard or soft deadlines. To meet these requirements, it may be necessary to improve the software by applying various kinds of…

Performance · Computer Science 2010-11-30 Hugues Cassé , Karine Heydemann , Haluk Ozaktas , Jonathan Ponroy , Christine Rochange , Olivier Zendra

Recently, AlphaZero has achieved landmark results in deep reinforcement learning, by providing a single self-play architecture that learned three different games at super human level. AlphaZero is a large and complicated system with many…

Artificial Intelligence · Computer Science 2021-01-11 Hui Wang , Mike Preuss , Aske Plaat

Traditional approaches to the design of multi-agent navigation algorithms consider the environment as a fixed constraint, despite the obvious influence of spatial constraints on agents' performance. Yet hand-designing improved environment…

Robotics · Computer Science 2022-09-26 Zhan Gao , Amanda Prorok

AlphaZero has been very successful in many games. Unfortunately, it still consumes a huge amount of computing resources, the majority of which is spent in self-play. Hyperparameter tuning exacerbates the training cost since each…

Artificial Intelligence · Computer Science 2020-03-16 Ti-Rong Wu , Ting-Han Wei , I-Chen Wu

Traditional reinforcement learning (RL) environments typically are the same for both the training and testing phases. Hence, current RL methods are largely not generalizable to a test environment which is conceptually similar but different…

Machine Learning · Computer Science 2022-07-15 John Tan Chong Min , Mehul Motani

We present a Monte Carlo simulation framework for analysing the risk involved in deploying real-time control systems in safety-critical applications, as well as an algorithm design technique allowing one (in certain situations) to robustify…

Optimization and Control · Mathematics 2022-08-04 Mads R. Bisgaard , Lukas Hewing , Alexander Domahidi

Using a model of the environment, reinforcement learning agents can plan their future moves and achieve superhuman performance in board games like Chess, Shogi, and Go, while remaining relatively sample-efficient. As demonstrated by the…

Machine Learning · Computer Science 2022-01-19 Julien Scholz , Cornelius Weber , Muhammad Burhan Hafez , Stefan Wermter

The largest experiments in machine learning now require resources far beyond the budget of all but a few institutions. Fortunately, it has recently been shown that the results of these huge experiments can often be extrapolated from the…

Machine Learning · Computer Science 2021-04-16 Andy L. Jones

Recent years have witnessed significant progress in reinforcement learning, especially with Zero-like paradigms, which have greatly boosted the generalization and reasoning abilities of large-scale language models. Nevertheless, existing…

Machine Learning · Computer Science 2026-03-24 Ruitong Li , Aisheng Mo , Guowei Su , Ru Zhang , Binjie Guo , Haohan Jiang , Xurong Lin , Hongyan Wei , Jie Li , Zhiyuan Qian , Zhuhao Zhang , Xiaoyuan Cheng

Asset allocation using reinforcement learning has advantages such as flexibility in goal setting and utilization of various information. However, existing asset allocation methods do not consider the following viewpoints in solving the…

Computational Finance · Quantitative Finance 2022-07-07 Jungyu Ahn , Sungwoo Park , Jiwoon Kim , Ju-hong Lee

AlphaZero has achieved impressive performance in deep reinforcement learning by utilizing an architecture that combines search and training of a neural network in self-play. Many researchers are looking for ways to reproduce and improve…

Artificial Intelligence · Computer Science 2021-05-14 Hui Wang , Mike Preuss , Aske Plaat

We are concerned with a situation in which we would like to test multiple hypotheses with tests whose p-values cannot be computed explicitly but can be approximated using Monte Carlo simulation. This scenario occurs widely in practice. We…

Methodology · Statistics 2018-10-17 Axel Gandy , Georg Hahn

We propose a general framework for increasing local stability of Artificial Neural Nets (ANNs) using Robust Optimization (RO). We achieve this through an alternating minimization-maximization procedure, in which the loss of the network is…

Machine Learning · Statistics 2018-05-07 Uri Shaham , Yutaro Yamada , Sahand Negahban

An important emerging application of coding agents is agent optimization: the iterative improvement of a target agent through edit-execute-evaluate cycles. Despite its relevance, the community lacks a systematic understanding of coding…

Artificial Intelligence · Computer Science 2026-05-12 Varun Ursekar , Apaar Shanker , Veronica Chatrath , Yuan Xue , Sam Denton

Planning with options -- a sequence of primitive actions -- has been shown effective in reinforcement learning within complex environments. Previous studies have focused on planning with predefined options or learned options through expert…

Artificial Intelligence · Computer Science 2025-03-24 Po-Wei Huang , Pei-Chiun Peng , Hung Guei , Ti-Rong Wu

In continual learning (CL), an AI agent (e.g., autonomous vehicles or robotics) learns from non-stationary data streams under dynamic environments. For the practical deployment of such applications, it is important to guarantee robustness…

Machine Learning · Computer Science 2024-01-11 Minsu Kim , Walid Saad

Autonomous systems such as self-driving cars and general-purpose robots are safety-critical systems that operate in highly uncertain and dynamic environments. We propose an interactive multi-agent framework where the system-under-design is…

Machine Learning · Computer Science 2021-07-07 Xin Qin , Nikos Aréchiga , Andrew Best , Jyotirmoy Deshmukh

Decision-making agents with planning capabilities have achieved huge success in the challenging domain like Chess, Shogi, and Go. In an effort to generalize the planning ability to the more general tasks where the environment dynamics are…

Artificial Intelligence · Computer Science 2020-06-23 Xuxi Yang , Werner Duvaud , Peng Wei