English
Related papers

Related papers: OptionZero: Planning with Learned Options

200 papers

Model-free reinforcement learning methods such as the Proximal Policy Optimization algorithm (PPO) have successfully applied in complex decision-making problems such as Atari games. However, these methods suffer from high variances and high…

Machine Learning · Computer Science 2018-11-20 Feiyang Pan , Qingpeng Cai , An-Xiang Zeng , Chun-Xiang Pan , Qing Da , Hualin He , Qing He , Pingzhong Tang

Playing board games is considered a major challenge for both humans and AI researchers. Because some complicated board games are quite hard to learn, humans usually begin with playing on smaller boards and incrementally advance to master…

Machine Learning · Computer Science 2021-07-20 Shai Ben-Assayag , Ran El-Yaniv

Self-play has enabled large language models to autonomously improve through self-generated challenges. However, existing self-play methods for vision-language models rely on passive interaction with static image collections, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Jinghan He , Junfeng Fang , Feng Xiong , Zijun Yao , Fei Shen , Haiyun Guo , Jinqiao Wang , Tat-Seng Chua

The training of autonomous agents often requires expensive and unsafe trial-and-error interactions with the environment. Nowadays several data sets containing recorded experiences of intelligent agents performing various tasks, spanning…

Machine Learning · Computer Science 2020-10-06 Giorgio Angelotti , Nicolas Drougard , Caroline Ponzoni Carvalho Chanel

The AlphaZero framework provides a standard way of combining Monte Carlo planning with prior knowledge provided by a previously trained policy-value neural network. AlphaZero usually assumes that the environment on which the neural network…

Artificial Intelligence · Computer Science 2025-10-30 Isidoro Tamassia , Wendelin Böhmer

Path planning plays an essential role in many areas of robotics. Various planning techniques have been presented, either focusing on learning a specific task from demonstrations or retrieving trajectories by optimizing for hand-crafted cost…

Robotics · Computer Science 2018-09-26 Salvatore Virga , Christian Rupprecht , Nassir Navab , Christoph Hennersperger

Advances in reinforcement learning (RL) often rely on massive compute resources and remain notoriously sample inefficient. In contrast, the human brain is able to efficiently learn effective control strategies using limited resources. This…

Machine Learning · Computer Science 2024-01-30 Burcu Küçükoğlu , Walraaf Borkent , Bodo Rueckauer , Nasir Ahmad , Umut Güçlü , Marcel van Gerven

Designing hierarchical reinforcement learning algorithms that exhibit safe behaviour is not only vital for practical applications but also, facilitates a better understanding of an agent's decisions. We tackle this problem in the options…

Artificial Intelligence · Computer Science 2021-07-01 Arushi Jain , Khimya Khetarpal , Doina Precup

In this work we present an empirical study where we demonstrate the possibility of developing an artificial agent that is capable to autonomously explore an experimental scenario. During the exploration, the agent is able to discover and…

Artificial Intelligence · Computer Science 2022-06-07 Gabriele Sartor , Davide Zollo , Marta Cialdea Mayer , Angelo Oddi , Riccardo Rasconi , Vieri Giuliano Santucci

Human beings are particularly good at reasoning and inference from just a few examples. When facing new tasks, humans will leverage knowledge and skills learned before, and quickly integrate them with the new task. In addition to learning…

Artificial Intelligence · Computer Science 2019-09-30 Hua Huang , Adrian Barbu

Multi-agent reinforcement learning (MARL) algorithms have accomplished remarkable breakthroughs in solving large-scale decision-making tasks. Nonetheless, most existing MARL algorithms are model-free, limiting sample efficiency and…

Machine Learning · Computer Science 2024-05-21 Qihan Liu , Jianing Ye , Xiaoteng Ma , Jun Yang , Bin Liang , Chongjie Zhang

Mimicking human behavior to actively learning from general experience and achieve artificial general intelligence has always been a human dream. Recent reinforcement learning (RL) based large-thinking models demonstrate impressive…

Computation and Language · Computer Science 2025-12-04 Xingrun Xing , Zhiyuan Fan , Jie Lou , Guoqi Li , Jiajun Zhang , Debing Zhang

Recent work has shown that, in classification tasks, it is possible to design decision support systems that do not require human experts to understand when to cede agency to a classifier or when to exercise their own agency to achieve…

Machine Learning · Computer Science 2025-10-21 Eleni Straitouri , Stratis Tsirtsis , Ander Artola Velasco , Manuel Gomez-Rodriguez

The options framework in Hierarchical Reinforcement Learning breaks down overall goals into a combination of options or simpler tasks and associated policies, allowing for abstraction in the action space. Ideally, these options can be…

Machine Learning · Computer Science 2022-06-14 Kushal Chauhan , Soumya Chatterjee , Akash Reddy , Balaraman Ravindran , Pradeep Shenoy

The ability to estimate human intentions and interact with human drivers intelligently is crucial for autonomous vehicles to successfully achieve their objectives. In this paper, we propose a game theoretic planning algorithm that models…

Robotics · Computer Science 2023-01-24 Siyu Dai , Sangjae Bae , David Isele

Games are abstractions of the real world, where artificial agents learn to compete and cooperate with other agents. While significant achievements have been made in various perfect- and imperfect-information games, DouDizhu (a.k.a. Fighting…

Artificial Intelligence · Computer Science 2021-06-14 Daochen Zha , Jingru Xie , Wenye Ma , Sheng Zhang , Xiangru Lian , Xia Hu , Ji Liu

Temporal abstractions in the form of options have been shown to help reinforcement learning (RL) agents learn faster. However, despite prior work on this topic, the problem of discovering options through interaction with an environment…

Machine Learning · Computer Science 2021-02-16 Vivek Veeriah , Tom Zahavy , Matteo Hessel , Zhongwen Xu , Junhyuk Oh , Iurii Kemaev , Hado van Hasselt , David Silver , Satinder Singh

AlphaZero has been very successful in many games. Unfortunately, it still consumes a huge amount of computing resources, the majority of which is spent in self-play. Hyperparameter tuning exacerbates the training cost since each…

Artificial Intelligence · Computer Science 2020-03-16 Ti-Rong Wu , Ting-Han Wei , I-Chen Wu

AI can not only outperform people in many planning tasks, but it can also teach them how to plan better. A recent and promising approach to improving human decision-making is to create intelligent tutors that utilize AI to discover and…

Artificial Intelligence · Computer Science 2025-06-24 Lovis Heindrich , Saksham Consul , Falk Lieder

We consider the task of building strong but human-like policies in multi-agent decision-making problems, given examples of human behavior. Imitation learning is effective at predicting human actions but may not match the strength of expert…

Multiagent Systems · Computer Science 2022-02-18 Athul Paul Jacob , David J. Wu , Gabriele Farina , Adam Lerer , Hengyuan Hu , Anton Bakhtin , Jacob Andreas , Noam Brown