English
Related papers

Related papers: POWERPLAY: Training an Increasingly General Proble…

200 papers

We present a general framework for evolutionary learning to emergent unbiased state representation without any supervision. Evolutionary frameworks such as self-play converge to bad local optima in case of multi-agent reinforcement learning…

Machine Learning · Statistics 2023-02-03 Shohei Ohsawa

The ability to autonomously explore and resolve tasks with minimal human guidance is crucial for the self-development of embodied intelligence. Although reinforcement learning methods can largely ease human effort, it's challenging to…

Robotics · Computer Science 2024-12-19 Changxin Huang , Yanbin Chang , Junfan Lin , Junyang Liang , Runhao Zeng , Jianqiang Li

Computational complexity is a core theory of computer science, which dictates the degree of difficulty of computation. There are many problems with high complexity that we have to deal, which is especially true for AI. This raises a big…

Computational Complexity · Computer Science 2023-01-10 Chuyu Xiong

Continual learning (CL) provides a framework for training models in ever-evolving environments. Although re-occurrence of previously seen objects or tasks is common in real-world problems, the concept of repetition in the data stream is not…

Human beings are particularly good at reasoning and inference from just a few examples. When facing new tasks, humans will leverage knowledge and skills learned before, and quickly integrate them with the new task. In addition to learning…

Artificial Intelligence · Computer Science 2019-09-30 Hua Huang , Adrian Barbu

Replaying data is a principal mechanism underlying the stability and data efficiency of off-policy reinforcement learning (RL). We present an effective yet simple framework to extend the use of replays across multiple experiments, minimally…

Continual learning is an online paradigm where a learner continually accumulates knowledge from different tasks encountered over sequential time steps. Importantly, the learner is required to extend and update its knowledge without…

Machine Learning · Statistics 2025-10-16 Tameem Adel

Reinforcement learning has emerged as a powerful paradigm for unlocking reasoning capabilities in language models. However, relying on sparse rewards makes this process highly sample-inefficient, as models must navigate vast search spaces…

Machine Learning · Computer Science 2026-05-11 Ilia Mahrooghi , Aryo Lotfi , Emmanuel Abbe

The availability of large idea repositories (e.g., the U.S. patent database) could significantly accelerate innovation and discovery by providing people with inspiration from solutions to analogous problems. However, finding useful…

Computation and Language · Computer Science 2017-06-20 Tom Hope , Joel Chan , Aniket Kittur , Dafna Shahaf

Continual learning is an emerging topic in the field of deep learning, where a model is expected to learn continuously for new upcoming tasks without forgetting previous experiences. This field has witnessed numerous advancements, but few…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Aupendu Kar , Krishnendu Ghosh , Prabir Kumar Biswas

Compositional generalization is a basic and essential intellective capability of human beings, which allows us to recombine known parts readily. However, existing neural network based models have been proven to be extremely deficient in…

Artificial Intelligence · Computer Science 2020-10-27 Qian Liu , Shengnan An , Jian-Guang Lou , Bei Chen , Zeqi Lin , Yan Gao , Bin Zhou , Nanning Zheng , Dongmei Zhang

Assistive agents should make humans' lives easier. Classically, such assistance is studied through the lens of inverse reinforcement learning, where an assistive agent (e.g., a chatbot, a robot) infers a human's intention and then selects…

Artificial Intelligence · Computer Science 2025-01-17 Vivek Myers , Evan Ellis , Sergey Levine , Benjamin Eysenbach , Anca Dragan

Exploration in environments with sparse rewards has been a persistent problem in reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and manually shaping a reward function can result in suboptimal…

Machine Learning · Computer Science 2018-02-27 Ashvin Nair , Bob McGrew , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

To solve a new task from minimal experience, it is essential to effectively reuse knowledge from previous tasks, a problem known as meta-learning. Compositional solutions, where common elements of computation are flexibly recombined into…

Machine Learning · Computer Science 2025-10-03 Jacob J. W. Bakermans , Pablo Tano , Reidar Riveland , Charles Findling , Alexandre Pouget

To make good decisions in the real world people need efficient planning strategies because their computational resources are limited. Knowing which planning strategies would work best for people in different situations would be very useful…

Artificial Intelligence · Computer Science 2021-02-02 Saksham Consul , Lovis Heindrich , Jugoslav Stojcheski , Falk Lieder

Recent developments in sequential experimental design look to construct a policy that can efficiently navigate the design space, in a way that maximises the expected information gain. Whilst there is work on achieving tractable policies for…

Machine Learning · Computer Science 2025-08-20 Yasir Zubayr Barlas , Kizito Salako

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Existing work on continual learning (CL) is primarily devoted to developing algorithms for models trained from scratch. Despite their encouraging performance on contrived benchmarks, these algorithms show dramatic performance drops in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Kuan-Ying Lee , Yuanyi Zhong , Yu-Xiong Wang

Reinforcement learning (RL) has improved the reasoning abilities of large language models (LLMs), yet state-of-the-art methods still fail to learn on many training problems. On hard problems, on-policy RL rarely explores even a single…

Machine Learning · Computer Science 2026-01-27 Yuxiao Qu , Amrith Setlur , Virginia Smith , Ruslan Salakhutdinov , Aviral Kumar

Generating explanation to explain its behavior is an essential capability for a robotic teammate. Explanations help human partners better understand the situation and maintain trust of their teammates. Prior work on robot generating…

Artificial Intelligence · Computer Science 2019-02-05 Yu Zhang , Mehrdad Zakershahrak