English
Related papers

Related papers: Modularization of End-to-End Learning: Case Study …

200 papers

We have seen much recent progress in rigid object manipulation, but interaction with deformable objects has notably lagged behind. Due to the large configuration space of deformable objects, solutions using traditional modelling approaches…

Robotics · Computer Science 2018-10-09 Jan Matas , Stephen James , Andrew J. Davison

Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment -- where the optimal behaviour is defined…

Complex, multi-task problems have proven to be difficult to solve efficiently in a sparse-reward reinforcement learning setting. In order to be sample efficient, multi-task learning requires reuse and sharing of low-level policies. To…

Machine Learning · Computer Science 2021-09-28 Valerie Chen , Abhinav Gupta , Kenneth Marino

Human beings use compositionality to generalise from past experiences to novel experiences. We assume a separation of our experiences into fundamental atomic components that can be recombined in novel ways to support our ability to engage…

Computation and Language · Computer Science 2023-12-20 Kevin Denamganaï , Sondess Missaoui , James Alfred Walker

Unambiguous identification of the rewards driving behaviours of entities operating in complex open-ended real-world environments is difficult, partly because goals and associated behaviours emerge endogenously and are dynamically updated as…

Machine Learning · Computer Science 2024-05-03 Richard M. Bailey

The widespread adoption of AI chatbots in education will drastically change learning, making responsible deployment a critical concern. While large language models (LLMs) might have access to sources discussing insights from educational…

Artificial Intelligence · Computer Science 2026-05-29 Julius Gabelmann , Felix Jahn , Kevin Baum , Sophie van Rossum , Emely Wuenscher , Timo P. Gros , Verena Wolf

Reinforcement learning (RL) is successful at learning to play games where the entire environment is visible. However, RL approaches are challenged in complex games like Starcraft II and in real-world environments where the entire…

Machine Learning · Computer Science 2021-08-13 Elizabeth Gilmour , Noah Plotkin , Leslie Smith

A key challenge in model-based reinforcement learning (RL) is to synthesize computationally efficient and accurate environment models. We show that carefully designed generative models that learn and operate on compact state…

Achieving efficient and scalable exploration in complex domains poses a major challenge in reinforcement learning. While Bayesian and PAC-MDP approaches to the exploration problem offer strong formal guarantees, they are often impractical…

Artificial Intelligence · Computer Science 2015-11-23 Bradly C. Stadie , Sergey Levine , Pieter Abbeel

A number of machine learning models have been proposed with the goal of achieving systematic generalization: the ability to reason about new situations by combining aspects of previous experiences. These models leverage compositional…

Machine Learning · Computer Science 2024-09-24 Devon Jarvis , Richard Klein , Benjamin Rosman , Andrew M. Saxe

Vision-based robotics often separates the control loop into one module for perception and a separate module for control. It is possible to train the whole system end-to-end (e.g. with deep RL), but doing it "from scratch" comes with a high…

Robotics · Computer Science 2020-11-16 Bryan Chen , Alexander Sax , Gene Lewis , Iro Armeni , Silvio Savarese , Amir Zamir , Jitendra Malik , Lerrel Pinto

Much of human dialogue occurs in semi-cooperative settings, where agents with different goals attempt to agree on common decisions. Negotiations require complex communication and reasoning skills, but success is easy to measure, making this…

Artificial Intelligence · Computer Science 2017-06-19 Mike Lewis , Denis Yarats , Yann N. Dauphin , Devi Parikh , Dhruv Batra

Large scale systems are forecasted to greatly impact our future lives thanks to their wide ranging applications including cooperative robotics, mobility on demand, resource allocation, supply chain management. While technological…

Optimization and Control · Mathematics 2024-12-20 Dario Paccagnan

TD-learning is a foundation reinforcement learning (RL) algorithm for value prediction. Critical to the accuracy of value predictions is the quality of state representations. In this work, we consider the question: how does end-to-end…

Machine Learning · Computer Science 2023-05-31 Yunhao Tang , Rémi Munos

Learning interpretable and transferable subpolicies and performing task decomposition from a single, complex task is difficult. Some traditional hierarchical reinforcement learning techniques enforce this decomposition in a top-down manner,…

Machine Learning · Computer Science 2019-03-06 Bohan Wu , Jayesh K. Gupta , Mykel J. Kochenderfer

As discussed in previous studies, the efficacy of evolutionary or reinforcement learning algorithms for continuous control optimization can be enhanced by including a neural module dedicated to feature extraction trained through…

Machine Learning · Computer Science 2021-06-09 Nicola Milano , Stefano Nolfi

Humans excel at applying learned behavior to unlearned situations. A crucial component of this generalization behavior is our ability to compose/decompose a whole into reusable parts, an attribute known as compositionality. One of the…

Artificial Intelligence · Computer Science 2024-07-24 Prasanna Vijayaraghavan , Jeffrey Frederic Queisser , Sergio Verduzco Flores , Jun Tani

Despite significant progress on multi-agent reinforcement learning (MARL) in recent years, coordination in complex domains remains a challenge. Work in MARL often focuses on solving tasks where agents interact with all other agents and…

Machine Learning · Computer Science 2022-09-27 Shariq Iqbal , Robby Costales , Fei Sha

The increasing use of complex machine learning models in education has led to concerns about their interpretability, which in turn has spurred interest in developing explainability techniques that are both faithful to the model's inner…

Machine Learning · Computer Science 2025-05-13 Juan D. Pinto , Luc Paquette

In the future, artificial learning agents are likely to become increasingly widespread in our society. They will interact with both other learning agents and humans in a variety of complex settings including social dilemmas. We consider the…

Computer Science and Game Theory · Computer Science 2019-11-21 Tobias Baumann , Thore Graepel , John Shawe-Taylor