English
Related papers

Related papers: Sample Complexity of Multi-task Reinforcement Lear…

200 papers

Reinforcement learning provides an automated framework for learning behaviors from high-level reward specifications, but in practice the choice of reward function can be crucial for good results -- while in principle the reward only needs…

Machine Learning · Computer Science 2022-10-19 Abhishek Gupta , Aldo Pacchiano , Yuexiang Zhai , Sham M. Kakade , Sergey Levine

Pretrained Transformer based models finetuned on domain specific corpora have changed the landscape of NLP. However, training or fine-tuning these models for individual tasks can be time consuming and resource intensive. Thus, a lot of…

Reinforcement Learning (RL) algorithms can in principle acquire complex robotic skills by learning from large amounts of data in the real world, collected via trial and error. However, most RL algorithms use a carefully engineered setup in…

Machine Learning · Computer Science 2021-04-23 Abhishek Gupta , Justin Yu , Tony Z. Zhao , Vikash Kumar , Aaron Rovinsky , Kelvin Xu , Thomas Devlin , Sergey Levine

Multi-task learning ideally allows robots to acquire a diverse repertoire of useful skills. However, many multi-task reinforcement learning efforts assume the robot can collect data from all tasks at all times. In reality, the tasks that…

Machine Learning · Computer Science 2022-04-07 Annie Xie , Chelsea Finn

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Qianru Sun , Yaoyao Liu , Zhaozheng Chen , Tat-Seng Chua , Bernt Schiele

We consider a reinforcement learning setting in which the deployment environment is different from the training environment. Applying a robust Markov decision processes formulation, we extend the distributionally robust $Q$-learning…

Machine Learning · Computer Science 2024-08-02 Shengbo Wang , Nian Si , Jose Blanchet , Zhengyuan Zhou

This paper addresses the problem of learning a task from demonstration. We adopt the framework of inverse reinforcement learning, where tasks are represented in the form of a reward function. Our contribution is a novel active learning…

Machine Learning · Computer Science 2013-01-24 Francisco Melo , Manuel Lopes

Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems have been solved in tasks such as game playing and robotics. Unfortunately, the sample complexity of most…

Machine Learning · Computer Science 2020-12-03 Aske Plaat , Walter Kosters , Mike Preuss

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

Robotics · Computer Science 2024-10-17 Yiannis Kantaros , Jun Wang

Multi-task learning by robots poses the challenge of the domain knowledge: complexity of tasks, complexity of the actions required, relationship between tasks for transfer learning. We demonstrate that this domain knowledge can be learned…

Robotics · Computer Science 2022-02-22 Sao Mai Nguyen , Nicolas Duminy , Alexandre Manoury , Dominique Duhaut , Cédric Buche

Unsupervised learning has been widely used in many real-world applications. One of the simplest and most important unsupervised learning models is the Gaussian mixture model (GMM). In this work, we study the multi-task learning problem on…

Machine Learning · Statistics 2025-12-29 Ye Tian , Haolei Weng , Lucy Xia , Yang Feng

We consider transferability estimation, the problem of estimating how well deep learning models transfer from a source to a target task. We focus on regression tasks, which received little previous attention, and propose two simple and…

Machine Learning · Computer Science 2023-12-05 Cuong N. Nguyen , Phong Tran , Lam Si Tung Ho , Vu Dinh , Anh T. Tran , Tal Hassner , Cuong V. Nguyen

Sample efficiency and risk-awareness are central to the development of practical reinforcement learning (RL) for complex decision-making. The former can be addressed by transfer learning and the latter by optimizing some utility function of…

Machine Learning · Computer Science 2021-06-01 Michael Gimelfarb , André Barreto , Scott Sanner , Chi-Guhn Lee

Multimodal meta-learning is a recent problem that extends conventional few-shot meta-learning by generalizing its setup to diverse multimodal task distributions. This setup makes a step towards mimicking how humans make use of a diverse set…

Machine Learning · Computer Science 2021-10-28 Milad Abdollahzadeh , Touba Malekzadeh , Ngai-Man Cheung

Sentence simplification aims to improve readability and understandability, based on several operations such as splitting, deletion, and paraphrasing. However, a valid simplified sentence should also be logically entailed by its input…

Computation and Language · Computer Science 2018-06-20 Han Guo , Ramakanth Pasunuru , Mohit Bansal

One question central to Reinforcement Learning is how to learn a feature representation that supports algorithm scaling and re-use of learned information from different tasks. Successor Features approach this problem by learning a feature…

Artificial Intelligence · Computer Science 2017-08-02 Lucas Lehnert , Stefanie Tellex , Michael L. Littman

Availability of labelled data is the major obstacle to the deployment of deep learning algorithms for computer vision tasks in new domains. The fact that many frameworks adopted to solve different tasks share the same architecture suggests…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Pierluigi Zama Ramirez , Adriano Cardace , Luca De Luigi , Alessio Tonioni , Samuele Salti , Luigi Di Stefano

Sequential sentence classification deals with the categorisation of sentences based on their content and context. Applied to scientific texts, it enables the automatic structuring of research papers and the improvement of academic search…

Computation and Language · Computer Science 2022-03-22 Arthur Brack , Anett Hoppe , Pascal Buschermöhle , Ralph Ewerth

Sparse-reward domains are challenging for reinforcement learning algorithms since significant exploration is needed before encountering reward for the first time. Hierarchical reinforcement learning can facilitate exploration by reducing…

Machine Learning · Computer Science 2020-11-13 Lorenzo Steccanella , Simone Totaro , Damien Allonsius , Anders Jonsson

Multi-task Inverse Reinforcement Learning (IRL) is the problem of inferring multiple reward functions from expert demonstrations. Prior work, built on Bayesian IRL, is unable to scale to complex environments due to computational…

Machine Learning · Computer Science 2018-07-17 Adam Gleave , Oliver Habryka