English
Related papers

Related papers: Active Fine-Tuning of Multi-Task Policies

200 papers

The optimal policy of a reinforcement learning problem is often discontinuous and non-smooth. I.e., for two states with similar representations, their optimal policies can be significantly different. In this case, representing the entire…

Machine Learning · Computer Science 2020-02-10 Zhimin Hou , Kuangen Zhang , Yi Wan , Dongyu Li , Chenglong Fu , Haoyong Yu

Multi-task learning, in which several tasks are jointly learned by a single model, allows NLP models to share information from multiple annotations and may facilitate better predictions when the tasks are inter-related. This technique,…

Computation and Language · Computer Science 2022-10-31 Guy Rotman , Roi Reichart

Multitask learning assumes that models capable of learning from multiple tasks can achieve better quality and efficiency via knowledge transfer, a key feature of human learning. Though, state of the art ML models rely on high customization…

Machine Learning · Computer Science 2022-11-17 Andrea Gesmundo , Jeff Dean

Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's…

Machine Learning · Computer Science 2021-02-04 Mirza Ramicic , Andrea Bonarini

Nature is in constant flux, so animals must account for changes in their environment when making decisions. How animals learn the timescale of such changes and adapt their decision strategies accordingly is not well understood. Recent…

Neurons and Cognition · Quantitative Biology 2018-12-24 Zachary P. Kilpatrick , William R. Holmes , Tahra L. Eissa , Krešimir Josić

Learning robotic tasks in the real world is still highly challenging and effective practical solutions remain to be found. Traditional methods used in this area are imitation learning and reinforcement learning, but they both have…

Machine Learning · Computer Science 2022-08-02 Abdalkarim Mohtasib , Gerhard Neumann , Heriberto Cuayahuitl

When we can not assume a large amount of annotated data , active learning is a good strategy. It consists in learning a model on a small amount of annotated data (annotation budget) and in choosing the best set of points to annotate in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Umang Aggarwal , Adrian Popescu , Céline Hudelot

Human agents routinely reason on instances with incomplete and muddied data (and weigh the cost of obtaining further features). In contrast, much of ML is devoted to the unrealistic, sterile environment where all features are observed and…

Machine Learning · Computer Science 2024-10-08 Yang Li , Junier Oliva

Before taking actions in an environment with more than one intelligent agent, an autonomous agent may benefit from reasoning about the other agents and utilizing a notion of a guarantee or confidence about the behavior of the system. In…

Machine Learning · Computer Science 2024-02-12 Nikunj Gupta , Somjit Nath , Samira Ebrahimi Kahou

Learning from demonstration (LfD) is an intuitive framework allowing non-expert users to easily (re-)program robots. However, the quality and quantity of demonstrations have a great influence on the generalization performances of LfD…

Robotics · Computer Science 2020-08-07 Hakan Girgin , Emmanuel Pignat , Noémie Jaquier , Sylvain Calinon

Flow-matching policies have emerged as a powerful paradigm for generalist robotics. These models are trained to imitate an action chunk, conditioned on sensor observations and textual instructions. Often, training demonstrations are…

Machine Learning · Computer Science 2025-07-22 Samuel Pfrommer , Yixiao Huang , Somayeh Sojoudi

Learning in a lifelong setting, where the dynamics continually evolve, is a hard challenge for current reinforcement learning algorithms. Yet this would be a much needed feature for practical applications. In this paper, we propose an…

Machine Learning · Computer Science 2021-12-14 Pierre Liotet , Francesco Vidaich , Alberto Maria Metelli , Marcello Restelli

Conventional reinforcement learning (RL) methods can successfully solve a wide range of sequential decision problems. However, learning policies that can generalize predictably across multiple tasks in a setting with non-Markovian reward…

Machine Learning · Computer Science 2024-06-04 Guillermo Infante , David Kuric , Anders Jonsson , Vicenç Gómez , Herke van Hoof

Team adaptation to new cooperative tasks is a hallmark of human intelligence, which has yet to be fully realized in learning agents. Previous work on multi-agent transfer learning accommodate teams of different sizes, heavily relying on the…

Artificial Intelligence · Computer Science 2022-03-10 Rongjun Qin , Feng Chen , Tonghan Wang , Lei Yuan , Xiaoran Wu , Zongzhang Zhang , Chongjie Zhang , Yang Yu

A practical challenge in reinforcement learning are combinatorial action spaces that make planning computationally demanding. For example, in cooperative multi-agent reinforcement learning, a potentially large number of agents jointly…

Self-assessment rules play an essential role in safe and effective real-world robotic applications, which verify the feasibility of the selected action before actual execution. But how to utilize the self-assessment results to re-choose…

Robotics · Computer Science 2023-02-28 Kechun Xu , Runjian Chen , Shuqi Zhao , Zizhang Li , Hongxiang Yu , Ci Chen , Yue Wang , Rong Xiong

Multi-task learning (MTL) has been successfully used in many real-world applications, which aims to simultaneously solve multiple tasks with a single model. The general idea of multi-task learning is designing kinds of global parameter…

Machine Learning · Computer Science 2023-01-24 Xuewen Tao , Mingming Ha , Xiaobo Guo , Qiongxu Ma , Hongwei Cheng , Wenfang Lin

Moving away from repetitive tasks, robots nowadays demand versatile skills that adapt to different situations. Task-parameterized learning improves the generalization of motion policies by encoding relevant contextual information in the…

Robotics · Computer Science 2022-01-26 Jihong Zhu , Michael Gienger , Jens Kober

To leverage the power of big data from source tasks and overcome the scarcity of the target task samples, representation learning based on multi-task pretraining has become a standard approach in many applications. However, up until now,…

Machine Learning · Computer Science 2022-02-03 Yifang Chen , Simon S. Du , Kevin Jamieson

Data-efficient learning algorithms are essential in many practical applications where data collection is expensive, e.g., in robotics due to the wear and tear. To address this problem, meta-learning algorithms use prior experience about…

Machine Learning · Computer Science 2020-10-26 Jean Kaddour , Steindór Sæmundsson , Marc Peter Deisenroth