English
Related papers

Related papers: Uncertainty-aware transfer across tasks using hybr…

200 papers

In reinforcement learning, universal successor features (SFs) are a way to provide zero-shot adaptation to new tasks at test time: they provide optimal policies for all downstream reward functions lying in the linear span of a set of base…

Machine Learning · Computer Science 2025-02-18 Yann Ollivier

We propose an efficient knowledge transfer approach for model-based reinforcement learning, addressing the challenge of deploying large world models in resource-constrained environments. Our method distills a high-capacity multi-task agent…

Machine Learning · Computer Science 2025-07-04 Dmytro Kuzmenko , Nadiya Shvai

Multi-task learning (MTL) is frequently used in settings where a target task has to be learnt based on limited training data, but knowledge can be leveraged from related auxiliary tasks. While MTL can improve task performance overall…

Machine Learning · Computer Science 2020-12-18 Rafael Peres da Silva , Chayaporn Suphavilai , Niranjan Nagarajan

In sequential decision-making (SDM) tasks, methods like reinforcement learning (RL) and heuristic search have made notable advances in specific cases. However, they often require extensive exploration and face challenges in generalizing…

Machine Learning · Computer Science 2024-10-11 Xue Yan , Yan Song , Xidong Feng , Mengyue Yang , Haifeng Zhang , Haitham Bou Ammar , Jun Wang

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

Robotics · Computer Science 2024-10-17 Yiannis Kantaros , Jun Wang

Developing an agent in reinforcement learning (RL) that is capable of performing complex control tasks directly from high-dimensional observation such as raw pixels is yet a challenge as efforts are made towards improving sample efficiency…

Machine Learning · Computer Science 2023-01-13 Thanh Nguyen , Tung M. Luu , Thang Vu , Chang D. Yoo

This paper introduces a novel approach for multi-task regression that connects Kernel Machines (KMs) and Extreme Learning Machines (ELMs) through the exploitation of the Random Fourier Features (RFFs) approximation of the RBF kernel. In…

We consider the problem of quantifying uncertainty over expected cumulative rewards in model-based reinforcement learning. In particular, we focus on characterizing the variance over values induced by a distribution over MDPs. Previous work…

Machine Learning · Computer Science 2023-03-08 Carlos E. Luis , Alessandro G. Bottero , Julia Vinogradska , Felix Berkenkamp , Jan Peters

Mastering multiple tasks through exploration and learning in an environment poses a significant challenge in reinforcement learning (RL). Unsupervised RL has been introduced to address this challenge by training policies with intrinsic…

Machine Learning · Computer Science 2024-07-02 Junkai Zhang , Weitong Zhang , Dongruo Zhou , Quanquan Gu

As instruction-tuned large language models (LLMs) evolve, aligning pretrained foundation models presents increasing challenges. Existing alignment strategies, which typically leverage diverse and high-quality data sources, often overlook…

Computation and Language · Computer Science 2024-06-10 Yikun Wang , Rui Zheng , Liang Ding , Qi Zhang , Dahua Lin , Dacheng Tao

In this paper, we study the Tiered Reinforcement Learning setting, a parallel transfer learning framework, where the goal is to transfer knowledge from the low-tier (source) task to the high-tier (target) task to reduce the exploration risk…

Machine Learning · Computer Science 2024-06-14 Jiawei Huang , Niao He

Vision-based reinforcement learning (RL) is a promising approach to solve control tasks involving images as the main observation. State-of-the-art RL algorithms still struggle in terms of sample efficiency, especially when using image…

Machine Learning · Computer Science 2021-10-05 Elie Aljalbout , Maximilian Ulmer , Rudolph Triebel

We seek to understand what facilitates sample-efficient learning from historical datasets for sequential decision-making, a problem that is popularly known as offline reinforcement learning (RL). Further, we are interested in algorithms…

Machine Learning · Computer Science 2024-02-07 Thanh Nguyen-Tang , Raman Arora

The ability of a reinforcement learning (RL) agent to learn about many reward functions at the same time has many potential benefits, such as the decomposition of complex tasks into simpler ones, the exchange of information between tasks,…

Machine Learning · Computer Science 2018-12-20 Diana Borsa , André Barreto , John Quan , Daniel Mankowitz , Rémi Munos , Hado van Hasselt , David Silver , Tom Schaul

One of the main challenges in real-world reinforcement learning is to learn successfully from limited training samples. We show that in certain settings, the available data can be dramatically increased through a form of multi-task…

Machine Learning · Computer Science 2021-02-19 Desmond Cai , Shiau Hong Lim , Laura Wynter

Feature transformation enhances downstream task performance by generating informative features through mathematical feature crossing. Despite the advancements in deep learning, feature transformation remains essential for structured data,…

Machine Learning · Computer Science 2026-03-02 Tao Zhe , Huazhen Fang , Kunpeng Liu , Qian Lou , Tamzidul Hoque , Dongjie Wang

In many reinforcement learning (RL) applications, the observation space is specified by human developers and restricted by physical realizations, and may thus be subject to dramatic changes over time (e.g. increased number of observable…

Machine Learning · Computer Science 2022-04-07 Yanchao Sun , Ruijie Zheng , Xiyao Wang , Andrew Cohen , Furong Huang

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

Machine Learning · Statistics 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei

Feature Transformation is crucial for classic machine learning that aims to generate feature combinations to enhance the performance of downstream tasks from a data-centric perspective. Current methodologies, such as manual expert-driven…

Machine Learning · Computer Science 2025-03-27 Tianqi He , Xiaohan Huang , Yi Du , Qingqing Long , Ziyue Qiao , Min Wu , Yanjie Fu , Yuanchun Zhou , Meng Xiao

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

Machine Learning · Computer Science 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen