English
Related papers

Related papers: APS: Active Pretraining with Successor Features

200 papers

In reinforcement learning, unsupervised skill discovery aims to learn diverse skills without extrinsic rewards. Previous methods discover skills by maximizing the mutual information (MI) between states and skills. However, such an MI…

Machine Learning · Computer Science 2023-05-09 Rushuai Yang , Chenjia Bai , Hongyi Guo , Siyuan Li , Bin Zhao , Zhen Wang , Peng Liu , Xuelong Li

We introduce ASPiRe (Adaptive Skill Prior for RL), a new approach that leverages prior experience to accelerate reinforcement learning. Unlike existing methods that learn a single skill prior from a large and diverse dataset, our framework…

Machine Learning · Computer Science 2022-10-03 Mengda Xu , Manuela Veloso , Shuran Song

The ability to discover behaviours from past experience and transfer them to new tasks is a hallmark of intelligent agents acting sample-efficiently in the real world. Equipping embodied reinforcement learners with the same ability may be…

Artificial Intelligence · Computer Science 2023-04-26 Sasha Salter , Kristian Hartikainen , Walter Goodwin , Ingmar Posner

Animals have a developed ability to explore that aids them in important tasks such as locating food, exploring for shelter, and finding misplaced items. These exploration skills necessarily track where they have been so that they can plan…

Machine Learning · Computer Science 2023-06-27 Arnav Kumar Jain , Lucas Lehnert , Irina Rish , Glen Berseth

In real-world applications, machine learning models face online label shift, where label distributions change over time. Effective adaptation requires careful learning rate selection: too low slows adaptation and too high causes…

Machine Learning · Computer Science 2025-08-20 Heewon Park , Mugon Joe , Miru Kim , Minhae Kwon

Humans and animals show remarkable flexibility in adjusting their behaviour when their goals, or rewards in the environment change. While such flexibility is a hallmark of intelligent behaviour, these multi-task scenarios remain an…

Artificial Intelligence · Computer Science 2020-01-13 Tamas J. Madarasz

Language models (LMs) are typically post-trained for desired capabilities and behaviors via weight-based or prompt-based steering, but the former is time-consuming and expensive, and the latter is not precisely controllable and often…

Computation and Language · Computer Science 2026-05-18 Sasha Cui , Zhongren Chen

Deep reinforcement learning (deep RL) has achieved superior performance in complex sequential tasks by using deep neural networks as function approximators to learn directly from raw input images. However, learning directly from raw images…

Machine Learning · Computer Science 2019-07-31 Gabriel V. de la Cruz , Yunshu Du , Matthew E. Taylor

Animals need to devise strategies to maximize returns while interacting with their environment based on incoming noisy sensory observations. Task-relevant states, such as the agent's location within an environment or the presence of a…

Machine Learning · Statistics 2019-06-25 Eszter Vertes , Maneesh Sahani

This paper proposes an assessor-guided learning strategy for continual learning where an assessor guides the learning process of a base learner by controlling the direction and pace of the learning process thus allowing an efficient…

Machine Learning · Computer Science 2023-03-22 Muhammad Anwar Ma'sum , Mahardhika Pratama , Edwin Lughofer , Weiping Ding , Wisnu Jatmiko

Current reinforcement learning (RL) in robotics often experiences difficulty in generalizing to new downstream tasks due to the innate task-specific training paradigm. To alleviate it, unsupervised RL, a framework that pre-trains the agent…

Robotics · Computer Science 2022-10-13 Daesol Cho , Jigang Kim , H. Jin Kim

A framework is introduced for actively and adaptively solving a sequence of machine learning problems, which are changing in bounded manner from one time step to the next. An algorithm is developed that actively queries the labels of the…

Machine Learning · Computer Science 2018-05-31 Yuheng Bu , Jiaxun Lu , Venugopal V. Veeravalli

Data scarcity poses a serious threat to modern machine learning and artificial intelligence, as their practical success typically relies on the availability of big datasets. One effective strategy to mitigate the issue of insufficient data…

Machine Learning · Computer Science 2026-05-14 Chaozhi Zhang , Lin Liu , Xiaoqun Zhang

Recent advances in person re-identification have demonstrated enhanced discriminability, especially with supervised learning or transfer learning. However, since the data requirements---including the degree of data curations---are becoming…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Kshitij Nikhal , Benjamin S. Riggan

Existing approaches to active learning maximize the system performance by sampling unlabeled instances for annotation that yield the most efficient training. However, when active learning is integrated with an end-user application, this can…

Computation and Language · Computer Science 2020-05-13 Ji-Ung Lee , Christian M. Meyer , Iryna Gurevych

Following the pivotal success of learning strategies to win at tasks, solely by interacting with an environment without any supervision, agents have gained the ability to make sequential decisions in complex MDPs. Yet, reinforcement…

Machine Learning · Computer Science 2026-03-18 Ezgi Korkmaz

Mixed cooperative-competitive control scenarios such as human-machine interaction with individual goals of the interacting partners are very challenging for reinforcement learning agents. In order to contribute towards intuitive…

Systems and Control · Electrical Eng. & Systems 2020-03-03 Florian Köpf , Alexander Nitsch , Michael Flad , Sören Hohmann

Many speech enhancement methods try to learn the relationship between noisy and clean speech, obtained using an acoustic room simulator. We point out several limitations of enhancement methods relying on clean speech targets; the goal of…

Computation and Language · Computer Science 2018-12-26 Geonmin Kim , Hwaran Lee , Bo-Kyeong Kim , Sang-Hoon Oh , Soo-Young Lee

When deploying artificial agents in real-world environments where they interact with humans, it is crucial that their behavior is aligned with the values, social norms or other requirements of that environment. However, many environments…

Machine Learning · Computer Science 2023-05-05 Mattijs Baert , Pietro Mazzaglia , Sam Leroux , Pieter Simoens

In recent years, deep reinforcement learning has been shown to be adept at solving sequential decision processes with high-dimensional state spaces such as in the Atari games. Many reinforcement learning problems, however, involve…

Machine Learning · Computer Science 2018-06-05 Yiming Zhang , Quan Ho Vuong , Kenny Song , Xiao-Yue Gong , Keith W. Ross