English
Related papers

Related papers: Assessor-Guided Learning for Continual Environment…

200 papers

We introduce a new unsupervised pretraining objective for reinforcement learning. During the unsupervised reward-free pretraining phase, the agent maximizes mutual information between tasks and states induced by the policy. Our key…

Machine Learning · Computer Science 2021-09-01 Hao Liu , Pieter Abbeel

Deep Reinforcement Learning (DeepRL) methods have been widely used in robotics to learn about the environment and acquire behaviors autonomously. Deep Interactive Reinforcement Learning (DeepIRL) includes interactive feedback from an…

Robotics · Computer Science 2021-11-19 Hung Son Nguyen , Francisco Cruz , Richard Dazeley

Continual learning aims to acquire new tasks while preserving performance on previously learned ones, but most methods struggle with catastrophic forgetting. Existing approaches typically treat all layers uniformly, often trading stability…

Machine Learning · Computer Science 2025-12-29 Hengyi Wu , Zhenyi Wang , Heng Huang

Reinforcement Learning (RL) offers a powerful paradigm for autonomous robots to master generalist manipulation skills through trial-and-error. However, its real-world application is stifled by low sample efficiency. Recent Human-in-the-Loop…

Robotics · Computer Science 2026-03-10 Haojun Chen , Zili Zou , Chengdong Ma , Yaoxiang Pu , Haotong Zhang , Yuanpei Chen , Yaodong Yang

Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In particular the online or "single-pass through the data" setting…

Machine Learning · Computer Science 2019-10-31 Rahaf Aljundi , Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Min Lin , Laurent Charlin , Tinne Tuytelaars

Generalization is often regarded as an essential property of machine learning systems. However, perhaps not every component of a system needs to generalize. Training models for generalization typically produces entangled representations at…

Machine Learning · Computer Science 2026-02-24 David Rawlinson , Gideon Kowadlo

Sampling is ubiquitous in machine learning methodologies. Due to the growth of large datasets and model complexity, we want to learn and adapt the sampling process while training a representation. Towards achieving this grand goal, a…

Machine Learning · Computer Science 2022-12-14 Jason Xiaotian Dou , Alvin Qingkai Pan , Runxue Bao , Haiyi Harry Mao , Lei Luo , Zhi-Hong Mao

Automated speaking assessment (ASA) typically involves automatic speech recognition (ASR) and hand-crafted feature extraction from the ASR transcript of a learner's speech. Recently, self-supervised learning (SSL) has shown stellar…

Sound · Computer Science 2025-03-04 Tien-Hong Lo , Fu-An Chao , Tzu-I Wu , Yao-Ting Sung , Berlin Chen

Humans can continuously learn new knowledge. However, machine learning models suffer from drastic dropping in performance on previous tasks after learning new tasks. Cognitive science points out that the competition of similar knowledge is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Runqi Wang , Yuxiang Bao , Baochang Zhang , Jianzhuang Liu , Wentao Zhu , Guodong Guo

In E-learning, there is still the problem of knowing how to ensure an individualized and continuous learner's follow-up during learning process, indeed among the numerous tools proposed, very few systems concentrate on a real time learner's…

Artificial Intelligence · Computer Science 2012-10-01 Abdelhamid Zouhair , El Mokhtar En-Naimi , Benaissa Amami , Hadhoum Boukachour , Patrick Person , Cyrille Bertelle

This paper presents simple and efficient methods to mitigate sampling bias in active learning while achieving state-of-the-art accuracy and model robustness. We introduce supervised contrastive active learning by leveraging the contrastive…

Machine Learning · Computer Science 2021-09-15 Ranganath Krishnan , Alok Sinha , Nilesh Ahuja , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

In stream-based active learning, the learning procedure typically has access to a stream of unlabeled data instances and must decide for each instance whether to label it and use it for training or to discard it. There are numerous active…

Machine Learning · Computer Science 2022-03-10 Michael Katz , Eli Kravchik

In continual learning, where task data arrives in a sequence, fine-tuning on later tasks will often lead to performance degradation on earlier tasks. This is especially pronounced when these tasks come from diverse domains. In this setting,…

Machine Learning · Computer Science 2025-01-13 Anat Kleiman , Gintare Karolina Dziugaite , Jonathan Frankle , Sham Kakade , Mansheej Paul

A good state representation is crucial to solving complicated reinforcement learning (RL) challenges. Many recent works focus on designing auxiliary losses for learning informative representations. Unfortunately, these handcrafted…

Machine Learning · Computer Science 2022-10-13 Tairan He , Yuge Zhang , Kan Ren , Minghuan Liu , Che Wang , Weinan Zhang , Yuqing Yang , Dongsheng Li

Classification using supervised learning requires annotating a large amount of classes-balanced data for model training and testing. This has practically limited the scope of applications with supervised learning, in particular deep…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Hao Zhen , Yucheng Shi , Jidong J. Yang , Javad Mohammadpour Vehni

Most recent test-time adaptation methods focus on only classification tasks, use specialized network architectures, destroy model calibration or rely on lightweight information from the source domain. To tackle these issues, this paper…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Devavrat Tomar , Guillaume Vray , Behzad Bozorgtabar , Jean-Philippe Thiran

This poster presents the conceptual framework of the Adaptive Learning Guidance System ALGS. The system aims to propose a model for adaptive learning environments where two major concerns arising from past studies are being addressed; the…

Computers and Society · Computer Science 2019-11-19 Ghada El-Hadad , Doaa Shawky , Ashraf Badawi

Active Learning (AL) aims to reduce annotation costs by strategically selecting the most informative samples for labeling. However, most active learning methods struggle in the low-budget regime where only a few labeled examples are…

Machine Learning · Computer Science 2025-04-08 Netta Shafir , Guy Hacohen , Daphna Weinshall

Forgetting presents a significant challenge during incremental training, making it particularly demanding for contemporary AI systems to assimilate new knowledge in streaming data environments. To address this issue, most approaches in…

Machine Learning · Computer Science 2024-08-27 Monica Millunzi , Lorenzo Bonicelli , Angelo Porrello , Jacopo Credi , Petter N. Kolm , Simone Calderara

We study the problem of sample efficient reinforcement learning, where prior data such as demonstrations are provided for initialization in lieu of a dense reward signal. A natural approach is to incorporate an imitation learning objective,…

Machine Learning · Computer Science 2025-06-10 Perry Dong , Alec M. Lessing , Annie S. Chen , Chelsea Finn