English
Related papers

Related papers: Sample-efficient Reinforcement Learning Representa…

200 papers

As representation learning becomes a powerful technique to reduce sample complexity in reinforcement learning (RL) in practice, theoretical understanding of its advantage is still limited. In this paper, we theoretically characterize the…

Machine Learning · Computer Science 2022-06-14 Yuan Cheng , Songtao Feng , Jing Yang , Hong Zhang , Yingbin Liang

We introduce EfficientCL, a memory-efficient continual pretraining method that applies contrastive learning with novel data augmentation and curriculum learning. For data augmentation, we stack two types of operation sequentially: cutoff…

Computation and Language · Computer Science 2021-10-19 Seonghyeon Ye , Jiseon Kim , Alice Oh

Contrastive learning has proven instrumental in learning unbiased representations of data, especially in complex environments characterized by high-cardinality and high-dimensional sensitive information. However, existing approaches within…

Machine Learning · Computer Science 2024-11-25 Stefan K. Nielsen , Tan M. Nguyen

Meta-reinforcement learning (meta-RL) is a promising framework for tackling challenging domains requiring efficient exploration. Existing meta-RL algorithms are characterized by low sample efficiency, and mostly focus on low-dimensional…

Machine Learning · Computer Science 2024-03-18 Zohar Rimon , Tom Jurgenson , Orr Krupnik , Gilad Adler , Aviv Tamar

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

Machine Learning · Computer Science 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han

Contrastive self-supervised learning (CSL) has managed to match or surpass the performance of supervised learning in image and video classification. However, it is still largely unknown if the nature of the representations induced by the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Rohit Gupta , Naveed Akhtar , Ajmal Mian , Mubarak Shah

Contrastive learning has gained popularity and pushes state-of-the-art performance across numerous large-scale benchmarks. In contrastive learning, the contrastive loss function plays a pivotal role in discerning similarities between…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Haojin Deng , Yimin Yang

Self-supervised skeleton-based action recognition enjoys a rapid growth along with the development of contrastive learning. The existing methods rely on imposing invariance to augmentations of 3D skeleton within a single data stream, which…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ding Li , Yongqiang Tang , Zhizhong Zhang , Wensheng Zhang

Behavioral Foundation Models (BFMs) produce agents with the capability to adapt to any unknown reward or task. These methods, however, are only able to produce near-optimal policies for the reward functions that are in the span of some…

Artificial Intelligence · Computer Science 2026-03-18 Pranaya Jajoo , Harshit Sikchi , Siddhant Agarwal , Amy Zhang , Scott Niekum , Martha White

Training sophisticated agents for optimal decision-making under uncertainty has been key to the rapid development of modern autonomous systems across fields. Notably, model-free reinforcement learning (RL) has enabled decision-making agents…

Machine Learning · Computer Science 2025-07-21 Thomas Banker , Ali Mesbah

Model-free deep reinforcement learning (RL) agents can learn an effective policy directly from repeated interactions with a black-box environment. However in practice, the algorithms often require large amounts of training experience to…

Machine Learning · Computer Science 2020-05-29 Parth Chadha

Recent curriculum Reinforcement Learning (RL) has shown notable progress in solving complex tasks by proposing sequences of surrogate tasks. However, the previous approaches often face challenges when they generate curriculum goals in a…

Machine Learning · Computer Science 2023-10-27 Seungjae Lee , Daesol Cho , Jonghae Park , H. Jin Kim

Learning representations for reinforcement learning (RL) has shown much promise for continuous control. We propose an efficient representation learning method using only a self-supervised latent-state consistency loss. Our approach employs…

Machine Learning · Computer Science 2024-06-06 Aidan Scannell , Kalle Kujanpää , Yi Zhao , Mohammadreza Nakhaei , Arno Solin , Joni Pajarinen

Flow matching models have shown great potential in image generation tasks among probabilistic generative models. However, most flow matching models in the literature do not explicitly utilize the underlying clustering structure in the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Anirban Samaddar , Yixuan Sun , Viktor Nilsson , Sandeep Madireddy

Standard regression techniques, while powerful, are often constrained by predefined, differentiable loss functions such as mean squared error. These functions may not fully capture the desired behavior of a system, especially when dealing…

Machine Learning · Computer Science 2025-08-04 Yongchao Huang

Class Incremental Learning (CIL) constitutes a pivotal subfield within continual learning, aimed at enabling models to progressively learn new classification tasks while retaining knowledge obtained from prior tasks. Although previous…

Machine Learning · Computer Science 2025-01-14 Jaeill Kim , Wonseok Lee , Moonjung Eo , Wonjong Rhee

In Reinforcement Learning (RL), agents aim at maximizing cumulative rewards in a given environment. During the learning process, RL agents face the dilemma of exploitation and exploration: leveraging existing knowledge to acquire rewards or…

Machine Learning · Computer Science 2023-10-24 Chenfan Weng , Zhongguo Li

Reinforcement learning (RL) algorithms allow artificial agents to improve their selection of actions to increase rewarding experiences in their environments. Temporal Difference (TD) Learning -- a model-free RL method -- is a leading…

Machine Learning · Computer Science 2019-09-05 Jacob Rafati , David C. Noelle

Deep reinforcement learning (DRL) is a promising approach for adaptive robot control, but its current application to robotics is currently hindered by high sample requirements. We propose two novel data augmentation techniques for DRL in…

Artificial Intelligence · Computer Science 2019-11-18 Yijiong Lin , Jiancong Huang , Matthieu Zimmer , Juan Rojas , Paul Weng

Nowadays, model-free reinforcement learning algorithms have achieved remarkable performance on many decision making and control tasks, but high sample complexity and low sample efficiency still hinder the wide use of model-free…

Artificial Intelligence · Computer Science 2020-10-27 Jingbin Liu , Xinyang Gu , Shuai Liu