English
Related papers

Related papers: EUCLID: Towards Efficient Unsupervised Reinforceme…

200 papers

Multi-UAV pursuit-evasion, where pursuers aim to capture evaders, poses a key challenge for UAV swarm intelligence. Multi-agent reinforcement learning (MARL) has demonstrated potential in modeling cooperative behaviors, but most RL-based…

Robotics · Computer Science 2025-07-09 Jiayu Chen , Chao Yu , Guosheng Li , Wenhao Tang , Shilong Ji , Xinyi Yang , Botian Xu , Huazhong Yang , Yu Wang

We propose UnCLe, the first standardized benchmark for Unsupervised Continual Learning of a multimodal 3D reconstruction task: Depth completion aims to infer a dense depth map from a pair of synchronized RGB image and sparse depth map. We…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Xien Chen , Rit Gangopadhyay , Michael Chu , Patrick Rim , Hyoungseob Park , Alex Wong

In this paper we consider self-supervised representation learning to improve sample efficiency in reinforcement learning (RL). We propose a forward prediction objective for simultaneously learning embeddings of states and action sequences.…

Machine Learning · Computer Science 2020-01-15 William Whitney , Rajat Agarwal , Kyunghyun Cho , Abhinav Gupta

Reward-free data is abundant and contains rich prior knowledge of human behaviors, but it is not well exploited by offline reinforcement learning (RL) algorithms. In this paper, we propose UBER, an unsupervised approach to extract useful…

Machine Learning · Computer Science 2023-10-31 Hao Hu , Yiqin Yang , Jianing Ye , Ziqing Mai , Chongjie Zhang

Visual navigation is a task of training an embodied agent by intelligently navigating to a target object (e.g., television) using only visual observations. A key challenge for current deep reinforcement learning models lies in the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Juncheng Li , Xin Wang , Siliang Tang , Haizhou Shi , Fei Wu , Yueting Zhuang , William Yang Wang

Unsupervised domain adaptation (UDA) deals with the adaptation process of a model to an unlabeled target domain while annotated data is only available for a given source domain. This poses a challenging task, as the domain shift between…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Tobias Ringwald , Rainer Stiefelhagen

Unsupervised video class incremental learning (uVCIL) represents an important learning paradigm for learning video information without forgetting, and without considering any data labels. Prior approaches have focused on supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Nattapong Kurpukdee , Adrian G. Bors

Scaling RL for LLMs is computationally expensive, largely due to multi-sampling for policy optimization and evaluation, making efficient data selection crucial. Inspired by the Zone of Proximal Development (ZPD) theory, we hypothesize LLMs…

Machine Learning · Computer Science 2025-05-20 Yang Zhao , Kai Xiong , Xiao Ding , Li Du , YangouOuyang , Zhouhao Sun , Jiannan Guan , Wenbin Zhang , Bin Liu , Dong Hu , Bing Qin , Ting Liu

By leveraging data from a fully labeled source domain, unsupervised domain adaptation (UDA) improves classification performance on an unlabeled target domain through explicit discrepancy minimization of data distribution or adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Shengjia Zhang , Tiancheng Lin , Yi Xu

Learning in multi-agent systems is highly challenging due to several factors including the non-stationarity introduced by agents' interactions and the combinatorial nature of their state and action spaces. In particular, we consider the…

Machine Learning · Statistics 2023-05-10 Barna Pásztor , Ilija Bogunovic , Andreas Krause

Preference-based reinforcement learning (PbRL) can enable robots to learn to perform tasks based on an individual's preferences without requiring a hand-crafted reward function. However, existing approaches either assume access to a…

Machine Learning · Computer Science 2024-02-13 Yi Liu , Gaurav Datta , Ellen Novoseller , Daniel S. Brown

We transform reinforcement learning (RL) into a form of supervised learning (SL) by turning traditional RL on its head, calling this Upside Down RL (UDRL). Standard RL predicts rewards, while UDRL instead uses rewards as task-defining…

Artificial Intelligence · Computer Science 2020-06-24 Juergen Schmidhuber

Collaborative edge computing uses edge nodes in different locations to execute tasks, necessitating dynamic task offloading decisions to maintain low latency and high reliability, especially under unpredictable node failures. Although deep…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-08 Hao Guo , Kaixiang Xv , Ziwu Ge , Lei Yang

Generalizing deep reinforcement learning agents to unseen environments remains a significant challenge. One promising solution is Unsupervised Environment Design (UED), a co-evolutionary framework in which a teacher adaptively generates…

Machine Learning · Computer Science 2026-03-17 Geonwoo Cho , Jaegyun Im , Jihwan Lee , Hojun Yi , Sejin Kim , Sundong Kim

Autonomous driving in urban crowds at unregulated intersections is challenging, where dynamic occlusions and uncertain behaviors of other vehicles should be carefully considered. Traditional methods are heuristic and based on…

Robotics · Computer Science 2021-09-20 Peide Cai , Sukai Wang , Hengli Wang , Ming Liu

This paper addresses multi-UAV pursuit-evasion, where a group of drones cooperates to capture a fast evader in a confined environment with obstacles. Existing heuristic algorithms, which simplify the pursuit-evasion problem, often lack…

Machine Learning · Computer Science 2024-05-01 Jiayu Chen , Guosheng Li , Chao Yu , Xinyi Yang , Botian Xu , Huazhong Yang , Yu Wang

Training general agents to follow complex instructions (tasks) in intricate environments (levels) remains a core challenge in reinforcement learning. Random sampling of task-level pairs often produces unsolvable combinations, highlighting…

Machine Learning · Computer Science 2025-12-30 Daniel Furelos-Blanco , Charles Pert , Frederik Kelbel , Alex F. Spies , Alessandra Russo , Michael Dennis

A hallmark of intelligent agents is the ability to learn reusable skills purely from unsupervised interaction with the environment. However, existing unsupervised skill discovery methods often learn entangled skills where one skill variable…

Machine Learning · Computer Science 2024-10-16 Jiaheng Hu , Zizhao Wang , Peter Stone , Roberto Martín-Martín

Upside-Down Reinforcement Learning (UDRL) is an approach for solving RL problems that does not require value functions and uses only supervised learning, where the targets for given inputs in a dataset do not change over time. Ghosh et al.…

We develop Upside-Down Reinforcement Learning (UDRL), a method for learning to act using only supervised learning techniques. Unlike traditional algorithms, UDRL does not use reward prediction or search for an optimal policy. Instead, it…

Machine Learning · Computer Science 2021-09-07 Rupesh Kumar Srivastava , Pranav Shyam , Filipe Mutz , Wojciech Jaśkowski , Jürgen Schmidhuber