中文
相关论文

相关论文: CIC: Contrastive Intrinsic Control for Unsupervise…

200 篇论文

In environments with sparse rewards, finding a good inductive bias for exploration is crucial to the agent's success. However, there are two competing goals: novelty search and systematic exploration. While existing approaches such as…

机器学习 · 计算机科学 2023-08-31 Stefan Sylvius Wagner , Peter Arndt , Jan Robine , Stefan Harmeling

The dichotomy between the challenging nature of obtaining annotations for activities, and the more straightforward nature of data collection from wearables, has resulted in significant interest in the development of techniques that utilize…

机器学习 · 计算机科学 2022-11-14 Harish Haresamudram , Irfan Essa , Thomas Ploetz

As the digital landscape becomes more interconnected, the frequency and severity of zero-day attacks, have significantly increased, leading to an urgent need for innovative Intrusion Detection Systems (IDS). Machine Learning-based IDS that…

密码学与安全 · 计算机科学 2025-05-15 Ippokratis Koukoulis , Ilias Syrigos , Thanasis Korakis

In this paper we introduce a new unsupervised reinforcement learning method for discovering the set of intrinsic options available to an agent. This set is learned by maximizing the number of different states an agent can reliably reach, as…

机器学习 · 计算机科学 2016-11-23 Karol Gregor , Danilo Jimenez Rezende , Daan Wierstra

Recently, contrastive learning has risen to be a promising approach for large-scale self-supervised learning. However, theoretical understanding of how it works is still unclear. In this paper, we propose a new guarantee on the downstream…

机器学习 · 计算机科学 2022-05-30 Yifei Wang , Qi Zhang , Yisen Wang , Jiansheng Yang , Zhouchen Lin

Adversarial imitation learning (AIL) is a popular method that has recently achieved much success. However, the performance of AIL is still unsatisfactory on the more challenging tasks. We find that one of the major reasons is due to the low…

机器学习 · 计算机科学 2023-07-07 Jialei Huang , Zhaoheng Yin , Yingdong Hu , Yang Gao

In this paper, we investigate the effectiveness of contrastive learning methods for predicting grasp outcomes in an unsupervised manner. By utilizing a publicly available dataset, we demonstrate that contrastive learning methods perform…

机器人学 · 计算机科学 2023-09-22 Chengliang Liu , Binhua Huang , Yiwen Liu , Yuanzhe Su , Ke Mai , Yupo Zhang , Zhengkun Yi , Xinyu Wu

Goal-conditioned reinforcement learning has shown considerable potential in robotic manipulation; however, existing approaches remain limited by their reliance on prioritizing collected experience, resulting in suboptimal performance across…

机器人学 · 计算机科学 2026-04-15 Xuerui Wang , Guangyu Ren , Tianhong Dai , Bintao Hu , Shuangyao Huang , Wenzhang Zhang , Hengyan Liu

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

计算机视觉与模式识别 · 计算机科学 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

Speech emotion recognition (SER) is a key technology to enable more natural human-machine communication. However, SER has long suffered from a lack of public large-scale labeled datasets. To circumvent this problem, we investigate how…

Network intrusion detection, a well-explored cybersecurity field, has predominantly relied on supervised learning algorithms in the past two decades. However, their limitations in detecting only known anomalies prompt the exploration of…

密码学与安全 · 计算机科学 2025-10-06 Hamed Fard , Tobias Schalau , Gerhard Wunder

Representation learning and unsupervised skill discovery can allow robots to acquire diverse and reusable behaviors without the need for task-specific rewards. In this work, we use unsupervised reinforcement learning to learn a latent…

机器人学 · 计算机科学 2024-10-11 Vassil Atanassov , Wanming Yu , Alexander Luis Mitchell , Mark Nicholas Finean , Ioannis Havoutis

Deriving value from a conversational AI system depends on the capacity of a user to translate the prior knowledge into a configuration. In most cases, discovering the set of relevant turn-level speaker intents is often one of the key steps.…

计算与语言 · 计算机科学 2024-10-22 Mrinal Rawat , Hithesh Sankararaman , Victor Barres

We study the problem of unsupervised skill discovery, whose goal is to learn a set of diverse and useful skills with no external reward. There have been a number of skill discovery methods based on maximizing the mutual information (MI)…

机器学习 · 计算机科学 2022-02-09 Seohong Park , Jongwook Choi , Jaekyeom Kim , Honglak Lee , Gunhee Kim

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

计算机视觉与模式识别 · 计算机科学 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell

In this paper we study a new reinforcement learning setting where the environment is non-rewarding, contains several possibly related objects of various controllability, and where an apt agent Bob acts independently, with non-observable…

机器学习 · 计算机科学 2019-03-26 Pierre Fournier , Olivier Sigaud , Cédric Colas , Mohamed Chetouani

Subspace clustering aims to group data points that lie in a union of low-dimensional subspaces and finds wide application in computer vision, hyperspectral imaging, and recommendation systems. However, most existing methods assume fully…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Huanran Li , Daniel Pimentel-Alarcón

Iterative learning control (ILC) improves the performance of a repetitive system by learning from previous trials. ILC can be combined with Model Predictive Control (MPC) to mitigate non-repetitive disturbances, thus improving overall…

系统与控制 · 电气工程与系统科学 2025-03-26 Riccardo Zuliani , Efe C. Balta , Alisa Rupenyan , John Lygeros

How can a reinforcement learning (RL) agent prepare to solve downstream tasks if those tasks are not known a priori? One approach is unsupervised skill discovery, a class of algorithms that learn a set of policies without access to a reward…

机器学习 · 计算机科学 2021-10-07 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

Unsupervised skill discovery carries the promise that an intelligent agent can learn reusable skills through autonomous, reward-free environment interaction. Existing unsupervised skill discovery methods learn skills by encouraging…

机器学习 · 计算机科学 2024-10-25 Zizhao Wang , Jiaheng Hu , Caleb Chuck , Stephen Chen , Roberto Martín-Martín , Amy Zhang , Scott Niekum , Peter Stone