English
Related papers

Related papers: Adversarial Unsupervised Representation Learning f…

200 papers

State representation learning, or the ability to capture latent generative factors of an environment, is crucial for building intelligent agents that can perform a wide variety of tasks. Learning such representations without supervision…

Machine Learning · Computer Science 2020-11-09 Ankesh Anand , Evan Racah , Sherjil Ozair , Yoshua Bengio , Marc-Alexandre Côté , R Devon Hjelm

This paper presents a novel yet intuitive approach to unsupervised feature learning. Inspired by the human visual system, we explore whether low-level motion-based grouping cues can be used to learn an effective visual representation.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Deepak Pathak , Ross Girshick , Piotr Dollár , Trevor Darrell , Bharath Hariharan

Recent advances in self-supervised learning through contrastive training have shown that it is possible to learn a competitive speech recognition system with as little as 10 minutes of labeled data. However, these systems are…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-02 Lasse Borgholt , Tycho Max Sylvester Tax , Jakob Drachmann Havtorn , Lars Maaløe , Christian Igel

Maintaining proper form while exercising is important for preventing injuries and maximizing muscle mass gains. Detecting errors in workout form naturally requires estimating human's body pose. However, off-the-shelf pose estimators…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Paritosh Parmar , Amol Gharat , Helge Rhodin

Contrastive Learning first extracts features from unlabeled data, followed by linear probing with labeled data. Adversarial Contrastive Learning (ACL) integrates Adversarial Training into the first phase to enhance feature robustness…

Machine Learning · Computer Science 2025-10-28 Ngoc N. Tran , Lam Tran , Hoang Phan , Anh Bui , Tung Pham , Toan Tran , Dinh Phung , Trung Le

Contrastive pretraining provides robust representations by ensuring their invariance to different image transformations while simultaneously preventing representational collapse. Equivariant contrastive learning, on the other hand, provides…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Taha Emre , Arunava Chakravarty , Dmitrii Lachinov , Antoine Rivail , Ursula Schmidt-Erfurth , Hrvoje Bogunović

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the…

Machine Learning · Computer Science 2021-10-25 Anh Bui , Trung Le , He Zhao , Paul Montague , Seyit Camtepe , Dinh Phung

Active learning aims to alleviate the amount of labor involved in data labeling by automating the selection of unlabeled samples via an acquisition function. For example, variational adversarial active learning (VAAL) leverages an…

Machine Learning · Computer Science 2024-08-26 Zongyao Lyu , William J. Beksi

Recent approaches have utilized self-supervised auxiliary tasks as representation learning to improve the performance and sample efficiency of vision-based reinforcement learning algorithms in single-agent settings. However, in multi-agent…

Machine Learning · Computer Science 2023-06-06 Haolin Song , Mingxiao Feng , Wengang Zhou , Houqiang Li

We introduce advocacy learning, a novel supervised training scheme for attention-based classification problems. Advocacy learning relies on a framework consisting of two connected networks: 1) $N$ Advocates (one for each class), each of…

Machine Learning · Computer Science 2019-08-08 Ian Fox , Jenna Wiens

Distinguishing if an action is performed as intended or if an intended action fails is an important skill that not only humans have, but that is also important for intelligent systems that operate in human environments. Recognizing if an…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Olga Zatsarynna , Yazan Abu Farha , Juergen Gall

This paper introduces Adversarial Resilience Learning (ARL), a concept to model, train, and analyze artificial neural networks as representations of competitive agents in highly complex systems. In our examples, the agents normally take the…

Artificial Intelligence · Computer Science 2018-11-16 Lars Fischer , Jan-Menno Memmen , Eric MSP Veith , Martin Tröschel

Factorization methods for recommender systems tend to represent users as a single latent vector. However, user behavior and interests may change in the context of the recommendations that are presented to the user. For example, in the case…

Information Retrieval · Computer Science 2020-04-21 Oren Barkan , Avi Caciularu , Ori Katz , Noam Koenigstein

Rapid progress in deep reinforcement learning has made it increasingly feasible to train controllers for high-dimensional humanoid bodies. However, methods that use pure reinforcement learning with simple reward functions tend to produce…

Robotics · Computer Science 2017-07-11 Josh Merel , Yuval Tassa , Dhruva TB , Sriram Srinivasan , Jay Lemmon , Ziyu Wang , Greg Wayne , Nicolas Heess

We propose a novel approach to achieving invariance for deep neural networks in the form of inducing amnesia to unwanted factors of data through a new adversarial forgetting mechanism. We show that the forgetting mechanism serves as an…

Machine Learning · Computer Science 2019-11-22 Ayush Jaiswal , Daniel Moyer , Greg Ver Steeg , Wael AbdAlmageed , Premkumar Natarajan

The field of neuroscience is experiencing rapid growth in the complexity and quantity of the recorded neural activity allowing us unprecedented access to its dynamics in different brain areas. The objective of this work is to discover…

It is necessary to improve the performance of some special classes or to particularly protect them from attacks in adversarial learning. This paper proposes a framework combining cost-sensitive classification and adversarial learning…

Machine Learning · Computer Science 2022-06-24 Haojing Shen , Sihong Chen , Ran Wang , Xizhao Wang

In this paper we consider self-supervised representation learning to improve sample efficiency in reinforcement learning (RL). We propose a forward prediction objective for simultaneously learning embeddings of states and action sequences.…

Machine Learning · Computer Science 2020-01-15 William Whitney , Rajat Agarwal , Kyunghyun Cho , Abhinav Gupta

Sequential recommendation models, models that learn from chronological user-item interactions, outperform traditional recommendation models in many settings. Despite the success of sequential recommendation models, their robustness has…

Information Retrieval · Computer Science 2024-01-17 Juntao Tan , Shelby Heinecke , Zhiwei Liu , Yongjun Chen , Yongfeng Zhang , Huan Wang