English
Related papers

Related papers: Learning Successor Features the Simple Way

200 papers

Nowadays, many visual scene understanding problems are addressed by dense prediction networks. But pixel-wise dense annotations are very expensive (e.g., for scene parsing) or impossible (e.g., for intrinsic image decomposition), motivating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Xiaoxue Chen , Yuhang Zheng , Yupeng Zheng , Qiang Zhou , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Continual learning is an emerging paradigm in machine learning, wherein a model is exposed in an online fashion to data from multiple different distributions (i.e. environments), and is expected to adapt to the distribution change.…

Machine Learning · Computer Science 2022-03-29 Binghui Peng , Andrej Risteski

This paper introduces a novel perspective about error in machine learning and proposes inverse feature learning (IFL) as a representation learning approach that learns a set of high-level features based on the representation of error for…

Machine Learning · Computer Science 2020-03-10 Behzad Ghazanfari , Fatemeh Afghah

Federated Learning (FL) is developed to learn a single global model across the decentralized data, while is susceptible when realizing client-specific personalization in the presence of statistical heterogeneity. However, studies focus on…

Machine Learning · Computer Science 2022-04-27 Changxing Jing , Yan Huang , Yihong Zhuang , Liyan Sun , Yue Huang , Zhenlong Xiao , Xinghao Ding

We study reinforcement learning (RL) with no-reward demonstrations, a setting in which an RL agent has access to additional data from the interaction of other agents with the same environment. However, it has no access to the rewards or…

Machine Learning · Computer Science 2021-06-11 Angelos Filos , Clare Lyle , Yarin Gal , Sergey Levine , Natasha Jaques , Gregory Farquhar

The Forward-Forward (FF) Algorithm has been recently proposed to alleviate the issues of backpropagation (BP) commonly used to train deep neural networks. However, its current formulation exhibits limitations such as the generation of…

Machine Learning · Computer Science 2024-03-29 Andreas Papachristodoulou , Christos Kyrkou , Stelios Timotheou , Theocharis Theocharides

For deep reinforcement learning (RL) from pixels, learning effective state representations is crucial for achieving high performance. However, in practice, limited experience and high-dimensional inputs prevent effective representation…

Machine Learning · Computer Science 2022-10-11 Tao Yu , Zhizheng Zhang , Cuiling Lan , Yan Lu , Zhibo Chen

In visual Reinforcement Learning (RL), upstream representation learning largely determines the effect of downstream policy learning. Employing auxiliary tasks allows the agent to enhance visual representation in a targeted manner, thereby…

Machine Learning · Computer Science 2024-05-21 Xin Liu , Yaran Chen , Dongbin Zhao

Self-supervised representation learning is a fundamental problem in computer vision with many useful applications (e.g., image search, instance level recognition, copy detection). In this paper we present a new contrastive self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Wu , Yunnan Wu

Self-supervised learning (SSL) has emerged as a powerful technique for learning visual representations. While recent SSL approaches achieve strong results in global image understanding, they are limited in capturing the structured…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Oussama Hadjerci , Antoine Letienne , Mohamed Abbas Hedjazi , Adel Hafiane

Training an agent to solve control tasks directly from high-dimensional images with model-free reinforcement learning (RL) has proven difficult. A promising approach is to learn a latent representation together with the control policy.…

Machine Learning · Computer Science 2020-07-10 Denis Yarats , Amy Zhang , Ilya Kostrikov , Brandon Amos , Joelle Pineau , Rob Fergus

We propose a fast, accurate matching method for estimating dense pixel correspondences across scenes. It is a challenging problem to estimate dense pixel correspondences between images depicting different scenes or instances of the same…

Computer Vision and Pattern Recognition · Computer Science 2015-04-24 Chao Zhang , Chunhua Shen , Tingzhi Shen

Self-supervised learning (SSL) has recently shown remarkable results in closing the gap between supervised and unsupervised learning. The idea is to learn robust features that are invariant to distortions of the input data. Despite its…

Sound · Computer Science 2023-03-08 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux

Existing few-shot learning (FSL) methods rely on training with a large labeled dataset, which prevents them from leveraging abundant unlabeled data. From an information-theoretic perspective, we propose an effective unsupervised FSL method,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Yuning Lu , Liangjian Wen , Jianzhuang Liu , Yajing Liu , Xinmei Tian

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

We introduce Mixture-based Feature Space Learning (MixtFSL) for obtaining a rich and robust feature representation in the context of few-shot image classification. Previous works have proposed to model each base class either with a single…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Arman Afrasiyabi , Jean-François Lalonde , Christian Gagné

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

Machine Learning · Computer Science 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han

We propose a self-supervised feature learning assisted reconstruction (SSFL-Recon) framework for MRI reconstruction to address the limitation of existing supervised learning methods. Although recent deep learning-based methods have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Siying Xu , Marcel Früh , Kerstin Hammernik , Andreas Lingg , Jens Kübler , Patrick Krumm , Daniel Rueckert , Sergios Gatidis , Thomas Küstner

Machine learning models usually assume that a set of feature values used to obtain an output is fixed in advance. However, in many real-world problems, a cost is associated with measuring these features. To address the issue of reducing…

Machine Learning · Computer Science 2025-03-13 Katsumi Takahashi , Koh Takeuchi , Hisashi Kashima

Spatial Transformer Networks (STN) can generate geometric transformations which modify input images to improve the classifier's performance. In this work, we combine the idea of STN with Reinforcement Learning (RL). To this end, we break…

Machine Learning · Computer Science 2021-06-29 Fatemeh Azimi , Federico Raue , Joern Hees , Andreas Dengel