English
Related papers

Related papers: Self-Supervised Ranking for Representation Learnin…

200 papers

Unsupervised learning is just at a tipping point where it could really take off. Among these approaches, contrastive learning has seen tremendous progress and led to state-of-the-art performance. In this paper, we construct a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Yu Wang , Jingyang Lin , Qi Cai , Yingwei Pan , Ting Yao , Hongyang Chao , Tao Mei

Learning to rank (LTR) is widely employed in web searches to prioritize pertinent webpages from retrieved content based on input queries. However, traditional LTR models encounter two principal obstacles that lead to suboptimal performance:…

Information Retrieval · Computer Science 2024-09-26 Yuchen Li , Haoyi Xiong , Linghe Kong , Jiang Bian , Shuaiqiang Wang , Guihai Chen , Dawei Yin

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

Supervised classification and representation learning are two widely used classes of methods to analyze multivariate images. Although complementary, these methods have been scarcely considered jointly in a hierarchical modeling. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Adrien Lagrange , Mathieu Fauvel , Stéphane May , José Bioucas-Dias , Nicolas Dobigeon

Recent unsupervised contrastive representation learning follows a Single Instance Multi-view (SIM) paradigm where positive pairs are usually constructed with intra-image data augmentation. In this paper, we propose an effective approach…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xiangxiang Chu , Xiaohang Zhan , Bo Zhang

In this paper, we investigate a new framework for image classification that adaptively generates spatial representations. Our strategy is based on a sequential process that learns to explore the different regions of any image in order to…

Computer Vision and Pattern Recognition · Computer Science 2014-02-12 Gabriel Dulac-Arnold , Ludovic Denoyer , Nicolas Thome , Matthieu Cord , Patrick Gallinari

In this paper, we consider a problem of self-supervised learning for small-scale datasets based on contrastive loss between multiple views of the data, which demonstrates the state-of-the-art performance in classification task. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Vitaliy Kinakh , Olga Taran , Svyatoslav Voloshynovskiy

Convolutional neural networks (CNNs) have achieved significant success in image classification by utilizing large-scale datasets. However, it is still of great challenge to learn from scratch on small-scale datasets efficiently and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Yilu Guo , Shicai Yang , Weijie Chen , Liang Ma , Di Xie , Shiliang Pu

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi

Computational visual aesthetics has recently become an active research area. Existing state-of-art methods formulate this as a binary classification task where a given image is predicted to be beautiful or not. In many applications such as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Parag S. Chandakkar , Vijetha Gattupalli , Baoxin Li

Self-supervision allows learning meaningful representations of natural images, which usually contain one central object. How well does it transfer to multi-entity scenes? We discuss key aspects of learning structured object-centric…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Federico Baldassarre , Hossein Azizpour

Recent approaches in self-supervised learning of image representations can be categorized into different families of methods and, in particular, can be divided into contrastive and non-contrastive approaches. While differences between the…

Machine Learning · Computer Science 2023-06-27 Quentin Garrido , Yubei Chen , Adrien Bardes , Laurent Najman , Yann Lecun

Contrastive self supervised learning(CSSL) usually makes use of the multi-view assumption which states that all relevant information must be shared between all views. The main objective of CSSL is to maximize the mutual information(MI)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yash Kumar Sharma , Vineet Padmanabhan

We study the problem of learning to assign a characteristic pose, i.e., scale and orientation, for an image region of interest. Despite its apparent simplicity, the problem is non-trivial; it is hard to obtain a large-scale set of image…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Jongmin Lee , Yoonwoo Jeong , Minsu Cho

Recent self-supervised representation learning techniques have largely closed the gap between supervised and unsupervised learning on ImageNet classification. While the particulars of pretraining on ImageNet are now relatively well…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Elijah Cole , Xuan Yang , Kimberly Wilber , Oisin Mac Aodha , Serge Belongie

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

We develop an approach to learning visual representations that embraces multimodal data, driven by a combination of intra- and inter-modal similarity preservation objectives. Unlike existing visual pre-training methods, which solve a proxy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , Yilin Wang , Michael Maire , Ajinkya Kale , Baldo Faieta

Casting session-based or sequential recommendation as reinforcement learning (RL) through reward signals is a promising research direction towards recommender systems (RS) that maximize cumulative profits. However, the direct use of RL…

Machine Learning · Computer Science 2021-11-08 Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Most recent self-supervised methods for learning image representations focus on either producing a global feature with invariance properties, or producing a set of local features. The former works best for classification tasks while the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Adrien Bardes , Jean Ponce , Yann LeCun

Unsupervised learning permits the development of algorithms that are able to adapt to a variety of different data sets using the same underlying rules thanks to the autonomous discovery of discriminating features during training. Recently,…

Neural and Evolutionary Computing · Computer Science 2018-01-30 Yanis Bahroun , Andrea Soltoggio