English
Related papers

Related papers: Variance Covariance Regularization Enforces Pairwi…

200 papers

Self-supervised learning (SSL) has emerged as an effective paradigm for deriving general representations from vast amounts of unlabeled data. However, as real-world applications continually integrate new content, the high computational and…

Machine Learning · Computer Science 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

Multi-label Recognition (MLR) involves assigning multiple labels to each data instance in an image, offering advantages over single-label classification in complex scenarios. However, it faces the challenge of annotating all relevant…

Machine Learning · Computer Science 2025-06-03 Ruhui Zhang , Hezhe Qiao , Pengcheng Xu , Mingsheng Shang , Lin Chen

While contrastive approaches of self-supervised learning (SSL) learn representations by minimizing the distance between two augmented views of the same data point (positive pairs) and maximizing views from different data points (negative…

Machine Learning · Computer Science 2021-10-11 Yuandong Tian , Xinlei Chen , Surya Ganguli

Recent successes in self-supervised learning (SSL) model spatial co-occurrences of visual features either by masking portions of an image or by aggressively cropping it. Here, we propose a new way to model spatial co-occurrences by aligning…

Machine Learning · Computer Science 2025-01-07 Arthur Aubret , Céline Teulière , Jochen Triesch

Multi-view representation learning (MvRL) has garnered substantial attention in recent years, driven by the increasing demand for applications that can effectively process and analyze data from multiple sources. In this context, graph…

Machine Learning · Statistics 2025-05-28 Amitai Yacobi , Ofir Lindenbaum , Uri Shaham

Self-supervised learning (SSL) is a powerful tool in machine learning, but understanding the learned representations and their underlying mechanisms remains a challenge. This paper presents an in-depth empirical analysis of SSL-trained…

Machine Learning · Computer Science 2023-06-01 Ido Ben-Shaul , Ravid Shwartz-Ziv , Tomer Galanti , Shai Dekel , Yann LeCun

Multilingual pretrained representations generally rely on subword segmentation algorithms to create a shared multilingual vocabulary. However, standard heuristic algorithms often lead to sub-optimal segmentation, especially for languages…

Computation and Language · Computer Science 2021-04-07 Xinyi Wang , Sebastian Ruder , Graham Neubig

Several self-supervised learning (SSL) approaches have shown that redundancy reduction in the feature embedding space is an effective tool for representation learning. However, these methods consider a narrow notion of redundancy, focusing…

Machine Learning · Computer Science 2024-12-10 David Zollikofer , Béni Egressy , Frederik Benzing , Matthias Otth , Roger Wattenhofer

Self-supervised Learning (SSL) aims to learn transferable feature representations for downstream applications without relying on labeled data. The Barlow Twins algorithm, renowned for its widespread adoption and straightforward…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Wele Gedara Chaminda Bandara , Celso M. De Melo , Vishal M. Patel

The substantial modality-induced variations in radiometric, texture, and structural characteristics pose significant challenges for the accurate registration of multimodal images. While supervised deep learning methods have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Xiaochen Wei , Weiwei Guo , Wenxian Yu

Self-supervised representation learning maps high-dimensional data into a meaningful embedding space, where samples of similar semantic contents are close to each other. Most of the recent representation learning methods maximize cosine…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Chuang Niu , Ge Wang

Recent work on curvilinear structure segmentation has mostly focused on backbone network design and loss engineering. The challenge of collecting labelled data, an expensive and labor intensive process, has been overlooked. While labelled…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Xun Xu , Manh Cuong Nguyen , Yasin Yazici , Kangkang Lu , Hlaing Min , Chuan-Sheng Foo

Multi-View Representation Learning (MVRL) aims to derive a unified representation from multi-view data by leveraging shared and complementary information across views. However, when views are irregularly missing, the incomplete data can…

Machine Learning · Computer Science 2025-03-03 Xin Gao , Jian Pu

Semi-supervised learning (SSL) enables training of powerful models with the assumption of limited, carefully labelled data and a large amount of unlabeled data to support the learning. In this paper, we propose a hybrid consistency learning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Matus Bojko , Maros Kollar , Marek Jakab , Wanda Benesova

Regularized empirical risk minimization including support vector machines plays an important role in machine learning theory. In this paper regularized pairwise learning (RPL) methods based on kernels will be investigated. One example is…

Statistics Theory · Mathematics 2015-10-13 Andreas Christmann , Ding-Xuan Zhou

This paper introduces vox2vec - a contrastive method for self-supervised learning (SSL) of voxel-level representations. vox2vec representations are modeled by a Feature Pyramid Network (FPN): a voxel representation is a concatenation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Mikhail Goncharov , Vera Soboleva , Anvar Kurmukov , Maxim Pisov , Mikhail Belyaev

A prominent approach to visual Reinforcement Learning (RL) is to learn an internal state representation using self-supervised methods, which has the potential benefit of improved sample-efficiency and generalization through additional…

Machine Learning · Computer Science 2023-03-16 Yanjie Ze , Nicklas Hansen , Yinbo Chen , Mohit Jain , Xiaolong Wang

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

Voice conversion (VC) systems are widely used for several applications, from speaker anonymisation to personalised speech synthesis. Supervised approaches learn a mapping between different speakers using parallel data, which is expensive to…

When algorithmic decisions depend on data distributed across institutions, how can we ensure that an individual's outcome does not change arbitrarily based on a protected attribute? We study this question in vertical federated learning…

Computers and Society · Computer Science 2026-05-11 Dawood Wasif , Chandan K. Reddy , Terrence J. Moore , Jin-Hee Cho