English
Related papers

Related papers: Rethinking The Uniformity Metric in Self-Supervise…

200 papers

Self-supervised contrastive learning is a powerful tool to learn visual representation without labels. Prior work has primarily focused on evaluating the recognition accuracy of various pre-training algorithms, but has overlooked other…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Yuanyi Zhong , Haoran Tang , Junkun Chen , Jian Peng , Yu-Xiong Wang

This paper proposes a probabilistic contrastive loss function for self-supervised learning. The well-known contrastive loss is deterministic and involves a temperature hyperparameter that scales the inner product between two normed feature…

Machine Learning · Computer Science 2021-12-06 Shen Li , Jianqing Xu , Bryan Hooi

Machine unlearning seeks to remove the influence of specified data from a trained model. While the unlearning accuracy provides a widely used metric for assessing unlearning performance, it falls short in assessing the reliability of…

Machine Learning · Computer Science 2026-05-13 Yingdan Shi , Sijia Liu , Kaize Ding , Ren Wang

Deep metric learning, which learns discriminative features to process image clustering and retrieval tasks, has attracted extensive attention in recent years. A number of deep metric learning methods, which ensure that similar examples are…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Tongtong Yuan , Weihong Deng , Jian Tang , Yinan Tang , Binghui Chen

Measuring inter-dataset similarity is an important task in machine learning and data mining with various use cases and applications. Existing methods for measuring inter-dataset similarity are computationally expensive, limited, or…

Machine Learning · Computer Science 2025-05-06 Muhammad Rajabinasab , Anton D. Lautrup , Arthur Zimek

Subspace clustering has established itself as a state-of-the-art approach to clustering high-dimensional data. In particular, methods relying on the self-expressiveness property have recently proved especially successful. However, they…

Machine Learning · Computer Science 2020-12-21 Julian Busch , Evgeniy Faerman , Matthias Schubert , Thomas Seidl

We present a novel objective function for cluster-based self-supervised learning (SSL) that is designed to circumvent the triad of failure modes, namely representation collapse, cluster collapse, and the problem of invariance to…

Machine Learning · Computer Science 2023-10-23 Emanuele Sansone

Conformal unlearning aims to ensure that a trained conformal predictor miscovers data points with specific shared characteristics, such as those from a particular label class, associated with a specific user, or belonging to a defined…

Machine Learning · Computer Science 2026-02-13 Yahya Alkhatib , Muhammad Ahmar Jamal , Wee Peng Tay

Self-supervised learning allows AI systems to learn effective representations from large amounts of data using tasks that do not require costly labeling. Mode collapse, i.e., the model producing identical representations for all inputs, is…

Machine Learning · Computer Science 2022-09-19 Serdar Ozsoy , Shadi Hamdan , Sercan Ö. Arik , Deniz Yuret , Alper T. Erdogan

This paper proposes a new method for determining similarity and anomalies between time series, most practically effective in large collections of (likely related) time series, by measuring distances between structural breaks within such a…

Machine Learning · Computer Science 2020-12-01 Nick James , Max Menzies , Lamiae Azizi , Jennifer Chan

In this work, we connect two distinct concepts for unsupervised domain adaptation: feature distribution alignment between domains by utilizing the task-specific decision boundary and the Wasserstein metric. Our proposed sliced Wasserstein…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Chen-Yu Lee , Tanmay Batra , Mohammad Haris Baig , Daniel Ulbricht

Semisupervised methods inevitably invoke some assumption that links the marginal distribution of the features to the regression function of the label. Most commonly, the cluster or manifold assumptions are used which imply that the…

Statistics Theory · Mathematics 2011-12-02 Martin Azizyan , Aarti Singh , Larry Wasserman

Metric learning aims to learn a distance metric such that semantically similar instances are pulled together while dissimilar instances are pushed away. Many existing methods consider maximizing or at least constraining a distance margin in…

Machine Learning · Statistics 2022-08-17 Xiaochen Yang , Yiwen Guo , Mingzhi Dong , Jing-Hao Xue

Defining similarity measures is a requirement for some machine learning methods. One such method is case-based reasoning (CBR) where the similarity measure is used to retrieve the stored case or set of cases most similar to the query case.…

Machine Learning · Computer Science 2020-01-16 Bjørn Magnus Mathisen , Agnar Aamodt , Kerstin Bach , Helge Langseth

Matching individuals across non-overlapping camera networks, known as person re-identification, is a fundamentally challenging problem due to the large visual appearance changes caused by variations of viewpoints, lighting, and occlusion.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-25 Sakrapee Paisitkriangkrai , Lin Wu , Chunhua Shen , Anton van den Hengel

Self-supervised speech representation learning has recently been a prosperous research topic. Many algorithms have been proposed for learning useful representations from large-scale unlabeled data, and their applications to a wide range of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-03 Yu-An Chung , Yonatan Belinkov , James Glass

Several self-supervised learning (SSL) approaches have shown that redundancy reduction in the feature embedding space is an effective tool for representation learning. However, these methods consider a narrow notion of redundancy, focusing…

Machine Learning · Computer Science 2024-12-10 David Zollikofer , Béni Egressy , Frederik Benzing , Matthias Otth , Roger Wattenhofer

Continual learning has emerged as an increasingly important challenge across various tasks, including Spoken Language Understanding (SLU). In SLU, its objective is to effectively handle the emergence of new concepts and evolving…

Computation and Language · Computer Science 2024-02-19 Muqiao Yang , Xiang Li , Umberto Cappellazzo , Shinji Watanabe , Bhiksha Raj

Feature selection methods have an important role on the readability of data and the reduction of complexity of learning algorithms. In recent years, a variety of efforts are investigated on feature selection problems based on unsupervised…

Machine Learning · Computer Science 2019-12-12 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi
‹ Prev 1 3 4 5 6 7 10 Next ›