中文
相关论文

相关论文: Rethinking The Uniformity Metric in Self-Supervise…

200 篇论文

Self-supervised contrastive learning is a powerful tool to learn visual representation without labels. Prior work has primarily focused on evaluating the recognition accuracy of various pre-training algorithms, but has overlooked other…

计算机视觉与模式识别 · 计算机科学 2022-06-13 Yuanyi Zhong , Haoran Tang , Junkun Chen , Jian Peng , Yu-Xiong Wang

This paper proposes a probabilistic contrastive loss function for self-supervised learning. The well-known contrastive loss is deterministic and involves a temperature hyperparameter that scales the inner product between two normed feature…

机器学习 · 计算机科学 2021-12-06 Shen Li , Jianqing Xu , Bryan Hooi

Machine unlearning seeks to remove the influence of specified data from a trained model. While the unlearning accuracy provides a widely used metric for assessing unlearning performance, it falls short in assessing the reliability of…

机器学习 · 计算机科学 2026-05-13 Yingdan Shi , Sijia Liu , Kaize Ding , Ren Wang

Deep metric learning, which learns discriminative features to process image clustering and retrieval tasks, has attracted extensive attention in recent years. A number of deep metric learning methods, which ensure that similar examples are…

计算机视觉与模式识别 · 计算机科学 2019-04-05 Tongtong Yuan , Weihong Deng , Jian Tang , Yinan Tang , Binghui Chen

Measuring inter-dataset similarity is an important task in machine learning and data mining with various use cases and applications. Existing methods for measuring inter-dataset similarity are computationally expensive, limited, or…

机器学习 · 计算机科学 2025-05-06 Muhammad Rajabinasab , Anton D. Lautrup , Arthur Zimek

Subspace clustering has established itself as a state-of-the-art approach to clustering high-dimensional data. In particular, methods relying on the self-expressiveness property have recently proved especially successful. However, they…

机器学习 · 计算机科学 2020-12-21 Julian Busch , Evgeniy Faerman , Matthias Schubert , Thomas Seidl

We present a novel objective function for cluster-based self-supervised learning (SSL) that is designed to circumvent the triad of failure modes, namely representation collapse, cluster collapse, and the problem of invariance to…

机器学习 · 计算机科学 2023-10-23 Emanuele Sansone

Conformal unlearning aims to ensure that a trained conformal predictor miscovers data points with specific shared characteristics, such as those from a particular label class, associated with a specific user, or belonging to a defined…

机器学习 · 计算机科学 2026-02-13 Yahya Alkhatib , Muhammad Ahmar Jamal , Wee Peng Tay

Self-supervised learning allows AI systems to learn effective representations from large amounts of data using tasks that do not require costly labeling. Mode collapse, i.e., the model producing identical representations for all inputs, is…

机器学习 · 计算机科学 2022-09-19 Serdar Ozsoy , Shadi Hamdan , Sercan Ö. Arik , Deniz Yuret , Alper T. Erdogan

This paper proposes a new method for determining similarity and anomalies between time series, most practically effective in large collections of (likely related) time series, by measuring distances between structural breaks within such a…

机器学习 · 计算机科学 2020-12-01 Nick James , Max Menzies , Lamiae Azizi , Jennifer Chan

In this work, we connect two distinct concepts for unsupervised domain adaptation: feature distribution alignment between domains by utilizing the task-specific decision boundary and the Wasserstein metric. Our proposed sliced Wasserstein…

计算机视觉与模式识别 · 计算机科学 2019-03-12 Chen-Yu Lee , Tanmay Batra , Mohammad Haris Baig , Daniel Ulbricht

Semisupervised methods inevitably invoke some assumption that links the marginal distribution of the features to the regression function of the label. Most commonly, the cluster or manifold assumptions are used which imply that the…

统计理论 · 数学 2011-12-02 Martin Azizyan , Aarti Singh , Larry Wasserman

Metric learning aims to learn a distance metric such that semantically similar instances are pulled together while dissimilar instances are pushed away. Many existing methods consider maximizing or at least constraining a distance margin in…

机器学习 · 统计学 2022-08-17 Xiaochen Yang , Yiwen Guo , Mingzhi Dong , Jing-Hao Xue

Defining similarity measures is a requirement for some machine learning methods. One such method is case-based reasoning (CBR) where the similarity measure is used to retrieve the stored case or set of cases most similar to the query case.…

机器学习 · 计算机科学 2020-01-16 Bjørn Magnus Mathisen , Agnar Aamodt , Kerstin Bach , Helge Langseth

Matching individuals across non-overlapping camera networks, known as person re-identification, is a fundamentally challenging problem due to the large visual appearance changes caused by variations of viewpoints, lighting, and occlusion.…

计算机视觉与模式识别 · 计算机科学 2016-05-25 Sakrapee Paisitkriangkrai , Lin Wu , Chunhua Shen , Anton van den Hengel

Self-supervised speech representation learning has recently been a prosperous research topic. Many algorithms have been proposed for learning useful representations from large-scale unlabeled data, and their applications to a wide range of…

音频与语音处理 · 电气工程与系统科学 2021-02-03 Yu-An Chung , Yonatan Belinkov , James Glass

Several self-supervised learning (SSL) approaches have shown that redundancy reduction in the feature embedding space is an effective tool for representation learning. However, these methods consider a narrow notion of redundancy, focusing…

机器学习 · 计算机科学 2024-12-10 David Zollikofer , Béni Egressy , Frederik Benzing , Matthias Otth , Roger Wattenhofer

Continual learning has emerged as an increasingly important challenge across various tasks, including Spoken Language Understanding (SLU). In SLU, its objective is to effectively handle the emergence of new concepts and evolving…

计算与语言 · 计算机科学 2024-02-19 Muqiao Yang , Xiang Li , Umberto Cappellazzo , Shinji Watanabe , Bhiksha Raj

Feature selection methods have an important role on the readability of data and the reduction of complexity of learning algorithms. In recent years, a variety of efforts are investigated on feature selection problems based on unsupervised…

机器学习 · 计算机科学 2019-12-12 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi