English
Related papers

Related papers: Prior shift estimation for positive unlabeled data…

200 papers

In this paper, we show that the performance of a learnt generative model is closely related to the model's ability to accurately represent the inferred \textbf{latent data distribution}, i.e. its topology and structural properties. We…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Shuyu Lin , Ronald Clark

Label Proportion Learning (LLP) addresses the classification problem where multiple instances are grouped into bags and each bag contains information about the proportion of each class. However, in practical applications, obtaining precise…

Machine Learning · Computer Science 2025-07-15 Jiahe Qin , Junpeng Li , Changchun Hua , Yana Yang

A key challenge in probabilistic regression is ensuring that predictive distributions accurately reflect true empirical uncertainty. Minimizing overall prediction error often encourages models to prioritize informativeness over calibration,…

Machine Learning · Statistics 2026-02-17 Ádám Jung , Domokos M. Kelen , András A. Benczúr

Recent approaches leveraging multi-modal pre-trained models like CLIP for Unsupervised Domain Adaptation (UDA) have shown significant promise in bridging domain gaps and improving generalization by utilizing rich semantic knowledge and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Tung-Long Vuong , Hoang Phan , Vy Vo , Anh Bui , Thanh-Toan Do , Trung Le , Dinh Phung

This survey is an introduction to positive definite kernels and the set of methods they have inspired in the machine learning literature, namely kernel methods. We first discuss some properties of positive definite kernels as well as…

Machine Learning · Statistics 2009-12-04 Marco Cuturi

The superior performance of some of today's state-of-the-art deep learning models is to some extent owed to extensive (self-)supervised contrastive pretraining on large-scale datasets. In contrastive learning, the network is presented with…

Machine Learning · Computer Science 2022-07-20 Shervin Ardeshir , Navid Azizan

We present a novel self-taught framework for unsupervised metric learning, which alternates between predicting class-equivalence relations between data through a moving average of an embedding model and learning the model with the predicted…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

The ability of a human being to extrapolate previously gained knowledge to other domains inspired a new family of methods in machine learning called transfer learning. Transfer learning is often based on the assumption that objects in both…

Machine Learning · Statistics 2016-10-21 Ievgen Redko , Younès Bennani

Classifier predictions often rely on the assumption that new observations come from the same distribution as training data. When the underlying distribution changes, so does the optimal classification rule, and performance may degrade. We…

Methodology · Statistics 2021-09-01 Ciaran Evans , Max G'Sell

In machine learning or statistics, it is often desirable to reduce the dimensionality of a sample of data points in a high dimensional space $\mathbb{R}^d$. This paper introduces a dimensionality reduction method where the embedding…

Machine Learning · Computer Science 2021-11-30 Michaël Fanuel , Antoine Aspeel , Jean-Charles Delvenne , Johan A. K. Suykens

We consider the problem of discovering novel object categories in an image collection. While these images are unlabelled, we also assume prior knowledge of related but different image classes. We use such prior knowledge to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Kai Han , Andrea Vedaldi , Andrew Zisserman

In machine learning, we are given a dataset of the form $\{(\mathbf{x}_j,y_j)\}_{j=1}^M$, drawn as i.i.d. samples from an unknown probability distribution $\mu$; the marginal distribution for the $\mathbf{x}_j$'s being $\mu^*$. We propose…

Machine Learning · Computer Science 2019-01-11 H. N. Mhaskar , A. Cloninger , X. Cheng

We introduce the isoperimetric loss as a regularization criterion for learning the map from a visual representation to a semantic embedding, to be used to transfer knowledge to unknown classes in a zero-shot learning setting. We use a…

Machine Learning · Computer Science 2019-12-05 Shay Deutsch , Andrea Bertozzi , Stefano Soatto

In this abstract paper, we introduce a new kernel learning method by a nonparametric density estimator. The estimator consists of a group of k-centroids clusterings. Each clustering randomly selects data points with randomly selected…

Machine Learning · Computer Science 2017-08-02 Xiao-Lei Zhang

This study presents an efficient approach for incomplete data classification, where the entries of samples are missing or masked due to privacy preservation. To deal with these incomplete data, a new kernel function with asymmetric…

Machine Learning · Computer Science 2016-11-22 Bo-Wei Chen

Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately,…

Machine Learning · Statistics 2015-03-03 E. Cruz Cortés , C. Scott

Density estimation in high-dimensional settings is an important and challenging statistical problem.Traditional methods based on kernel smoothing are inefficient in high dimensions due to the difficulties in specifying appropriate…

Machine Learning · Statistics 2026-05-14 Ruitong Zhang , Ke Deng

In this study, we consider a variant of unlabelled sensing where the measurements are sparsely permuted, and additionally, a few correspondences are known. We present an estimator to solve for the unknown vector. We derive a theoretical…

Signal Processing · Electrical Eng. & Systems 2023-09-06 Garweet Sresth , Ajit Rajwade , Satish Mulleti

Kernel techniques are among the most popular and flexible approaches in data science allowing to represent probability measures without loss of information under mild conditions. The resulting mapping called mean embedding gives rise to a…

Machine Learning · Statistics 2024-11-27 Linda Chamakh , Zoltan Szabo

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun