English
Related papers

Related papers: Nonparametric Divergence Estimation with Applicati…

200 papers

Distance metric learning is successful in discovering intrinsic relations in data. However, most algorithms are computationally demanding when the problem size becomes large. In this paper, we propose a discriminative metric learning…

Machine Learning · Computer Science 2019-05-15 Jun Li , Xun Lin , Xiaoguang Rui , Yong Rui , Dacheng Tao

Estimating and disentangling epistemic uncertainty, uncertainty that is reducible with more training data, and aleatoric uncertainty, uncertainty that is inherent to the task at hand, is critically important when applying machine learning…

Machine Learning · Computer Science 2024-11-08 Matthew A. Chan , Maria J. Molina , Christopher A. Metzler

We investigate unsupervised anomaly detection for high-dimensional data and introduce a deep metric learning (DML) based framework. In particular, we learn a distance metric through a deep neural network. Through this metric, we project the…

Machine Learning · Computer Science 2020-05-13 Selim F. Yilmaz , Suleyman S. Kozat

In many remote sensing applications one wants to estimate variables or parameters of interest from observations. When the target variable is available at a resolution that matches the remote sensing observations, standard algorithms such as…

Parametric density estimation, for example as Gaussian distribution, is the base of the field of statistics. Machine learning requires inexpensive estimation of much more complex densities, and the basic approach is relatively costly…

Machine Learning · Computer Science 2017-02-21 Jarek Duda

A common approach to statistical learning with big-data is to randomly split it among $m$ machines and learn the parameter of interest by averaging the $m$ individual estimates. In this paper, focusing on empirical risk minimization, or…

Machine Learning · Statistics 2016-06-14 Jonathan Rosenblatt , Boaz Nadler

We consider several estimation and learning problems that networked agents face when making decisions given their uncertainty about an unknown variable. Our methods are designed to efficiently deal with heterogeneity in both size and…

Applications · Statistics 2016-11-11 M. Amin Rahimian , Ali Jadbabaie

Anomaly detection aims at identifying images that deviate significantly from the norm. We focus on algorithms that embed the normal training examples in space and when given a test image, detect anomalies based on the features distance to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Ori Nizan , Ayellet Tal

This work addresses the distributed estimation problem in a set membership framework. The agents of a network collect measurements which are affected by bounded errors, thus implying that the unknown parameters to be estimated belong to a…

Optimization and Control · Mathematics 2018-12-11 Francesco Farina , Andrea Garulli , Antonio Giannitrapani

When facing uncertainty, decision-makers want predictions they can trust. A machine learning provider can convey confidence to decision-makers by guaranteeing their predictions are distribution calibrated -- amongst the inputs that receive…

Machine Learning · Statistics 2021-07-14 Shengjia Zhao , Michael P. Kim , Roshni Sahoo , Tengyu Ma , Stefano Ermon

We review the main applications of machine learning models that are not fully supervised in particle physics, i.e., clustering, anomaly detection, detector simulation, and unfolding. Unsupervised methods are ideal for anomaly detection…

High Energy Physics - Phenomenology · Physics 2024-10-24 Jai Bardhan , Tanumoy Mandal , Subhadip Mitra , Cyrin Neeraj , Monalisa Patra

Although deep learning has been applied to successfully address many data mining problems, relatively limited work has been done on deep learning for anomaly detection. Existing deep anomaly detection methods, which focus on learning new…

Machine Learning · Computer Science 2019-11-21 Guansong Pang , Chunhua Shen , Anton van den Hengel

This paper deals with uncertainty quantification and out-of-distribution detection in deep learning using Bayesian and ensemble methods. It proposes a practical solution to the lack of prediction diversity observed recently for standard…

Machine Learning · Computer Science 2025-02-03 Antoine de Mathelin , François Deheeger , Mathilde Mougeot , Nicolas Vayatis

Bayesian estimation is a powerful theoretical paradigm for the operation of quantum sensors. However, the Bayesian method for statistical inference generally suffers from demanding calibration requirements that have so far restricted its…

Quantum Physics · Physics 2021-09-22 Samuel P. Nolan , Augusto Smerzi , Luca Pezzè

Learning in the presence of outliers is a fundamental problem in statistics. Until recently, all known efficient unsupervised learning algorithms were very sensitive to outliers in high dimensions. In particular, even for the task of robust…

Data Structures and Algorithms · Computer Science 2019-11-15 Ilias Diakonikolas , Daniel M. Kane

This paper investigates score-based diffusion models when the underlying target distribution is concentrated on or near low-dimensional manifolds within the higher-dimensional space in which they formally reside, a common characteristic of…

Machine Learning · Computer Science 2025-01-03 Gen Li , Yuling Yan

The reliable measurement of confidence in classifiers' predictions is very important for many applications and is, therefore, an important part of classifier design. Yet, although deep learning has received tremendous attention in recent…

Artificial Intelligence · Computer Science 2020-07-01 Amit Mandelbaum , Daphna Weinshall

It has been shown that deep learning models can under certain circumstances outperform traditional statistical methods at forecasting. Furthermore, various techniques have been developed for quantifying the forecast uncertainty (prediction…

Machine Learning · Computer Science 2021-10-08 Thabang Mathonsi , Terence L. van Zyl

We overview some results on distributed learning with focus on a family of recently proposed algorithms known as non-Bayesian social learning. We consider different approaches to the distributed learning problem and its algorithmic…

Optimization and Control · Mathematics 2016-09-27 Angelia Nedić , Alex Olshevsky , César A. Uribe

We introduce a general semiparametric clusterwise elliptical distribution to assess how latent cluster structure shapes continuous outcomes. Using a subjectwise representation, we first estimate cluster-specific mean vectors and a…

Methodology · Statistics 2026-04-10 Jen-Chieh Teng , Sheng-Hsin Fan , Chin-Tsang Chiang , Ming-Yueh Huang , Alvin Lim