English
Related papers

Related papers: The surprising strength of weak classifiers for va…

200 papers

Although deep learning has shown great success in recent years, researchers have discovered a critical flaw where small, imperceptible changes in the input to the system can drastically change the output classification. These attacks are…

Machine Learning · Computer Science 2018-11-21 Jacob M. Springer , Charles S. Strauss , Austin M. Thresher , Edward Kim , Garrett T. Kenyon

Conformal predictors are an important class of algorithms that allow predictions to be made with a user-defined confidence level. They are able to do this by outputting prediction sets, rather than simple point predictions. The conformal…

Machine Learning · Computer Science 2021-05-25 Anthony Bellotti

Due to its linear complexity, naive Bayes classification remains an attractive supervised learning method, especially in very large-scale settings. We propose a sparse version of naive Bayes, which can be used for feature selection. This…

Machine Learning · Computer Science 2025-03-13 Armin Askari , Alexandre d'Aspremont , Laurent El Ghaoui

This paper presents the first systematic study of evaluating Deep Neural Networks (DNNs) designed to forecast the evolution of stochastic complex systems. We show that traditional evaluation methods like threshold-based classification…

Machine Learning · Computer Science 2025-01-28 Harshit Kumar , Beomseok Kang , Biswadeep Chakraborty , Saibal Mukhopadhyay

Multi-class classification methods that produce sets of probabilistic classifiers, such as ensemble learning methods, are able to model aleatoric and epistemic uncertainty. Aleatoric uncertainty is then typically quantified via the Bayes…

Machine Learning · Statistics 2023-04-20 Thomas Mortier , Viktor Bengs , Eyke Hüllermeier , Stijn Luca , Willem Waegeman

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

In many classification problems a classifier should be robust to small variations in the input vector. This is a desired property not only for particular transformations, such as translation and rotation in image classification problems,…

Machine Learning · Statistics 2016-01-18 Sergey Demyanov , James Bailey , Ramamohanarao Kotagiri , Christopher Leckie

Deep learning has revolutionized various fields by enabling highly accurate predictions and estimates. One important application is probabilistic prediction, where models estimate the probability of events rather than deterministic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Simone Fassio , Simone Monaco , Daniele Apiletti

There is a growing interest in studying sequential neural posterior estimation (SNPE) techniques due to their advantages for simulation-based models with intractable likelihoods. The methods aim to learn the posterior from adaptively…

Computation · Statistics 2025-10-16 Xiliang Yang , Yifei Xiong , Zhijian He

A persistent challenge in practical classification tasks is that labeled training sets are not always available. In particle physics, this challenge is surmounted by the use of simulations. These simulations accurately reproduce most…

High Energy Physics - Phenomenology · Physics 2018-07-25 Patrick T. Komiske , Eric M. Metodiev , Benjamin Nachman , Matthew D. Schwartz

Smoothing classifiers and probability density functions with Gaussian kernels appear unrelated, but in this work, they are unified for the problem of robust classification. The key building block is approximating the $\textit{energy…

Machine Learning · Statistics 2020-05-12 Saeed Saremi , Rupesh Srivastava

Learning to infer Bayesian posterior from a few-shot dataset is an important step towards robust meta-learning due to the model uncertainty inherent in the problem. In this paper, we propose a novel Bayesian model-agnostic meta-learning…

Machine Learning · Computer Science 2018-11-20 Taesup Kim , Jaesik Yoon , Ousmane Dia , Sungwoong Kim , Yoshua Bengio , Sungjin Ahn

Currently, it is hard to reap the benefits of deep learning for Bayesian methods, which allow the explicit specification of prior knowledge and accurately capture model uncertainty. We present Prior-Data Fitted Networks (PFNs). PFNs…

Machine Learning · Computer Science 2024-08-14 Samuel Müller , Noah Hollmann , Sebastian Pineda Arango , Josif Grabocka , Frank Hutter

Counterfactual Explanations (CEs) have received increasing interest as a major methodology for explaining neural network classifiers. Usually, CEs for an input-output pair are defined as data points with minimum distance to the input that…

Machine Learning · Computer Science 2024-04-05 Junqi Jiang , Jianglin Lan , Francesco Leofante , Antonio Rago , Francesca Toni

Due to their uncertainty quantification, Bayesian solutions to inverse problems are the framework of choice in applications that are risk averse. These benefits come at the cost of computations that are in general, intractable. New advances…

Machine Learning · Computer Science 2024-05-10 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

Simulation-based inference with neural posterior estimation (NPE) often yields overconfident and unreliable posteriors under limited simulation budgets. To address this, we propose DRO-NPE, a distributionally robust approach that replaces…

Machine Learning · Statistics 2026-05-28 William Laplante , Yuga Hikida , Charita Dellaporta , François-Xavier Briol , Ayush Bharti

The ability to fool deep learning classifiers with tiny perturbations of the input has lead to the development of adversarial training in which the loss with respect to adversarial examples is minimized in addition to the training examples.…

Machine Learning · Computer Science 2024-07-30 Amir Hagai , Yair Weiss

Weighting estimators based on propensity scores are widely used for causal estimation in a variety of contexts, such as observational studies, marginal structural models and interference. They enjoy appealing theoretical properties such as…

Methodology · Statistics 2021-10-06 Linbo Wang , Yuexia Zhang , Thomas S. Richardson , Xiao-Hua Zhou

Unsupervised sentence embedding aims to obtain the most appropriate embedding for a sentence to reflect its semantic. Contrastive learning has been attracting developing attention. For a sentence, current models utilize diverse data…

Computation and Language · Computer Science 2022-03-03 Hao Wang , Yangguang Li , Zhen Huang , Yong Dou , Lingpeng Kong , Jing Shao

Popular debiased estimation methods for causal inference -- such as augmented inverse propensity weighting and targeted maximum likelihood estimation -- enjoy desirable asymptotic properties like statistical efficiency and double robustness…

Machine Learning · Statistics 2025-09-16 Tiffany Tianhui Cai , Yuri Fonseca , Kaiwen Hou , Hongseok Namkoong