English
Related papers

Related papers: Weighted Aggregation of Conformity Scores for Clas…

200 papers

Conformal inference is a fundamental and versatile tool that provides distribution-free guarantees for many machine learning tasks. We consider the transductive setting, where decisions are made on a test sample of $m$ new points, giving…

Methodology · Statistics 2024-03-20 Ulysse Gazin , Gilles Blanchard , Etienne Roquain

A problem faced by many instructors is that of designing exams that accurately assess the abilities of the students. Typically these exams are prepared several days in advance, and generic question scores are used based on rough…

Computers and Society · Computer Science 2018-11-07 Sam Ganzfried , Farzana Yusuf

The merit of Conformal Prediction (CP), as a distribution-free framework for uncertainty quantification, depends on generating prediction sets that are efficient, reflected in small average set sizes, while adaptive, meaning they signal…

Machine Learning · Computer Science 2026-02-24 Navid Akhavan Attar , Hesam Asadollahzadeh , Ling Luo , Uwe Aickelin

Feature attribution methods are widely used for explaining image-based predictions, as they provide feature-level insights that can be intuitively visualized. However, such explanations often vary in their robustness and may fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Amr Alkhatib , Stephanie Lowry

A key to causal inference with observational data is achieving balance in predictive features associated with each treatment type. Recent literature has explored representation learning to achieve this goal. In this work, we discuss the…

Machine Learning · Statistics 2021-02-25 Serge Assaad , Shuxi Zeng , Chenyang Tao , Shounak Datta , Nikhil Mehta , Ricardo Henao , Fan Li , Lawrence Carin

Unlike the typical classification setting where each instance is associated with a single class, in multi-label learning each instance is associated with multiple classes simultaneously. Therefore the learning task in this setting is to…

Machine Learning · Computer Science 2022-11-30 Harris Papadopoulos

We discuss weighted scoring rules for forecast evaluation and their connection to hypothesis testing. First, a general construction principle for strictly locally proper weighted scoring rules based on conditional densities and scoring…

Methodology · Statistics 2017-01-12 Hajo Holzmann , Bernhard Klar

Multi-document summarization has received a great deal of attention in the past couple of decades. Several approaches have been proposed, many of which perform equally well and it is becoming in- creasingly difficult to choose one…

Information Retrieval · Computer Science 2018-02-06 Parth Mehta , Prasenjit Majumder

Ensuring model calibration is critical for reliable prediction, yet popular distribution-free methods such as histogram binning and isotonic regression offer only asymptotic guarantees. We introduce a unified framework for Venn and…

Machine Learning · Statistics 2025-07-17 Lars van der Laan , Ahmed Alaa

This paper proposes a new method for finding the highest predictive density set or region, within the heteroscedastic regression framework. This framework enjoys the property that any highest predictive density set is a translation of some…

Methodology · Statistics 2025-04-09 Max Sampson , Kung-Sik Chan

We investigate a problem in which each member of a group of learners is trained separately to solve the same classification task. Each learner has access to a training dataset (possibly with overlap across learners) but each trained…

Machine Learning · Computer Science 2020-03-03 Mahmoud Albardan , John Klein , Olivier Colot

Conformal prediction provides a pivotal and flexible technique for uncertainty quantification by constructing prediction sets with a predefined coverage rate. Many online conformal prediction methods have been developed to address data…

Machine Learning · Statistics 2026-02-25 Dongjian Hu , Junxi Wu , Shu-Tao Xia , Changliang Zou

Score matching is an estimation procedure that has been developed for statistical models whose probability density function is known up to proportionality but whose normalizing constant is intractable, so that maximum likelihood is…

Methodology · Statistics 2024-04-23 Jiazhen Xu , Janice L. Scealy , Andrew T. A. Wood , Tao Zou

The problem of adaptive multivariate function estimation in the single-index regression model with random design and weak assumptions on the noise is investigated. A novel estimation procedure that adapts simultaneously to the unknown index…

Statistics Theory · Mathematics 2014-01-29 Oleg Lepski , Nora Serdyukova

Conformal prediction (CP) converts any model's output to prediction sets with a guarantee to cover the true label with (adjustable) high probability. Robust CP extends this guarantee to worst-case (adversarial) inputs. Existing baselines…

Machine Learning · Computer Science 2025-03-10 Soroush H. Zargarbashi , Aleksandar Bojchevski

Covariate balance is crucial for unconfounded descriptive or causal comparisons. However, lack of balance is common in observational studies. This article considers weighting strategies for balancing covariates. We define a general class of…

Methodology · Statistics 2016-09-30 Fan Li , Kari Lock Morgan , Alan M. Zaslavsky

Covariate balance is crucial for unconfounded descriptive or causal comparisons. However, lack of balance is common in observational studies. This article considers weighting strategies for balancing covariates. We define a general class of…

Methodology · Statistics 2016-11-17 Fan Li , Kari Lock Morgan , Alan M. Zaslavsky

In this paper, a new classifier based on the intrinsic properties of the data is proposed. Classification is an essential task in data mining-based applications. The classification problem will be challenging when the size of the training…

Machine Learning · Computer Science 2020-10-14 Sahar Tavakoli

Conformal prediction constructs prediction sets with finite-sample coverage guarantees, but its calibration stage is structurally constrained to a scalar score function and a single threshold variable - forcing shapes of prediction sets to…

Machine Learning · Statistics 2026-05-13 Laura Lützow , Simone Garatti , Marco C. Campi , Lars Lindemann , Matthias Althoff

We present a novel method for jointly learning compositional and non-compositional phrase embeddings by adaptively weighting both types of embeddings using a compositionality scoring function. The scoring function is used to quantify the…

Computation and Language · Computer Science 2016-06-09 Kazuma Hashimoto , Yoshimasa Tsuruoka