English
Related papers

Related papers: Contamination Estimation via Convex Relaxations

200 papers

In learning tasks with label noise, improving model robustness against overfitting is a pivotal challenge because the model eventually memorizes labels, including the noisy ones. Identifying the samples with noisy labels and preventing the…

Machine Learning · Computer Science 2023-09-28 Reihaneh Torkzadehmahani , Reza Nasirigerdeh , Daniel Rueckert , Georgios Kaissis

When causal quantities cannot be point identified, researchers often pursue partial identification to quantify the range of possible values. However, the peculiarities of applied research conditions can make this analytically intractable.…

Methodology · Statistics 2021-09-29 Guilherme Duarte , Noam Finkelstein , Dean Knox , Jonathan Mummolo , Ilya Shpitser

In supervised learning one wishes to identify a pattern present in a joint distribution $P$, of instances, label pairs, by providing a function $f$ from instances to labels that has low risk $\mathbb{E}_{P}\ell(y,f(x))$. To do so, the…

Machine Learning · Statistics 2015-07-07 Brendan van Rooyen , Robert C. Williamson

In discrete choice panel data, estimation of average effects is crucial for quantifying the effect of covariates, and for policy evaluation and counterfactual analysis. However, in short panels with individual-specific effects, challenges…

Econometrics · Economics 2026-01-27 Cavit Pakel , Martin Weidner

The advent of large-scale inference has spurred reexamination of conventional statistical thinking. In a Gaussian model for $n$ many $z$-scores with at most $k < \frac{n}{2}$ nonnulls, Efron suggests estimating the location and scale…

Statistics Theory · Mathematics 2025-01-15 Subhodh Kotekal , Chao Gao

For many complex diseases, prognosis is of essential importance. It has been shown that, beyond the main effects of genetic (G) and environmental (E) risk factors, the gene-environment (G$\times$E) interactions also play a critical role. In…

Applications · Statistics 2015-05-15 Hao Chai , Qingzhao Zhang , Yu Jiang , Guohua Wang , Sanguo Zhang , Shuangge Ma

The paper is focused on the problem of estimating the probability $p$ of individual contaminated sample, under group testing. The precision of the estimator is given by the probability of proportional closeness, a concept defined in the…

Statistics Theory · Mathematics 2017-12-27 Yaakov Malinovsky , Shelemyahu Zacks

Tables are an abundant form of data with use cases across all scientific fields. Real-world datasets often contain anomalous samples that can negatively affect downstream analysis. In this work, we only assume access to contaminated data…

Machine Learning · Computer Science 2023-07-25 Guy Zamberg , Moshe Salhov , Ofir Lindenbaum , Amir Averbuch

A method is developed for estimating the emission rates of contaminants into the atmosphere from multiple point sources using measurements of particulate material deposited at ground level. The approach is based on a Gaussian plume type…

Atmospheric and Oceanic Physics · Physics 2010-06-11 Enkeleida Lushi , John M. Stockie

The problem of sequential anomaly detection is considered, where multiple data sources are monitored in real time and the goal is to identify the "anomalous" ones among them, when it is not possible to sample all sources at all times. A…

Statistics Theory · Mathematics 2022-05-23 Aristomenis Tsopelakos , Georgios Fellouris

Compressed sensing typically deals with the estimation of a system input from its noise-corrupted linear measurements, where the number of measurements is smaller than the number of input components. The performance of the estimation…

Information Theory · Computer Science 2016-11-17 Jin Tan , Danielle Carmon , Dror Baron

Machine learning models have traditionally been developed under the assumption that the training and test distributions match exactly. However, recent success in few-shot learning and related problems are encouraging signs that these models…

Machine Learning · Statistics 2020-10-15 James Lucas , Mengye Ren , Irene Kameni , Toniann Pitassi , Richard Zemel

Large language models are trained on vast amounts of internet data, prompting concerns and speculation that they have memorized public benchmarks. Going from speculation to proof of contamination is challenging, as the pretraining data used…

Computation and Language · Computer Science 2023-11-27 Yonatan Oren , Nicole Meister , Niladri Chatterji , Faisal Ladhak , Tatsunori B. Hashimoto

Standard Importance Sampling (IS) collapses under label corruption because high-norm examples, prioritized for variance reduction, are often adversarial outliers. We formalize this misalignment using an $\varepsilon$-contamination model and…

Machine Learning · Computer Science 2026-05-11 Csongor Horváth , Ida-Maria Sintorn , Prashant Singh

This paper addresses the deconvolution problem of estimating a square-integrable probability density from observations contaminated with additive measurement errors having a known density. The estimator begins with a density estimate of the…

Statistics Theory · Mathematics 2023-04-12 David Kent , David Ruppert

Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…

Machine Learning · Statistics 2025-10-02 Chuntao Chen , Tapio Helin , Nuutti Hyvönen , Yuya Suzuki

Multiclass classification problems such as image annotation can involve a large number of classes. In this context, confusion between classes can occur, and single label classification may be misleading. We provide in the present paper a…

Statistics Theory · Mathematics 2017-12-19 Christophe Denis , Mohamed Hebiri

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

The quality of generative models depends on the quality of the data they are trained on. Creating large-scale, high-quality datasets is often expensive and sometimes impossible, e.g. in certain scientific applications where there is no…

Machine Learning · Computer Science 2024-11-06 Giannis Daras , Yeshwanth Cherapanamjeri , Constantinos Daskalakis

Inconsistent values are commonly encountered in real-world applications, which can negatively impact data analysis and decision-making. While existing research primarily focuses on identifying the smallest removal set to resolve…

Data Structures and Algorithms · Computer Science 2025-12-23 Haoda Li , Jiahui Chen , Yu Sun , Shaoxu Song , Haiwei Zhang , Xiaojie Yuan