English
Related papers

Related papers: Contamination Estimation via Convex Relaxations

200 papers

We establish a novel criterion for comparing the performance of two densities, $g_1$ and $g_2$, within the context of corrupted data. Utilizing this criterion, we propose an algorithm to construct a density estimator within a star-shaped…

Statistics Theory · Mathematics 2025-01-20 Xiaolong Liu , Matey Neykov

Decision making under severe lack of information is a ubiquitous situation in nearly every applied field of engineering, policy, and science. A severe lack of information precludes our ability to determine a frequency of occurrence of…

Geophysics · Physics 2011-11-01 Dylan R. Harp , Velimir V. Vesselinov

There is a great need for robust techniques in data mining and machine learning contexts where many standard techniques such as principal component analysis and linear discriminant analysis are inherently susceptible to outliers.…

Methodology · Statistics 2015-09-28 Garth Tarr , Samuel Müller , Neville C. Weber

Density level sets can be estimated using plug-in methods, excess mass algorithms or a hybrid of the two previous methodologies. The plug-in algorithms are based on replacing the unknown density by some nonparametric estimator, usually the…

Statistics Theory · Mathematics 2016-11-26 A. Rodríguez-Casal , P. Saavedra-Nieves

In this paper, we show how to transform any optimization problem that arises from fitting a machine learning model into one that (1) detects and removes contaminated data from the training set while (2) simultaneously fitting the trimmed…

Machine Learning · Statistics 2017-02-07 Aleksandr Aravkin , Damek Davis

Many modern datasets are collected automatically and are thus easily contaminated by outliers. This led to a regain of interest in robust estimation, including new notions of robustness such as robustness to adversarial contamination of the…

Statistics Theory · Mathematics 2023-05-05 Pierre Alquier , Mathieu Gerber

Study samples often differ from the target populations of inference and policy decisions in non-random ways. Researchers typically believe that such departures from random sampling -- due to changes in the population over time and space, or…

Methodology · Statistics 2023-07-20 Tamara Broderick , Ryan Giordano , Rachael Meager

Peer review is crucial for advancing and improving science through constructive criticism. However, toxic feedback can discourage authors and hinder scientific progress. This work explores an important but underexplored area: detecting…

Computation and Language · Computer Science 2025-02-05 Man Luo , Bradley Peterson , Rafael Gan , Hari Ramalingame , Navya Gangrade , Ariadne Dimarogona , Imon Banerjee , Phillip Howard

We develop a numerical method for the computation of a minimal convex and compact set, $\mathcal{B}\subset\mathbb{R}^N$, in the sense of mean width. This minimisation is constrained by the requirement that $\max_{b\in\mathcal{B}}\langle b ,…

Numerical Analysis · Mathematics 2024-03-12 Åsmund Hausken Sande , Johan S. Wind

Background: Trace quantities of contaminating DNA are widespread in the laboratory environment, but their presence has received little attention in the context of high throughput sequencing. This issue is highlighted by recent works that…

Genomics · Quantitative Biology 2015-06-18 Richard W Lusk

Dataset condensation aims to condense a large dataset with a lot of training samples into a small set. Previous methods usually condense the dataset into the pixels format. However, it suffers from slow optimization speed and large number…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 David Junhao Zhang , Heng Wang , Chuhui Xue , Rui Yan , Wenqing Zhang , Song Bai , Mike Zheng Shou

Exposure measurement error is a ubiquitous but often overlooked challenge in causal inference with observational data. Existing methods accounting for exposure measurement error largely rely on restrictive parametric assumptions, while…

The performance of learning models often deteriorates when deployed in out-of-sample environments. To ensure reliable deployment, we propose a stability evaluation criterion based on distributional perturbations. Conceptually, our stability…

Machine Learning · Statistics 2024-05-07 Jose Blanchet , Peng Cui , Jiajin Li , Jiashuo Liu

We conduct the convergence analysis of parameter estimation in the contaminated mixture of experts. This model is motivated from the prompt learning problem where ones utilize prompts, which can be formulated as experts, to fine-tune a…

Machine Learning · Computer Science 2025-03-07 Fanqi Yan , Huy Nguyen , Dung Le , Pedram Akbarian , Nhat Ho

One of the most significant challenges in combating against the spread of infectious diseases was the difficulty in estimating the true magnitude of infections. Unreported infections could drive up disease spread, making it very hard to…

Social and Information Networks · Computer Science 2025-02-04 Jiaming Cui , Bijaya Adhikari , Arash Haddadan , A S M Ahsan-Ul Haque , Jilles Vreeken , Anil Vullikanti , B. Aditya Prakash

The advancement of large language models (LLMs) relies on evaluation using public benchmarks, but data contamination can lead to overestimated performance. Previous researches focus on detecting contamination by determining whether the…

Computation and Language · Computer Science 2024-09-24 Shangqing Tu , Kejian Zhu , Yushi Bai , Zijun Yao , Lei Hou , Juanzi Li

While there is a rich literature on robust methodologies for contamination in continuously distributed data, contamination in categorical data is largely overlooked. This is regrettable because many datasets are categorical and oftentimes…

Methodology · Statistics 2024-12-13 Max Welz

The estimation of a density profile from experimental data points is a challenging problem, usually tackled by plotting a histogram. Prior assumptions on the nature of the density, from its smoothness to the specification of its form, allow…

Methodology · Statistics 2015-03-13 Alberto Bernacchia , Simone Pigolotti

Computational capability often falls short when confronted with massive data, posing a common challenge in establishing a statistical model or statistical inference method dealing with big data. While subsampling techniques have been…

Methodology · Statistics 2024-10-31 Yixiao Ruan , Zan Li , Zhaohui Li , Dennis K. J. Lin , Qingpei Hu , Dan Yu

Multivariate Gaussian is often used as a first approximation to the distribution of high-dimensional data. Determining the parameters of this distribution under various constraints is a widely studied problem in statistics, and is often…

Statistics Theory · Mathematics 2016-02-09 Samuel Balmand , Arnak Dalalyan
‹ Prev 1 3 4 5 6 7 10 Next ›