English
Related papers

Related papers: Contamination Estimation via Convex Relaxations

200 papers

The dramatic increase of autonomous systems subject to variable environments has given rise to the pressing need to consider risk in both the synthesis and verification of policies for these systems. This paper aims to address a few…

Artificial Intelligence · Computer Science 2022-04-22 Prithvi Akella , Anushri Dixit , Mohamadreza Ahmadi , Joel W. Burdick , Aaron D. Ames

In a bivariate setting, we consider the problem of detecting a sparse contamination or mixture component, where the effect manifests itself as a positive dependence between the variables, which are otherwise independent in the main…

Statistics Theory · Mathematics 2020-01-13 Ery Arias-Castro , Rong Huang , Nicolas Verzelen

An observation of a cumulative distribution function $F$ with finite variance is said to be contaminated according to the inflated variance model if it has a large probability of coming from the original target distribution $F$, but a small…

Statistics Theory · Mathematics 2017-12-12 Ben Berckmoes , Geert Molenberghs

Classical semiparametric inference with missing outcome data is not robust to contamination of the observed data and a single observation can have arbitrarily large influence on estimation of a parameter of interest. This sensitivity is…

Methodology · Statistics 2021-03-02 Eva Cantoni , Xavier de Luna

Inspired by recent work on learning with distribution shift, we give a general outlier removal algorithm called iterative polynomial filtering and show a number of striking applications for supervised learning with contamination: (1) We…

Machine Learning · Computer Science 2026-01-13 Adam R. Klivans , Konstantinos Stavropoulos , Kevin Tian , Arsen Vasilyan

Adversarial poisoning attacks pose huge threats to various machine learning applications. Especially, the recent accumulative poisoning attacks show that it is possible to achieve irreparable harm on models via a sequence of imperceptible…

Machine Learning · Computer Science 2023-06-07 Jianing Zhu , Xiawei Guo , Jiangchao Yao , Chao Du , Li He , Shuo Yuan , Tongliang Liu , Liang Wang , Bo Han

Subsampling methods have been recently proposed to speed up least squares estimation in large scale settings. However, these algorithms are typically not robust to outliers or corruptions in the observed covariates. The concept of influence…

Machine Learning · Statistics 2014-06-20 Brian McWilliams , Gabriel Krummenacher , Mario Lucic , Joachim M. Buhmann

Low-cost air pollution sensors, offering hyper-local characterization of pollutant concentrations, are becoming increasingly prevalent in environmental and public health research. However, low-cost air pollution data can be noisy, biased by…

Applications · Statistics 2023-02-21 Claire Heffernan , Roger Peng , Drew R. Gentner , Kirsten Koehler , Abhirup Datta

This paper introduces new techniques for using convex optimization to fit input-output data to a class of stable nonlinear dynamical models. We present an algorithm that guarantees consistent estimates of models in this class when a small…

Optimization and Control · Mathematics 2013-03-19 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

This paper deals with the state estimation problem in discrete-event systems modeled with nondeterministic finite automata, partially observed via a sensor measuring unit whose measurements (reported observations) may be vitiated by a…

Information Theory · Computer Science 2020-11-04 Yuting Li , Christoforos N. Hadjicostis , Naiqi Wu , Zhiwu Li

Estimating prevalence, the fraction of a population with a certain medical condition, is fundamental to epidemiology. Traditional methods rely on classification of test samples taken at random from a population. Such approaches to…

Methodology · Statistics 2022-03-25 Paul Patrone , Anthony Kearsley

When data contains measurement errors, it is necessary to make assumptions relating the observed, erroneous data to the unobserved true phenomena of interest. These assumptions should be justifiable on substantive grounds, but are often…

Machine Learning · Statistics 2020-12-24 Noam Finkelstein , Roy Adams , Suchi Saria , Ilya Shpitser

We revisit the so-called sampling and discarding approach used to quantify the probability of constraint violation of a solution to convex scenario programs when some of the original samples are allowed to be discarded. Motivated by two…

Optimization and Control · Mathematics 2022-04-05 Licio Romao , Antonis Papachristodoulou , Kostas Margellos

We consider in this paper a contamined regression model where the distribution of the contaminating component is known when the Eu- clidean parameters of the regression model, the noise distribution, the contamination ratio and the…

Statistics Theory · Mathematics 2011-11-10 Pierre Vandekerkhove

We consider the problem of estimating the covariance structure of a random vector $Y\in \mathbb R^d$ from a sample $Y_1,\ldots,Y_n$. We are interested in the situation when $d$ is large compared to $n$ but the covariance matrix $\Sigma$ of…

Statistics Theory · Mathematics 2024-10-08 Stanislav Minsker , Lang Wang

Graphical modeling explores dependences among a collection of variables by inferring a graph that encodes pairwise conditional independences. For jointly Gaussian variables, this translates into detecting the support of the precision…

Methodology · Statistics 2018-02-16 Shota Katayama , Hironori Fujisawa , Mathias Drton

Convex sample approximations of chance-constrained optimization problems are considered, in which chance constraints are replaced by sets of sampled constraints. We propose a randomized sample selection strategy that allows tight bounds to…

Optimization and Control · Mathematics 2018-05-22 Mark Cannon

The US Census Bureau will deliberately corrupt data sets derived from the 2020 US Census, enhancing the privacy of respondents while potentially reducing the precision of economic analysis. To investigate whether this trade-off is…

Econometrics · Economics 2024-02-13 Anish Agarwal , Rahul Singh

Most deep anomaly detection models are based on learning normality from datasets due to the difficulty of defining abnormality by its diverse and inconsistent nature. Therefore, it has been a common practice to learn normality under the…

Machine Learning · Computer Science 2023-09-19 Minkyung Kim , Jongmin Yu , Junsik Kim , Tae-Hyun Oh , Jun Kyun Choi

In this work we propose and numerically analyze an algorithm for detection of a contaminant source using a dynamic sensor network. The algorithm is motivated using a global probabilistic optimization problem and is based on the analysis of…

Probability · Mathematics 2015-10-21 Sergio A. Almada Monter , Amarjit Budhiraja , Jan Hannig