English
Related papers

Related papers: Estimating the Contamination Factor's Distribution…

200 papers

Estimating average causal effect (ACE) is useful whenever we want to know the effect of an intervention on a given outcome. In the absence of a randomized experiment, many methods such as stratification and inverse propensity weighting have…

Machine Learning · Computer Science 2019-07-11 Rathin Desai , Amit Sharma

Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex…

Machine Learning · Computer Science 2020-10-20 Haoyi Fan , Fengbin Zhang , Ruidong Wang , Liang Xi , Zuoyong Li

We consider a collection of independent random variables that are identically distributed, except for a small subset which follows a different, anomalous distribution. We study the problem of detecting which random variables in the…

Information Theory · Computer Science 2018-06-21 Natalie Durgin , Rachel Grotheer , Chenxi Huang , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Exfiltration of data via email is a serious cybersecurity threat for many organizations. Detecting data exfiltration (anomaly) patterns typically requires labeling, most often done by a human annotator, to reduce the high number of false…

Machine Learning · Computer Science 2023-07-19 Jaturong Kongmanee , Mark Chignell , Khilan Jerath , Abhay Raman

Anomaly detection involves identifying instances within a dataset that deviate from the norm and occur infrequently. Current benchmarks tend to favor methods biased towards low diversity in normal data, which does not align with real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Mohammad Akhavan Anvari , Rojina Kashefi , Vahid Reza Khazaie , Mohammad Khalooei , Mohammad Sabokrou

Anomaly detection is a crucial task in various domains. Most of the existing methods assume the normal sample data clusters around a single central prototype while the real data may consist of multiple categories or subgroups. In addition,…

Machine Learning · Statistics 2024-12-03 Zhijin Dong , Hongzhi Liu , Boyuan Ren , Weimin Xiong , Zhonghai Wu

In this work, we empirically explore the question: how can we assess the quality of samples from some target distribution? We assume that the samples are provided by some valid Monte Carlo procedure, so we are guaranteed that the collection…

Machine Learning · Computer Science 2016-06-21 Arjumand Masood , Weiwei Pan , Finale Doshi-Velez

Anomaly detection methods are widely used but often rely on ad hoc rules or strong assumptions, and they often focus on tail events, missing ``inlier'' anomalies that occur in low-density gaps between modes. We propose a unified framework…

Methodology · Statistics 2026-03-11 Rob J Hyndman , David T. Frazier

Random-effects meta-analyses of observational studies can produce biased estimates if the synthesized studies are subject to unmeasured confounding. We propose sensitivity analyses quantifying the extent to which unmeasured confounding of…

Methodology · Statistics 2017-10-10 Maya B. Mathur , Tyler J. VanderWeele

Learning how to rank multivariate unlabeled observations depending on their degree of abnormality/novelty is a crucial problem in a wide range of applications. In practice, it generally consists in building a real valued "scoring" function…

Machine Learning · Statistics 2015-02-06 Nicolas Goix , Anne Sabourin , Stéphan Clémençon

Unsupervised detection of anomaly points in time series is a challenging problem, which requires the model to derive a distinguishable criterion. Previous methods tackle the problem mainly through learning pointwise representation or…

Machine Learning · Computer Science 2022-06-30 Jiehui Xu , Haixu Wu , Jianmin Wang , Mingsheng Long

Frequent false alarms impede the promotion of unsupervised anomaly detection algorithms in industrial applications. Potential characteristics of false alarms depending on the trained detector are revealed by investigating density…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Ji Qiu , Hongmei Shi , Yu Hen Hu , Zujun Yu

We propose a methodology for modeling and comparing probability distributions within a Bayesian nonparametric framework. Building on dependent normalized random measures, we consider a prior distribution for a collection of discrete random…

Methodology · Statistics 2022-06-01 Mario Beraha , Jim E. Griffin

We propose a new probabilistic method for unsupervised recovery of corrupted data. Given a large ensemble of degraded samples, our method recovers accurate posteriors of clean values, allowing the exploration of the manifold of possible…

Machine Learning · Computer Science 2020-07-01 Francesco Tonolini , Pablo G. Moreno , Andreas Damianou , Roderick Murray-Smith

In anomaly detection, the degree of irregularity is often summarized as a real-valued anomaly score. We address the problem of attributing such anomaly scores to input features for interpreting the results of anomaly detection. We…

Machine Learning · Computer Science 2023-07-24 Naoya Takeishi , Yoshinobu Kawahara

The problem of detecting anomalies in multiple processes is considered. We consider a composite hypothesis case, in which the measurements drawn when observing a process follow a common distribution with an unknown parameter (vector), whose…

Information Theory · Computer Science 2020-04-22 Bar Hemo , Tomer Gafni , Kobi Cohen , Qing Zhao

Unsupervised anomaly detection (UAD) alleviates large labeling efforts by training exclusively on unlabeled in-distribution data and detecting outliers as anomalies. Generally, the assumption prevails that large training datasets allow the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Felix Meissen , Johannes Getzner , Alexander Ziller , Özgün Turgut , Georgios Kaissis , Martin J. Menten , Daniel Rueckert

We propose a general method to carry out a valid Bayesian analysis of a finite-dimensional `targeted' parameter in the presence of a finite-dimensional nuisance parameter. We apply our methods to causal inference based on estimating…

Methodology · Statistics 2026-02-03 Magid Sabbagh , David A. Stephens

This paper considers an anomaly detection problem in which a detection algorithm assigns anomaly scores to multi-dimensional data points, such as cellular networks' Key Performance Indicators (KPIs). We propose an optimization framework to…

Information Theory · Computer Science 2023-09-01 Ali Maatouk , Fadhel Ayed , Wenjie Li , Yu Wang , Hong Zhu , Jiantao Ye

Semi- and non-parametric mixture of regressions are a very useful flexible class of mixture of regressions in which some or all of the parameters are non-parametric functions of the covariates. These models are, however, based on the…

Methodology · Statistics 2026-01-21 Peterson Mambondimumwe , Sphiwe B. Skhosana , Najmeh Nakhaei Rad