English
Related papers

Related papers: Derandomized Novelty Detection with FDR Control vi…

200 papers

Multivariate statistics are often available as well as necessary in hypothesis tests. We study how to use such statistics to control not only false discovery rate (FDR) but also positive FDR (pFDR) with good power. We show that FDR can be…

Statistics Theory · Mathematics 2008-05-21 Zhiyi Chi

This paper describes a methodology for detecting anomalies from sequentially observed and potentially noisy data. The proposed approach consists of two main elements: (1) {\em filtering}, or assigning a belief or likelihood to each…

Machine Learning · Computer Science 2016-11-17 Maxim Raginsky , Rebecca Willett , Corinne Horn , Jorge Silva , Roummel Marcia

Online anomaly detection is essential in fields such as cybersecurity, healthcare, and industrial monitoring, where promptly identifying deviations from expected behavior can avert critical failures or security breaches. While numerous…

Machine Learning · Computer Science 2025-05-06 Amirmohammad Farzaneh , Osvaldo Simeone

The PC algorithm allows investigators to estimate a complete partially directed acyclic graph (CPDAG) from a finite dataset, but few groups have investigated strategies for estimating and controlling the false discovery rate (FDR) of the…

Machine Learning · Statistics 2017-05-11 Eric V. Strobl , Peter L. Spirtes , Shyam Visweswaran

Novelty detection is the process of determining whether a query example differs from the learned training distribution. Previous methods attempt to learn the representation of the normal samples via generative adversarial networks (GANs).…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Chengwei Chen , Yuan Xie , Shaohui Lin , Ruizhi Qiao , Jian Zhou , Xin Tan , Yi Zhang , Lizhuang Ma

We propose a new probabilistic method for unsupervised recovery of corrupted data. Given a large ensemble of degraded samples, our method recovers accurate posteriors of clean values, allowing the exploration of the manifold of possible…

Machine Learning · Computer Science 2020-07-01 Francesco Tonolini , Pablo G. Moreno , Andreas Damianou , Roderick Murray-Smith

We propose the use of a new false discovery rate (FDR) controlling procedure as a model selection penalized method, and compare its performance to that of other penalized methods over a wide range of realistic settings: nonorthogonal design…

Applications · Statistics 2009-05-19 Yoav Benjamini , Yulia Gavrilov

The use of weights provides an effective strategy to incorporate prior domain knowledge in large-scale inference. This paper studies weighted multiple testing in a decision-theoretic framework. We develop oracle and data-driven procedures…

Methodology · Statistics 2017-05-10 Pallavi Basu , T. Tony Cai , Kiranmoy Das , Wenguang Sun

We propose a new empirical Bayes method for covariate-assisted multiple testing with false discovery rate (FDR) control, where we model the local false discovery rate for each hypothesis as a function of both its covariates and p-value. Our…

Methodology · Statistics 2021-07-01 Patrick Chao , William Fithian

Conformal prediction is widely adopted in uncertainty quantification, due to its post-hoc, distribution-free, and model-agnostic properties. In the realm of modern deep learning, researchers have proposed Feature Conformal Prediction (FCP),…

Machine Learning · Computer Science 2024-12-03 Zihao Tang , Boyuan Wang , Chuan Wen , Jiaye Teng

Machine learning classification tasks often benefit from predicting a set of possible labels with confidence scores to capture uncertainty. However, existing methods struggle with the high-dimensional nature of the data and the lack of…

Machine Learning · Computer Science 2024-07-08 Rui Luo , Zhixin Zhou

Multiple testing is a fundamental problem in high-dimensional statistical inference. Although many methods have been proposed to control false discoveries, it is still a challenging task when the tests are correlated to each other. To…

Statistics Theory · Mathematics 2022-07-06 Meng Mei , Yuan Jiang

Large-scale multiple testing with correlated and heavy-tailed data arises in a wide range of research areas from genomics, medical imaging to finance. Conventional methods for estimating the false discovery proportion (FDP) often ignore the…

Methodology · Statistics 2018-09-19 Jianqing Fan , Yuan Ke , Qiang Sun , Wen-Xin Zhou

Quantifying uncertainty in detected changepoints is an important problem. However it is challenging as the naive approach would use the data twice, first to detect the changes, and then to test them. This will bias the test, and can lead to…

Methodology · Statistics 2026-05-11 Rachel Carrington , Paul Fearnhead

Conformal prediction is a non-parametric technique for constructing prediction intervals or sets from arbitrary predictive models under the assumption that the data is exchangeable. It is popular as it comes with theoretical guarantees on…

Machine Learning · Statistics 2025-12-01 Jase Clarkson , Wenkai Xu , Mihai Cucuringu , Yvik Swan , Gesine Reinert

There is a significant need for principled uncertainty reasoning in machine learning systems as they are increasingly deployed in safety-critical domains. A new approach with uncertainty-aware regression-based neural networks (NNs), based…

Machine Learning · Computer Science 2023-07-21 Nis Meinert , Jakob Gawlikowski , Alexander Lavin

Controlling the False Discovery Rate (FDR) in a variable selection procedure is critical for reproducible discoveries, and it has been extensively studied in sparse linear models. However, it remains largely open in scenarios where the…

Methodology · Statistics 2023-11-16 Yang Cao , Xinwei Sun , Yuan Yao

The density estimation is one of the core problems in statistics. Despite this, existing techniques like maximum likelihood estimation are computationally inefficient due to the intractability of the normalizing constant. For this reason an…

Machine Learning · Computer Science 2021-01-14 Tsimboy Olga , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

Instance segmentation plays a pivotal role in medical image analysis by enabling precise localization and delineation of lesions, tumors, and anatomical structures. Although deep learning models such as Mask R-CNN and BlendMask have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Mengxia Dai , Wenqian Luo , Tianyang Li

In this paper, we address conditional testing problems through the conformal inference framework. We define the localized conformal p-values by inverting prediction intervals and prove their theoretical properties. These defined p-values…

Methodology · Statistics 2024-09-26 Xiaoyang Wu , Lin Lu , Zhaojun Wang , Changliang Zou