English
Related papers

Related papers: False Discovery estimation in Record Linkage

200 papers

Since Benjamini and Hochberg introduced false discovery rate (FDR) in their seminal paper, this has become a very popular approach to the multiple comparisons problem. An increasingly popular topic within functional data analysis is local…

Methodology · Statistics 2019-08-16 Niels Lundtorp Olsen , Alessia Pini , Simone Vantini

The local false discovery rate (lfdr) of Efron et al. (2001) enjoys major conceptual and decision-theoretic advantages over the false discovery rate (FDR) as an error criterion in multiple testing, but is only well-defined in Bayesian…

Statistics Theory · Mathematics 2025-02-25 Daniel Xiang , Jake A. Soloff , William Fithian

To discover new insights from data, there is a growing need to share information that is often held by different organisations. One key task in data integration is the calculation of similarities between records in different databases to…

Databases · Computer Science 2025-11-04 Sirintra Vaiwsri , Thilina Ranbaduge

We present false discovery rate smoothing, an empirical-Bayes method for exploiting spatial structure in large multiple-testing problems. FDR smoothing automatically finds spatially localized regions of significant test statistics. It then…

Methodology · Statistics 2016-11-15 Wesley Tansey , Oluwasanmi Koyejo , Russell A. Poldrack , James G. Scott

Discovering causal structure among a set of variables is a fundamental problem in many domains. However, state-of-the-art methods seldom consider the possibility that the observational data has missing values (incomplete data), which is…

Machine Learning · Computer Science 2020-06-11 Xiaoshui Huang , Fujin Zhu , Lois Holloway , Ali Haidar

Penetration testing, the simulation of cyberattacks to identify security vulnerabilities, presents a sequential decision-making problem well-suited for reinforcement learning (RL) automation. Like many applications of RL to real-world…

Machine Learning · Computer Science 2025-09-25 Raphael Simon , Pieter Libin , Wim Mees

Multivariate statistics are often available as well as necessary in hypothesis tests. We study how to use such statistics to control not only false discovery rate (FDR) but also positive FDR (pFDR) with good power. We show that FDR can be…

Statistics Theory · Mathematics 2008-05-21 Zhiyi Chi

The privacy loss distribution (PLD) provides a tight characterization of the privacy loss of a mechanism in the context of differential privacy (DP). Recent work has shown that PLD-based accounting allows for tighter $(\varepsilon,…

Data Structures and Algorithms · Computer Science 2022-07-12 Vadym Doroshenko , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi

In the context of multiple hypotheses testing, the proportion $\pi_0$ of true null hypotheses in the pool of hypotheses to test often plays a crucial role, although it is generally unknown a priori. A testing procedure using an implicit or…

Statistics Theory · Mathematics 2009-02-17 Gilles Blanchard , Etienne Roquain

We propose a general and flexible procedure for testing multiple hypotheses about sequential (or streaming) data that simultaneously controls both the false discovery rate (FDR) and false nondiscovery rate (FNR) under minimal assumptions…

Methodology · Statistics 2019-01-14 Jay Bartroff , Jinlin Song

Various deep learning (DL) methods have recently been utilized to detect software vulnerabilities. Real-world software vulnerability datasets are rare and hard to acquire, as there is no simple metric for classifying vulnerability. Such…

Software Engineering · Computer Science 2025-04-29 Seyed Shayan Daneshvar , Da Tan , Shaowei Wang , Carson Leung

Since federated learning (FL) has been introduced as a decentralized learning technique with privacy preservation, statistical heterogeneity of distributed data stays the main obstacle to achieve robust performance and stable convergence in…

Machine Learning · Computer Science 2022-12-08 Yanhang Shi , Siguang Chen , Haijun Zhang

Real-life data are often non-IID due to complex distributions and interactions, and the sensitivity to the distribution of samples can differ among learning models. Accordingly, a key question for any supervised or unsupervised model is…

Machine Learning · Computer Science 2023-10-03 Zhilin Zhao , Longbing Cao

Genome-wide association studies (GWAS) have led to the discovery of numerous single nucleotide polymorphisms (SNPs) associated with various phenotypes and complex diseases. However, the identified genetic variants do not fully explain the…

Methodology · Statistics 2025-07-09 Dayeon Jung , Yewon Kim , Junyong Park

Data sets obtained from linking multiple files are frequently affected by mismatch error, as a result of non-unique or noisy identifiers used during record linkage. Accounting for such mismatch error in downstream analysis performed on the…

Person re-identification aims to match a person's identity across multiple camera streams. Deep neural networks have been successfully applied to the challenging person re-identification task. One remarkable bottleneck is that the existing…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Guodong Ding , Shanshan Zhang , Salman Khan , Zhenmin Tang , Jian Zhang , Fatih Porikli

Motivation: The reconstruction of gene networks from gene expression microarrays is gaining popularity as methods improve and as more data become available. The reliability of such networks could be judged by the probability that a…

Genomics · Quantitative Biology 2007-05-23 David R. Bickel

Controlled variable selection is an important analytical step in various scientific fields, such as brain imaging or genomics. In these high-dimensional data settings, considering too many variables leads to poor models and high costs,…

Methodology · Statistics 2023-10-17 Alexandre Blain , Bertrand Thirion , Olivier Grisel , Pierre Neuvial

In many scenarios such as genome-wide association studies where dependences between variables commonly exist, it is often of interest to infer the interaction effects in the model. However, testing pairwise interactions among millions of…

Methodology · Statistics 2022-09-02 Jingyi Duan , Yang Ning , Xi Chen , Yong Chen

Local differential privacy (LDP) provides a way for an untrusted data collector to aggregate users' data without violating their privacy. Various privacy-preserving data analysis tasks have been studied under the protection of LDP, such as…

Cryptography and Security · Computer Science 2024-07-01 Wei Tong , Haoyu Chen , Jiacheng Niu , Sheng Zhong