English
Related papers

Related papers: False Discovery estimation in Record Linkage

200 papers

The rapid propagation of misinformation poses substantial risks to public interest. To combat misinformation, large language models (LLMs) are adapted to automatically verify claim credibility. Nevertheless, existing methods heavily rely on…

Computation and Language · Computer Science 2024-06-17 Zhenrui Yue , Huimin Zeng , Lanyu Shang , Yifan Liu , Yang Zhang , Dong Wang

High-dimensional feature selection is routinely required to balance statistical power with strict control of multiple-error metrics such as the k-Family-Wise Error Rate (k-FWER) and the False Discovery Proportion (FDP), yet some existing…

Methodology · Statistics 2026-03-03 Xuelin Zhang , Jingxuan Liang , Xinyue Liu , Hong Chen , Biqin Song

We consider multiple testing means of many dependent Normal random variables that do not necessarily follow a joint Normal distribution. Under weak dependence, we show the uniform consistency of proportion estimators that are constructed as…

Methodology · Statistics 2022-05-09 Xiongzhi Chen

Data-aided channel estimation is a promising solution to improve channel estimation accuracy by exploiting data symbols as pilot signals for updating an initial channel estimate. In this paper, we propose a semi-data-aided channel estimator…

Signal Processing · Electrical Eng. & Systems 2022-04-05 Tae-Kyoung Kim , Yo-Seb Jeon , Jun Li , Nima Tavangaran , H. Vincent Poor

Reinforcement learning (RL) has exceeded human performance in many synthetic settings such as video games and Go. However, real-world deployment of end-to-end RL models is less common, as RL models can be very sensitive to slight…

Machine Learning · Computer Science 2022-09-29 Jing Dong , Jingwei Li , Baoxiang Wang , Jingzhao Zhang

Label distribution learning (LDL) trains a model to predict the relevance of a set of labels (called label distribution (LD)) to an instance. The previous LDL methods all assumed the LDs of the training instances are accurate. However,…

Machine Learning · Computer Science 2023-08-29 Zhiqiang Kou , Yuheng Jia , Jing Wang , Xin Geng

Many diagnostic errors occur because clinicians cannot easily access relevant information in patient Electronic Health Records (EHRs). In this work we propose a method to use LLMs to identify pieces of evidence in patient EHR data that…

Data replication is crucial for enabling fault tolerance and uniform low latency in modern decentralized applications. Replicated Data Types (RDTs) have emerged as a principled approach for developing replicated implementations of basic…

Programming Languages · Computer Science 2025-02-28 Vimala Soundarapandian , Kartik Nagar , Aseem Rastogi , KC Sivaramakrishnan

Statistical matching is a technique for integrating two or more data sets when information available for matching records for individual participants across data sets is incomplete. Statistical matching can be viewed as a missing data…

Methodology · Statistics 2015-10-14 Jae-kwang Kim , Emily Berg , Taesung Park

Motivation: In microarray analysis, special consideration must be given to the issues of multiple statistical tests and typically p-values are adjusted to control family-wise error rate (FWER) or false discovery rate (FDR). FDR metrics have…

Quantitative Methods · Quantitative Biology 2007-05-23 Rishi L. Khan , Rajanikanth Vadigepalli , Guang Gao , James S. Schwaber

Dynamic Link Prediction (DLP) addresses the prediction of future links in evolving networks. However, accurately portraying the performance of DLP algorithms poses challenges that might impede progress in the field. Importantly, common…

Social and Information Networks · Computer Science 2024-05-28 Raphaël Romero , Maarten Buyl , Tijl De Bie , Jefrey Lijffijt

Deep reinforcement learning (RL) has shown remarkable success in specific offline decision-making scenarios, yet its theoretical guarantees are still under development. Existing works on offline RL theory primarily emphasize a few trivial…

Machine Learning · Computer Science 2023-12-20 Di Wu , Yuling Jiao , Li Shen , Haizhao Yang , Xiliang Lu

Customer data is often stored as records in Customer Relations Management systems (CRMs). Data which is manually entered into such systems by one of more users over time leads to data replication, partial duplication or fuzzy duplication.…

Computation and Language · Computer Science 2024-06-25 Ian Ormesher

The ever-increasing use of generative models in various fields where tabular data is used highlights the need for robust and standardized validation metrics to assess the similarity between real and synthetic data. Current methods lack a…

Machine Learning · Computer Science 2024-08-01 Patricia A. Apellániz , Ana Jiménez , Borja Arroyo Galende , Juan Parras , Santiago Zazo

Many differentially private (DP) data release systems either output DP synthetic data and leave analysts to perform inference as usual, which can lead to severe miscalibration, or output a DP point estimate without a principled way to do…

Machine Learning · Computer Science 2026-03-03 Amir Asiaee , Samhita Pal

In large scale multiple testing, the use of an empirical null distribution rather than the theoretical null distribution can be critical for correct inference. This paper proposes a ``mode matching'' method for fitting an empirical null…

Applications · Statistics 2009-01-27 Armin Schwartzman

Local differential privacy (LDP), a technique applying unbiased statistical estimations instead of real data, is often adopted in data collection. In particular, this technique is used with frequency oracles (FO) because it can protect each…

Cryptography and Security · Computer Science 2022-03-29 Dan Zhao , Suyun Zhao , Ruixuan Liu , Cuiping Li , Wenjuan Liang , Hong Chen

In many statistical problems the hypotheses are naturally divided into groups, and the investigators are interested to perform group-level inference, possibly along with inference on individual hypotheses. We consider the goal of…

Statistics Theory · Mathematics 2021-05-20 Marina Bogomolov

Clustering is a widely deployed unsupervised learning tool. Model-based clustering is a flexible framework to tackle data heterogeneity when the clusters have different shapes. Likelihood-based inference for mixture distributions often…

Machine Learning · Statistics 2023-05-30 Yubo Zhuang , Xiaohui Chen , Yun Yang

In the recent years, Local Differential Privacy (LDP) has been one of the corner stone of privacy preserving data analysis. However, many challenges still opposes its widespread application. One of these problems is the scalability of LDP…

Cryptography and Security · Computer Science 2022-06-15 Thomas Carette