English
Related papers

Related papers: Online multiple testing with super-uniformity rewa…

200 papers

Multiple hypothesis testing is a core problem in statistical inference and arises in almost every scientific field. Given a set of null hypotheses $\mathcal{H}(n) = (H_1,\dotsc, H_n)$, Benjamini and Hochberg introduced the false discovery…

Statistics Theory · Mathematics 2017-07-10 Adel Javanmard , Andrea Montanari

To provide rigorous uncertainty quantification for online learning models, we develop a framework for constructing uncertainty sets that provably control risk -- such as coverage of confidence intervals, false negative rate, or F1 score --…

Machine Learning · Computer Science 2023-01-30 Shai Feldman , Liran Ringel , Stephen Bates , Yaniv Romano

Important advances have recently been achieved in developing procedures yielding uniformly valid inference for a low dimensional causal parameter when high-dimensional nuisance models must be estimated. In this paper, we review the…

Statistics Theory · Mathematics 2025-09-08 Niloofar Moosavi , Jenny Häggström , Xavier de Luna

Many environments currently employ machine learning models for data processing and analytics that were built using a limited number of training data points. Once deployed, the models are exposed to significant amounts of previously-unseen…

Machine Learning · Computer Science 2020-05-21 Justin E. Doak , Michael R. Smith , Joey B. Ingram

The Seemingly Unrelated Regressions (SUR) model is a wide used estimation procedure in econometrics, insurance and finance, where very often, the regression model contains more than one equation. Unknown parameters, regression coefficients…

Methodology · Statistics 2021-07-05 Giovanni Saraceno , Fatemah Alqallaf , Claudio Agostinelli

This paper will focus on the process of 'fusing' several observations or models of uncertainty into a single resultant model. Many existing approaches to fusion use subjective quantities such as 'strengths of belief' and process these…

Artificial Intelligence · Computer Science 2020-07-28 Shawn C. Eastwood , Svetlana N. Yanushkevich

The success of deep learning in transient stability assessment (TSA) heavily relies on high-quality training data. However, the label information in TSA datasets is vulnerable to contamination through false label injection (FLI)…

Machine Learning · Computer Science 2024-06-12 Hanxuan Wang , Na Lu , Yinhong Liu , Zhuqing Wang , Zixuan Wang

Online testing procedures aim to control the extent of false discoveries over a sequence of hypothesis tests, allowing for the possibility that early-stage test results influence the choice of hypotheses to be tested in later stages.…

Methodology · Statistics 2021-10-18 Aaron Fisher

Safe exploration is a key requirement for reinforcement learning (RL) agents to learn and adapt online, beyond controlled (e.g. simulated) environments. In this work, we tackle this challenge by utilizing suboptimal yet conservative…

Machine Learning · Computer Science 2026-02-10 Manuel Wendl , Yarden As , Manish Prajapat , Anton Pollak , Stelian Coros , Andreas Krause

In this paper, we revisit the classical goodness-of-fit problems for univariate distributions; we propose a new testing procedure based on a characterisation of the uniform distribution. Asymptotic theory for the simple hypothesis case is…

Methodology · Statistics 2021-08-17 Bruno Ebner , Shawn Liebenberg , Jaco Visagie

One important partition of algorithms for controlling the false discovery rate (FDR) in multiple testing is into offline and online algorithms. The first generally achieve significantly higher power of discovery, while the latter allow…

Methodology · Statistics 2021-03-05 Tijana Zrnic , Daniel L. Jiang , Aaditya Ramdas , Michael I. Jordan

Large language models have demonstrated remarkable capabilities in complex mathematical reasoning tasks, but they inevitably generate errors throughout multi-step solutions. Process-level Reward Models (PRMs) have shown great promise by…

Artificial Intelligence · Computer Science 2025-08-05 Jiuzhou Han , Wray Buntine , Ehsan Shareghi

Post-training LLMs with Reinforcement Learning, specifically Group Relative Policy Optimization (GRPO), has emerged as a paradigm for enhancing mathematical reasoning. However, standard GRPO relies on scalar correctness rewards that are…

Computation and Language · Computer Science 2026-03-03 Xiwen Chen , Wenhui Zhu , Peijie Qiu , Xuanzhao Dong , Hao Wang , Haiyu Wu , Huayu Li , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

In this paper, we address conditional testing problems through the conformal inference framework. We define the localized conformal p-values by inverting prediction intervals and prove their theoretical properties. These defined p-values…

Methodology · Statistics 2024-09-26 Xiaoyang Wu , Lin Lu , Zhaojun Wang , Changliang Zou

Semi-supervised learning (SSL) has witnessed great progress with various improvements in the self-training framework with pseudo labeling. The main challenge is how to distinguish high-quality pseudo labels against the confirmation bias.…

Machine Learning · Computer Science 2024-02-21 Siyuan Li , Weiyang Jin , Zedong Wang , Fang Wu , Zicheng Liu , Cheng Tan , Stan Z. Li

While Distributional Reinforcement Learning (DRL) methods have demonstrated strong performance in online settings, its success in offline scenarios remains limited. We hypothesize that a key limitation of existing offline DRL methods lies…

Machine Learning · Computer Science 2026-01-06 Ryo Iwaki , Takayuki Osogami

This paper introduces a novel conformal selection procedure, inspired by the Neyman--Pearson paradigm, to maximize the power of selecting qualified units while maintaining false discovery rate (FDR) control. Existing conformal selection…

Methodology · Statistics 2025-02-25 Jing Qin , Yukun Liu , Moming Li , Chiung-Yu Huang

Post-training for reasoning of large language models (LLMs) increasingly relies on verifiable rewards: deterministic checkers that provide 0-1 correctness signals. While reliable, such binary feedback is brittle--many tasks admit partially…

Computation and Language · Computer Science 2025-10-20 Leitian Tao , Ilia Kulikov , Swarnadeep Saha , Tianlu Wang , Jing Xu , Sharon Li , Jason E Weston , Ping Yu

In multiple hypothesis testing, it is well known that adaptive procedures can enhance power via incorporating information about the number of true nulls present. Under independence, we establish that two adaptive false discovery rate (FDR)…

Methodology · Statistics 2024-01-25 Dennis Leung , Ninh Tran

Assessing uncertainty is an important step towards ensuring the safety and reliability of machine learning systems. Existing uncertainty estimation techniques may fail when their modeling assumptions are not met, e.g. when the data…

Machine Learning · Computer Science 2017-01-24 Volodymyr Kuleshov , Stefano Ermon