中文
相关论文

相关论文: Online multiple testing with super-uniformity rewa…

200 篇论文

Multiple hypothesis testing is a core problem in statistical inference and arises in almost every scientific field. Given a set of null hypotheses $\mathcal{H}(n) = (H_1,\dotsc, H_n)$, Benjamini and Hochberg introduced the false discovery…

统计理论 · 数学 2017-07-10 Adel Javanmard , Andrea Montanari

To provide rigorous uncertainty quantification for online learning models, we develop a framework for constructing uncertainty sets that provably control risk -- such as coverage of confidence intervals, false negative rate, or F1 score --…

机器学习 · 计算机科学 2023-01-30 Shai Feldman , Liran Ringel , Stephen Bates , Yaniv Romano

Important advances have recently been achieved in developing procedures yielding uniformly valid inference for a low dimensional causal parameter when high-dimensional nuisance models must be estimated. In this paper, we review the…

统计理论 · 数学 2025-09-08 Niloofar Moosavi , Jenny Häggström , Xavier de Luna

Many environments currently employ machine learning models for data processing and analytics that were built using a limited number of training data points. Once deployed, the models are exposed to significant amounts of previously-unseen…

机器学习 · 计算机科学 2020-05-21 Justin E. Doak , Michael R. Smith , Joey B. Ingram

The Seemingly Unrelated Regressions (SUR) model is a wide used estimation procedure in econometrics, insurance and finance, where very often, the regression model contains more than one equation. Unknown parameters, regression coefficients…

统计方法学 · 统计学 2021-07-05 Giovanni Saraceno , Fatemah Alqallaf , Claudio Agostinelli

This paper will focus on the process of 'fusing' several observations or models of uncertainty into a single resultant model. Many existing approaches to fusion use subjective quantities such as 'strengths of belief' and process these…

人工智能 · 计算机科学 2020-07-28 Shawn C. Eastwood , Svetlana N. Yanushkevich

The success of deep learning in transient stability assessment (TSA) heavily relies on high-quality training data. However, the label information in TSA datasets is vulnerable to contamination through false label injection (FLI)…

机器学习 · 计算机科学 2024-06-12 Hanxuan Wang , Na Lu , Yinhong Liu , Zhuqing Wang , Zixuan Wang

Online testing procedures aim to control the extent of false discoveries over a sequence of hypothesis tests, allowing for the possibility that early-stage test results influence the choice of hypotheses to be tested in later stages.…

统计方法学 · 统计学 2021-10-18 Aaron Fisher

Safe exploration is a key requirement for reinforcement learning (RL) agents to learn and adapt online, beyond controlled (e.g. simulated) environments. In this work, we tackle this challenge by utilizing suboptimal yet conservative…

机器学习 · 计算机科学 2026-02-10 Manuel Wendl , Yarden As , Manish Prajapat , Anton Pollak , Stelian Coros , Andreas Krause

In this paper, we revisit the classical goodness-of-fit problems for univariate distributions; we propose a new testing procedure based on a characterisation of the uniform distribution. Asymptotic theory for the simple hypothesis case is…

统计方法学 · 统计学 2021-08-17 Bruno Ebner , Shawn Liebenberg , Jaco Visagie

One important partition of algorithms for controlling the false discovery rate (FDR) in multiple testing is into offline and online algorithms. The first generally achieve significantly higher power of discovery, while the latter allow…

统计方法学 · 统计学 2021-03-05 Tijana Zrnic , Daniel L. Jiang , Aaditya Ramdas , Michael I. Jordan

Large language models have demonstrated remarkable capabilities in complex mathematical reasoning tasks, but they inevitably generate errors throughout multi-step solutions. Process-level Reward Models (PRMs) have shown great promise by…

人工智能 · 计算机科学 2025-08-05 Jiuzhou Han , Wray Buntine , Ehsan Shareghi

Post-training LLMs with Reinforcement Learning, specifically Group Relative Policy Optimization (GRPO), has emerged as a paradigm for enhancing mathematical reasoning. However, standard GRPO relies on scalar correctness rewards that are…

计算与语言 · 计算机科学 2026-03-03 Xiwen Chen , Wenhui Zhu , Peijie Qiu , Xuanzhao Dong , Hao Wang , Haiyu Wu , Huayu Li , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

In this paper, we address conditional testing problems through the conformal inference framework. We define the localized conformal p-values by inverting prediction intervals and prove their theoretical properties. These defined p-values…

统计方法学 · 统计学 2024-09-26 Xiaoyang Wu , Lin Lu , Zhaojun Wang , Changliang Zou

Semi-supervised learning (SSL) has witnessed great progress with various improvements in the self-training framework with pseudo labeling. The main challenge is how to distinguish high-quality pseudo labels against the confirmation bias.…

机器学习 · 计算机科学 2024-02-21 Siyuan Li , Weiyang Jin , Zedong Wang , Fang Wu , Zicheng Liu , Cheng Tan , Stan Z. Li

While Distributional Reinforcement Learning (DRL) methods have demonstrated strong performance in online settings, its success in offline scenarios remains limited. We hypothesize that a key limitation of existing offline DRL methods lies…

机器学习 · 计算机科学 2026-01-06 Ryo Iwaki , Takayuki Osogami

This paper introduces a novel conformal selection procedure, inspired by the Neyman--Pearson paradigm, to maximize the power of selecting qualified units while maintaining false discovery rate (FDR) control. Existing conformal selection…

统计方法学 · 统计学 2025-02-25 Jing Qin , Yukun Liu , Moming Li , Chiung-Yu Huang

Post-training for reasoning of large language models (LLMs) increasingly relies on verifiable rewards: deterministic checkers that provide 0-1 correctness signals. While reliable, such binary feedback is brittle--many tasks admit partially…

计算与语言 · 计算机科学 2025-10-20 Leitian Tao , Ilia Kulikov , Swarnadeep Saha , Tianlu Wang , Jing Xu , Sharon Li , Jason E Weston , Ping Yu

In multiple hypothesis testing, it is well known that adaptive procedures can enhance power via incorporating information about the number of true nulls present. Under independence, we establish that two adaptive false discovery rate (FDR)…

统计方法学 · 统计学 2024-01-25 Dennis Leung , Ninh Tran

Assessing uncertainty is an important step towards ensuring the safety and reliability of machine learning systems. Existing uncertainty estimation techniques may fail when their modeling assumptions are not met, e.g. when the data…

机器学习 · 计算机科学 2017-01-24 Volodymyr Kuleshov , Stefano Ermon