English
Related papers

Related papers: Where to find needles in a haystack?

200 papers

Policymakers often use recursive binary split rules to partition populations based on binary outcomes and target subpopulations whose probability of the binary event exceeds a threshold. We call such problems Latent Probability…

Machine Learning · Statistics 2025-10-03 Lei Bill Wang , Zhenbang Jiao , Fangyi Wang

In large scale multiple testing, the use of an empirical null distribution rather than the theoretical null distribution can be critical for correct inference. This paper proposes a ``mode matching'' method for fitting an empirical null…

Applications · Statistics 2009-01-27 Armin Schwartzman

For high-dimensional classification, it is well known that naively performing the Fisher discriminant rule leads to poor results due to diverging spectra and noise accumulation. Therefore, researchers proposed independence rules to…

Machine Learning · Statistics 2011-11-10 Jianqing Fan , Yang Feng , Xin Tong

We propose a new method for predicting multiple missing links in partially observed networks while controlling the false discovery rate (FDR), a largely unresolved challenge in network analysis. The main difficulty lies in handling complex…

Methodology · Statistics 2025-07-10 Wenqin Du , Wanteng Ma , Dong Xia , Yuan Zhang , Wen Zhou

Multiple comparison procedures that control a family-wise error rate or false discovery rate provide an achieved error rate as the adjusted p-value for each hypothesis tested. However, since such p-values are not probabilities that the null…

Methodology · Statistics 2013-09-03 David R. Bickel

The spiked Fisher matrix is a significant topic for two-sample problems in multivariate statistical inference. This paper is dedicated to testing the number of spikes in a high-dimensional generalized spiked Fisher matrix that relaxes the…

Statistics Theory · Mathematics 2025-02-26 Rui Wang , Dandan Jiang

To ensure the out-of-distribution (OOD) generalization performance, traditional domain generalization (DG) methods resort to training on data from multiple sources with different underlying distributions. And the success of those DG methods…

Machine Learning · Computer Science 2023-05-26 Zheyan Shen , Han Yu , Peng Cui , Jiashuo Liu , Xingxuan Zhang , Linjun Zhou , Furui Liu

Standard (network) meta-analysis methods for medical test accuracy evaluation analyse the data separately for each test threshold - wasting data - unless every study reports all thresholds. Previously proposed "multiple threshold" models…

Cluster randomized trials are widely used when individual randomization is logistically infeasible or when correlations between observations cannot be ignored, especially in fields such as ophthalmology, infectious disease, vaccine…

Methodology · Statistics 2026-05-04 Wanying Shao , Toshimitsu Hamasaki , Scott Evans , Guoqing Diao

Personalized federated learning algorithms have shown promising results in adapting models to various distribution shifts. However, most of these methods require labeled data on testing clients for personalization, which is usually…

Machine Learning · Computer Science 2023-10-31 Wenxuan Bao , Tianxin Wei , Haohan Wang , Jingrui He

Weakly supervised temporal action localization (WTAL) aims to detect action instances in untrimmed videos using only video-level annotations. Since many existing works optimize WTAL models based on action classification labels, they…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Geuntaek Lim , Hyunwoo Kim , Joonsoo Kim , Yukyung Choi

We propose a new method named the Conditional Randomization Rank Test (CRRT) for testing conditional independence of a response variable Y and a covariate variable X, conditional on the rest of the covariates Z. The new method generalizes…

Methodology · Statistics 2021-12-02 Yanjie Zhong , Todd Kuffner , Soumendra Lahiri

We develop a new density-based clustering algorithm named CRAD which is based on a new neighbor searching function with a robust data depth as the dissimilarity measure. Our experiments prove that the new CRAD is highly competitive at…

Computation · Statistics 2019-04-09 Xin Huang , Yulia R. Gel

Learning from a label distribution has achieved promising results on ordinal regression tasks such as facial age and head pose estimation wherein, the concept of adaptive label distribution learning (ALDL) has drawn lots of attention…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Qiang Li , Jingjing Wang , Zhaoliang Yao , Yachun Li , Pengju Yang , Jingwei Yan , Chunmao Wang , Shiliang Pu

Compared to supervised variable selection, the research on unsupervised variable selection is far behind. A forward partial-variable clustering full-variable loss (FPCFL) method is proposed for the corresponding challenges. An advantage is…

Methodology · Statistics 2024-12-02 Tonglin Zhang , Huyunting Huang

Conventional event detection models under supervised learning settings suffer from the inability of transfer to newly-emerged event types owing to lack of sufficient annotations. A commonly-adapted solution is to follow a…

Computation and Language · Computer Science 2022-10-24 Ruihan Zhang , Wei Wei , Xian-Ling Mao , Rui Fang , Dangyang Chen

Conditional value-at-risk (CVaR) and value-at-risk (VaR) are popular tail-risk measures in finance and insurance industries as well as in highly reliable, safety-critical uncertain environments where often the underlying probability…

Machine Learning · Computer Science 2021-06-23 Shubhada Agrawal , Wouter M. Koolen , Sandeep Juneja

This paper studies a factor modeling-based approach for clustering high-dimensional data generated from a mixture of strongly correlated variables. Statistical modeling with correlated structures pervades modern applications in economics,…

Statistics Theory · Mathematics 2024-08-23 Shange Tang , Soham Jana , Jianqing Fan

We consider offline detection of a single changepoint in binary and count time-series. We compare exact tests based on the cumulative sum (CUSUM) and the likelihood ratio (LR) statistics, and a new proposal that combines exact two-sample…

Methodology · Statistics 2020-08-21 Shyamal K. De , Soumendu Sundar Mukherjee

How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class similarity, whether by constructing positive and negative…

Machine Learning · Computer Science 2024-08-21 Qingsong Zhao , Yi Wang , Shuguang Dou , Chen Gong , Yin Wang , Cairong Zhao