English
Related papers

Related papers: Distribution-Free, Size Adaptive Submatrix Detecti…

200 papers

This paper considers inference for conditional moment inequality models using a multiscale statistic. We derive the asymptotic distribution of this test statistic and use the result to propose feasible critical values that have a simple…

Applications · Statistics 2015-12-10 Timothy B. Armstrong , Hock Peng Chan

Researchers in genetics and other life sciences commonly use permutation tests to evaluate differences between groups. Permutation tests have desirable properties, including exactness if data are exchangeable, and are applicable even when…

Computation · Statistics 2018-11-01 Brian Segal , Thomas Braun , Michael Elliott , Hui Jiang

We give the first algorithm for Matrix Completion whose running time and sample complexity is polynomial in the rank of the unknown target matrix, linear in the dimension of the matrix, and logarithmic in the condition number of the matrix.…

Machine Learning · Computer Science 2014-07-16 Moritz Hardt , Mary Wootters

Feature selection is a critical step in the analysis of high-dimensional data, where the number of features often vastly exceeds the number of samples. Effective feature selection not only improves model performance and interpretability but…

Machine Learning · Computer Science 2025-01-27 Raquel Espinosa , Gracia Sánchez , José Palma , Fernando Jiménez

For large-scale testing with graph-associated data, we present an empirical Bayes mixture technique to score local false discovery rates. Compared to empirical Bayes procedures that ignore the graph, the proposed method gains power in…

Methodology · Statistics 2019-11-26 TIen Vo , Vamsi Ithapu , Vikas Singh , Michael A. Newton

Detector-based and detector-free matchers are only applicable within their respective sparsity ranges. To improve adaptability of existing matchers, this paper introduces a novel probabilistic reweighting method. Our method is applicable to…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Ya Fan , Rongling Lang

Often in multiple testing, the hypotheses appear in non-overlapping blocks with the associated $p$-values exhibiting dependence within but not between blocks. We consider adapting the Benjamini-Hochberg method for controlling the false…

Methodology · Statistics 2016-11-11 Wenge Guo , Sanat Sarkar

Training large transformer models from scratch for a target task requires lots of data and is computationally demanding. The usual practice of transfer learning overcomes this challenge by initializing the model with weights of a pretrained…

We propose a nonparametric procedure to test for changes in correlation matrices at an unknown point in time. The new test requires only mild assumptions on the serial dependence structure and has considerable power in finite samples. We…

Methodology · Statistics 2014-10-29 Dominik Wied

We introduce PseudoNet, a new pseudolikelihood-based estimator of the inverse covariance matrix, that has a number of useful statistical and computational properties. We show, through detailed experiments with synthetic and also real-world…

Methodology · Statistics 2016-10-17 Alnur Ali , Kshitij Khare , Sang-Yun Oh , Bala Rajaratnam

In this paper we consider the uniformity testing problem for high-dimensional discrete distributions (multinomials) under sparse alternatives. More precisely, we derive sharp detection thresholds for testing, based on $n$ samples, whether a…

Statistics Theory · Mathematics 2022-02-17 Bhaswar B. Bhattacharya , Rajarshi Mukherjee

Many applications, including rank aggregation, crowd-labeling, and graphon estimation, can be modeled in terms of a bivariate isotonic matrix with unknown permutations acting on its rows and/or columns. We consider the problem of estimating…

Machine Learning · Statistics 2019-10-29 Cheng Mao , Ashwin Pananjady , Martin J. Wainwright

Matrix completion is a modern missing data problem where both the missing structure and the underlying parameter are high dimensional. Although missing structure is a key component to any missing data problems, existing matrix completion…

Machine Learning · Statistics 2020-03-23 Xiaojun Mao , Raymond K. W. Wong , Song Xi Chen

This paper develops an inferential theory for high-dimensional matrix-variate factor models with missing observations. We propose an easy-to-use all-purpose method that involves two straightforward steps. First, we perform principal…

Methodology · Statistics 2025-03-26 Yongxia Zhang , Jinwen Liang , Liwen Xu , Keming Yu , Maozai Tian

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

Methodology · Statistics 2017-12-12 Yi-Hui Zhou

This work is concerned with the detection of a mixture distribution from a $\mathbb{R}$-valued sample. Given a sample $X_1,\dots,X_n$ and an even density $\phi$, our aim is to detect whether the sample distribution is $\phi(\cdot-\mu)$ for…

Statistics Theory · Mathematics 2016-01-22 Béatrice Laurent , Clément Marteau , Cathy Maugis-Rabusseau

The technique of subsampling has been extensively employed to address the challenges posed by limited computing resources and meet the needs for expedite data analysis. Various subsampling methods have been developed to meet the challenges…

Methodology · Statistics 2024-09-24 Haixiang Zhang , HaiYing Wang

This paper addresses classification problems with matrix-valued data, which commonly arise in applications such as neuroimaging and signal processing. Building on the assumption that the data from each class follows a matrix normal…

Methodology · Statistics 2025-12-18 Seungyeon Oh , Seongoh Park , Hoyoung Park

In a sequence of multivariate observations or non-Euclidean data objects, such as networks, local dependence is common and could lead to false change-point discoveries. We propose a new way of permutation -- circular block permutation with…

Methodology · Statistics 2019-03-06 Hao Chen

We present a machine learning approach for model-independent new physics searches. The corresponding algorithm is powered by recent large-scale implementations of kernel methods, nonparametric learning algorithms that can approximate any…

High Energy Physics - Phenomenology · Physics 2022-10-17 Marco Letizia , Gianvito Losapio , Marco Rando , Gaia Grosso , Andrea Wulzer , Maurizio Pierini , Marco Zanetti , Lorenzo Rosasco