English
Related papers

Related papers: RAPTT: An Exact Two-Sample Test in High Dimensions…

200 papers

We present a preconditioned Monte Carlo method for computing high-dimensional multivariate normal and Student-$t$ probabilities arising in spatial statistics. The approach combines a tile-low-rank representation of covariance matrices with…

Computation · Statistics 2020-11-26 Jian Cao , Marc G. Genton , David E. Keyes , George M. Turkiyyah

The classical likelihood ratio test (LRT) based on the asymptotic chi-squared distribution of the log likelihood is one of the fundamental tools of statistical inference. A recent universal LRT approach based on sample splitting provides…

Methodology · Statistics 2022-11-22 Robin Dunn , Aaditya Ramdas , Sivaraman Balakrishnan , Larry Wasserman

In this work we propose a framework for constructing goodness of fit tests in both low and high-dimensional linear models. We advocate applying regression methods to the scaled residuals following either an ordinary least squares or Lasso…

Methodology · Statistics 2017-04-11 Rajen D. Shah , Peter Bühlmann

This paper introduces Manhattan sampling in two and higher dimensions, and proves sampling theorems. In two dimensions, Manhattan sampling, which takes samples densely along a Manhattan grid of lines, can be viewed as sampling on the union…

Information Theory · Computer Science 2015-02-06 Matthew A. Prelee , David L. Neuhoff

Two-sample testing is a fundamental problem in statistics. Despite its long history, there has been renewed interest in this problem with the advent of high-dimensional and complex data. Specifically, in the machine learning literature,…

Methodology · Statistics 2019-11-19 Ilmun Kim , Ann B. Lee , Jing Lei

Equivalence testing, a fundamental problem in the field of distribution testing, seeks to infer if two unknown distributions on $[n]$ are the same or far apart in the total variation distance. Conditional sampling has emerged as a powerful…

Data Structures and Algorithms · Computer Science 2024-03-08 Diptarka Chakraborty , Sourav Chakraborty , Gunjan Kumar , Kuldeep S. Meel

This paper concerns a method of testing equality of distribution of random convex compact sets and the way how to use the test to distinguish between two realisations of general random sets. The family of metrics on the space of…

Statistics Theory · Mathematics 2018-01-09 Vesna Gotovac , Kateřina Helisová

The problem of approximating a matrix by a low-rank one has been extensively studied. This problem assumes, however, that the whole matrix has a low-rank structure. This assumption is often false for real-world matrices. We consider the…

Data Structures and Algorithms · Computer Science 2025-11-05 Martino Ciaperoni , Aristides Gionis , Heikki Mannila

In this work, we redefined two important statistics, the CLRT test (Bai et.al., Ann. Stat. 37 (2009) 3822-3840) and the LW test (Ledoit and Wolf, Ann. Stat. 30 (2002) 1081-1102) on identity tests for high dimensional data using random…

Methodology · Statistics 2013-04-12 Cheng Wang , Jing Yang , Baiqi Miao , Longbing Cao

The random sampling task performed by Google's Sycamore processor gave us a glimpse of the "Quantum Supremacy era". This has definitely shed some spotlight on the power of random quantum circuits in this abstract task of sampling outputs…

Quantum Physics · Physics 2024-01-23 Keerthi Kumaran , Manas Sajjan , Sangchul Oh , Sabre Kais

Joint ptychography and tomography (JPT) is a recently developed framework that enables high-resolution reconstruction of 3D volumes with significantly relaxed constraints on probe overlap at adjacent scan positions. In ptychographic X-ray…

Image and Video Processing · Electrical Eng. & Systems 2020-02-20 Azat M. Slyamov , Viktor Nikitin , Doğa Gürsoy , Rajmund Mokso , Jens W. Andreasen

In this paper, we consider testing the correlation coefficient matrix between two subsets of high-dimensional variables. We produce a test statistic by using the extended cross-data-matrix (ECDM) methodology and show the unbiasedness of…

Methodology · Statistics 2015-03-24 Kazuyoshi Yata , Makoto Aoshima

Random projections offer an appealing and flexible approach to a wide range of large-scale statistical problems. They are particularly useful in high-dimensional settings, where we have many covariates recorded for each observation. In…

Methodology · Statistics 2019-11-26 Timothy I. Cannings

In the study of computer codes, filling space as uniformly as possible is important to describe the complexity of the investigated phenomenon. However, this property is not conserved by reducing the dimension. Some numeric experiment…

Machine Learning · Computer Science 2008-02-19 Jessica Franco , Laurent Carraro , Olivier Roustant , Astrid Jourdan

A common disadvantage in existing distribution-free two-sample testing approaches is that the computational complexity could be high. Specifically, if the sample size is $N$, the computational complexity of those two-sample tests is at…

Methodology · Statistics 2017-07-18 Cheng Huang , Xiaoming Huo

Two-sample hypothesis testing is a fundamental problem with various applications, which faces new challenges in the high-dimensional context. To mitigate the issue of the curse of dimensionality, high-dimensional data are typically assumed…

Methodology · Statistics 2026-04-06 Jiaqi Gu , Ruoxu Tan , Guosheng Yin

Rare event probability estimation is an important topic in reliability analysis. Stochastic methods, such as importance sampling, have been developed to estimate such probabilities but they often fail in high dimension. In this paper, we…

Computation · Statistics 2021-08-24 Maxime El-Masri , Jérôme Morio , Florian Simatos

Analyzing large samples of high-dimensional data under dependence is a challenging statistical problem as long time series may have change points, most importantly in the mean and the marginal covariances, for which one needs valid tests.…

Methodology · Statistics 2022-11-07 Fabian Mies , Ansgar Steland

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

Numerical Analysis · Mathematics 2016-06-07 Victor Y. Pan , Liang Zhao

Estimates of the approximate factor model are increasingly used in empirical work. Their theoretical properties, studied some twenty years ago, also laid the ground work for analysis on large dimensional panel data models with cross-section…

Econometrics · Economics 2020-08-04 Jushan Bai , Serena Ng