English
Related papers

Related papers: Permutation-based true discovery proportions for f…

200 papers

In qualitative statistics, permutation tests are very popular, mainly because of their finite-sample exactness under exchangeability. However, in non-exchangeable settings, the covariance structure of permuted statistics typically differs…

Methodology · Statistics 2026-04-09 Merle Munko , Paavo Sattler

The estimation of functional networks through functional covariance and graphical models have recently attracted increasing attention in settings with high dimensional functional data, where the number of functional variables p is…

Statistics Theory · Mathematics 2024-09-05 Qin Fang , Qing Jiang , Xinghao Qiao

In this paper, we advocate a novel measure for the purpose of checking the quality of a cluster partition for a sample into several distinct classes, and thus, determine the unknown value for the true number of clusters prevailing the…

Applications · Statistics 2024-04-12 Soumita Modak

Threshold-free cluster enhancement (TFCE) integrates cluster extent across thresholds to improve voxel-wise neuroimaging inference, but permutation testing makes it prohibitively slow for large datasets. Probabilistic TFCE (pTFCE) uses…

Image and Video Processing · Electrical Eng. & Systems 2026-05-08 Don Yin , Hao Chen , Takeshi Miki , Enyu Yang

We propose a novel method for multiple clustering that assumes a co-clustering structure (partitions in both rows and columns of the data matrix) in each view. The new method is applicable to high-dimensional data. It is based on a…

Selective inference aims at providing valid inference after a data-driven selection of models or hypotheses. It is essential to avoid overconfident results and replicability issues. While significant advances have been made in this area for…

Methodology · Statistics 2025-03-14 Matteo D'Alessandro , Magne Thoresen

Clustering is a central approach for unsupervised learning. After clustering is applied, the most fundamental analysis is to quantitatively compare clusterings. Such comparisons are crucial for the evaluation of clustering methods as well…

Machine Learning · Statistics 2017-10-03 Alexander J Gates , Yong-Yeol Ahn

We introduce a new method for performing clustering with the aim of fitting clusters with different scatters and weights. It is designed by allowing to handle a proportion $\alpha$ of contaminating data to guarantee the robustness of the…

Statistics Theory · Mathematics 2008-12-18 Luis A. García-Escudero , Alfonso Gordaliza , Carlos Matrán , Agustin Mayo-Iscar

In some complicated datasets, due to the presence of noisy data points and outliers, cluster validity indices can give conflicting results in determining the optimal number of clusters. This paper presents a new validity index for…

Machine Learning · Computer Science 2020-05-20 Mohammad Hossein Fazel Zarandi , Shahabeddin Sotudian , Oscar Castillo

In this paper we propose a measure of clustering quality or accuracy that is appropriate in situations where it is desirable to evaluate a clustering algorithm by somehow comparing the clusters it produces with ``ground truth' consisting of…

Machine Learning · Computer Science 2013-01-07 Byron E Dom

Despite the accelerating presence of exploratory causal analysis in modern science and medicine, the available non-experimental methods for validating causal models are not well characterized. One of the most popular methods is to evaluate…

Methodology · Statistics 2025-03-20 Ritwick Banerjee , Bryan Andrews , Erich Kummerfeld

Inferring cluster structure in microarray datasets is a fundamental task for the -omic sciences. A fundamental question in Statistics, Data Analysis and Classification, is the prediction of the number of clusters in a dataset, usually…

Data Structures and Algorithms · Computer Science 2011-02-16 Filippo Utro

We consider a permutation method for testing whether observations given in their natural pairing exhibit an unusual level of similarity in situations where any two observations may be similar at some unknown baseline level. Under a null…

Statistics Theory · Mathematics 2007-06-13 Larry Goldstein , Yosef Rinott

Compressive sensing has become a powerful addition to uncertainty quantification in recent years. This paper identifies new bases for random variables through linear mappings such that the representation of the quantity of interest is more…

Statistics Theory · Mathematics 2016-03-08 Xiu Yang , Huan Lei , Nathan A. Baker , Guang Lin

Semi-supervised clustering is the task of clustering data points into clusters where only a fraction of the points are labelled. The true number of clusters in the data is often unknown and most models require this parameter as an input.…

Machine Learning · Computer Science 2013-09-27 Amar Shah , Zoubin Ghahramani

The Markov Chain Monte Carlo (MCMC) algorithm is a widely recognised as an efficient method for sampling a specified posterior distribution. However, when the posterior is multi-modal, conventional MCMC algorithms either tend to become…

Instrumentation and Methods for Astrophysics · Physics 2014-08-19 Yi-Ming Hu , Martin Hendry , Ik Siong Heng

We study a linear observation model with an unknown permutation called \textit{permuted/shuffled linear regression}, where responses and covariates are mismatched and the permutation forms a discrete, factorial-size parameter. The…

Statistics Theory · Mathematics 2026-01-23 Hirofumi Ota , Masaaki Imaizumi

Multiple hypothesis testing is widely used to evaluate scientific studies involving statistical tests. However, for many of these tests, p-values are not available and are thus often approximated using Monte Carlo tests such as permutation…

Applications · Statistics 2018-10-17 Axel Gandy , Georg Hahn

Several factors make clustering of functional data challenging, including the infinite-dimensional space to which observations belong and the lack of a defined probability density function for the functional random variable. To overcome…

Methodology · Statistics 2025-02-03 Andi Mai , Lan Xue , Roger Zoh , Carmen Tekwe

We propose a new model-independent method for new physics searches called Cluster Scanning. It uses the k-means algorithm to perform clustering in the space of low-level event or jet observables, and separates potentially anomalous clusters…

High Energy Physics - Phenomenology · Physics 2024-05-22 Ivan Oleksiyuk , John Andrew Raine , Michael Krämer , Svyatoslav Voloshynovskiy , Tobias Golling