English
Related papers

Related papers: Two-step estimators of high dimensional correlatio…

200 papers

We present a new strategy for filtering high-dimensional multiscale systems characterized by high-order non-Gaussian statistics using observations from leading-order moments. A closed stochastic-statistical modeling framework suitable for…

Mathematical Physics · Physics 2024-07-09 Di Qi , Jian-Guo Liu

A major challenge in cluster analysis is that the number of data clusters is mostly unknown and it must be estimated prior to clustering the observed data. In real-world applications, the observed data is often subject to heavy tailed noise…

Machine Learning · Statistics 2020-05-06 Freweyni K. Teklehaymanot , Michael Muma , Abdelhak M. Zoubir

Bayesian hierarchical modeling is a natural framework to effectively integrate data and borrow information across groups. In this paper, we address problems related to density estimation and identifying clusters across related groups, by…

Methodology · Statistics 2025-10-29 Huizi Zhang , Sara Wade , Natalia Bochkina

We introduce a new method for two-sample testing of high-dimensional linear regression coefficients without assuming that those coefficients are individually estimable. The procedure works by first projecting the matrices of covariates and…

Statistics Theory · Mathematics 2023-05-11 Fengnan Gao , Tengyao Wang

High covariate dimensionality is increasingly occurrent in model estimation, and existing techniques to address this issue typically require sparsity or discrete heterogeneity of the \emph{unobservable} parameter vector. However, neither…

Econometrics · Economics 2025-07-31 Abdul-Nasah Soale , Emmanuel Selorm Tsyawo

We introduce a very general method for sparse and large-scale variable selection. The large-scale regression settings is such that both the number of parameters and the number of samples are extremely large. The proposed method is based on…

Statistics Theory · Mathematics 2019-07-31 Jelena Bradic

Estimating time-varying correlation matrices is challenging because existing methods may adapt slowly to structural changes, impose insufficient regularization, or produce diffuse posterior uncertainty. In moderate dimensions, an additional…

Methodology · Statistics 2026-05-11 Daniel Andrew Coulson , David S. Matteson , Martin T. Wells

Correlation matrices are omnipresent in multivariate data analysis. When the number d of variables is large, the sample estimates of correlation matrices are typically noisy and conceal underlying dependence patterns. We consider the case…

Statistics Theory · Mathematics 2024-10-24 Samuel Perreault , Thierry Duchesne , Johanna G. Nešlehová

Tensor clustering, which seeks to extract underlying cluster structures from noisy tensor observations, has gained increasing attention. One extensively studied model for tensor clustering is the tensor block model, which postulates the…

Statistics Theory · Mathematics 2023-11-07 Yuchen Zhou , Yuxin Chen

We often seek to estimate the impact of an exposure naturally occurring or randomly assigned at the cluster-level. For example, the literature on neighborhood determinants of health continues to grow. Likewise, community randomized trials…

Methodology · Statistics 2021-07-08 Laura B. Balzer , Wenjing Zheng , Mark J. van der Laan , Maya L. Petersen

We propose a methodology to parallelize Hamiltonian Monte Carlo estimators. Our approach constructs a pair of Hamiltonian Monte Carlo chains that are coupled in such a way that they meet exactly after some random number of iterations. These…

Computation · Statistics 2018-08-28 Jeremy Heng , Pierre E. Jacob

We consider estimation in a high-dimensional linear model with strongly correlated variables. We propose to cluster the variables first and do subsequent sparse estimation such as the Lasso for cluster-representatives or the group Lasso…

Methodology · Statistics 2015-01-14 Peter Bühlmann , Philipp Rütimann , Sara van de Geer , Cun-Hui Zhang

Co-clustering simultaneously clusters rows and columns, revealing more fine-grained groups. However, existing co-clustering methods suffer from poor scalability and cannot handle large-scale data. This paper presents a novel and scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Zihan Wu , Zhaoke Huang , Hong Yan

In extreme value statistics for stationary sequences, blocks estimators are usually constructed by using disjoint blocks because exceedances over high thresholds of different blocks can be assumed asymptotically independent. In this paper…

Statistics Theory · Mathematics 2008-12-23 Christian Y. Robert , Johan Segers , Christopher A. T. Ferro

Bayesian shrinkage methods have generated a lot of recent interest as tools for high-dimensional regression and model selection. These methods naturally facilitate tractable uncertainty quantification and incorporation of prior information.…

Computation · Statistics 2017-04-17 Bala Rajaratnam , Doug Sparks , Kshitij Khare , Liyuan Zhang

High-order clustering aims to identify heterogeneous substructures in multiway datasets that arise commonly in neuroimaging, genomics, social network studies, etc. The non-convex and discontinuous nature of this problem pose significant…

Methodology · Statistics 2022-10-11 Rungang Han , Yuetian Luo , Miaoyan Wang , Anru R. Zhang

Network clustering reveals the organization of a network or corresponding complex system with elements represented as vertices and interactions as edges in a (directed, weighted) graph. Although the notion of clustering can be somewhat…

Machine Learning · Statistics 2017-11-15 Yongjin Park , Joel S. Bader

Finding a set of nested partitions of a dataset is useful to uncover relevant structure at different scales, and is often dealt with a data-dependent methodology. In this paper, we introduce a general two-step methodology for model-based…

Computation · Statistics 2021-04-22 Etienne Côme , Nicolas Jouvin , Pierre Latouche , Charles Bouveyron

Getting a robust time-series clustering with best choice of distance measure and appropriate representation is always a challenge. We propose a novel mechanism to identify the clusters combining learned compact representation of…

Machine Learning · Computer Science 2021-01-12 Soma Bandyopadhyay , Anish Datta , Arpan Pal

Spectral clustering has been one of the widely used methods for community detection in networks. However, large-scale networks bring computational challenges to the eigenvalue decomposition therein. In this paper, we study the spectral…

Social and Information Networks · Computer Science 2022-01-07 Hai Zhang , Xiao Guo , Xiangyu Chang