English
Related papers

Related papers: Two-step estimators of high dimensional correlatio…

200 papers

We consider the problem of jointly modeling and clustering populations of tensors by introducing a high-dimensional tensor mixture model with heterogeneous covariances. To effectively tackle the high dimensionality of tensor objects, we…

Methodology · Statistics 2024-11-21 Biao Cai , Jingfei Zhang , Will Wei Sun

Estimation of the ordered scale parameter of a two scale mixture of the exponential distribution is considered under Stein loss and symmetric loss. Under certain conditions, we prove that the inadmissibility equivariant estimator exhibits…

Statistics Theory · Mathematics 2025-12-11 Somnath Mondal , Lakshmi Kanta Patra

Cross-validation is a statistical tool that can be used to improve large covariance matrix estimation. Although its efficiency is observed in practical applications and a convergence result towards the error of the non linear shrinkage is…

Statistics Theory · Mathematics 2025-09-18 Lamia Lamrani , Christian Bongiorno , Marc Potters

We consider Bayesian estimation of a hierarchical linear model (HLM) from partially observed data, assumed to be missing at random, and small sample sizes. A vector of continuous covariates $C$ includes cluster-level partially observed…

Methodology · Statistics 2025-02-03 Dongho Shin , Yongyun Shin , Nao Hagiwara

When fitting statistical models, some predictors are often found to be correlated with each other, and functioning together. Many group variable selection methods are developed to select the groups of predictors that are closely related to…

Methodology · Statistics 2021-03-25 Zhiyuan Li

We develop a scalable multi-step Monte Carlo algorithm for inference under a large class of nonparametric Bayesian models for clustering and classification. Each step is "embarrassingly parallel" and can be implemented using the same Markov…

Computation · Statistics 2018-06-08 Yang Ni , Peter Müller , Maurice Diesendruck , Sinead Williamson , Yitan Zhu , Yuan Ji

Generalized estimating equations (GEE) are of great importance in analyzing clustered data without full specification of multivariate distributions. A recent approach jointly models the mean, variance, and correlation coefficients of…

Methodology · Statistics 2025-01-13 Zhenyu Xu , Jason P. Fine , Wenling Song , Jun Yan

Cluster analysis faces two problems in high dimensions: first, the `curse of dimensionality' that can lead to overfitting and poor generalization performance; and second, the sheer time taken for conventional algorithms to process large…

Quantitative Methods · Quantitative Biology 2013-09-12 Shabnam N. Kadir , Dan F. M. Goodman , Kenneth D. Harris

Spectral clustering is a celebrated algorithm that partitions objects based on pairwise similarity information. While this approach has been successfully applied to a variety of domains, it comes with limitations. The reason is that there…

Statistics Theory · Mathematics 2018-05-24 Kwangjun Ahn , Kangwook Lee , Changho Suh

In cluster analysis interest lies in probabilistically capturing partitions of individuals, items or observations into groups, such that those belonging to the same group share similar attributes or relational profiles. Bayesian posterior…

Methodology · Statistics 2017-03-23 Riccardo Rastelli , Nial Friel

Most of the research on clustering ensemble focuses on designing practical consistency learning algorithms.To solve the problems that the quality of base clusters varies and the low-quality base clusters have an impact on the performance of…

Machine Learning · Computer Science 2024-11-04 Jianwen Gan , Yan Chen , Peng Zhou , Liang Du

With the advent of structured data in the form of social networks, genetic circuits and protein interaction networks, statistical analysis of networks has gained popularity over recent years. Stochastic block model constitutes a classical…

Statistics Theory · Mathematics 2015-05-27 Debdeep Pati , Anirban Bhattacharya

A doubly type-II censored scheme is an important sampling scheme in the life testing experiment and reliability engineering. In the present commutation, we have considered estimating ordered scale parameters of two exponential distributions…

Statistics Theory · Mathematics 2024-12-09 Shrajal Bajpai , Lakshmi Kanta Patra

Recently, many machine learning and statistical models such as non-linear regressions, the Single Index, Multi-index, Varying Coefficient Index Models and Two-layer Neural Networks can be reduced to or be seen as a special case of a new…

Machine Learning · Computer Science 2020-10-20 Di Wang , Xiangyu Guo , Chaowen Guan , Shi Li , Jinhui Xu

Modern causal inference methods allow machine learning to be used to weaken parametric modeling assumptions. However, the use of machine learning may result in complications for inference. Doubly-robust cross-fit estimators have been…

Methodology · Statistics 2022-03-11 Paul N Zivich , Alexander Breskin

Staggered rollout cluster randomized experiments (SR-CREs) involve sequential treatment adoption across clusters, requiring analysis methods that address a general class of dynamic causal effects, anticipation, and non-ignorable…

Methodology · Statistics 2026-02-02 Xinyuan Chen , Fan Li

Community detection in networks has drawn much attention in diverse fields, especially social sciences. Given its significance, there has been a large body of literature with approaches from many fields. Here we present a statistical…

Methodology · Statistics 2014-12-18 Lijun Peng , Luis Carvalho

This work aims to improve the sample efficiency of parallel large-scale ranking and selection (R&S) problems by leveraging correlation information. We modify the commonly used "divide and conquer" framework in parallel computing by adding a…

Methodology · Statistics 2026-02-16 Zishi Zhang , Yijie Peng

This paper considers clustered multi-task compressive sensing, a hierarchical model that solves multiple compressive sensing tasks by finding clusters of tasks that leverage shared information to mutually improve signal reconstruction. The…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Alexander Lin , Demba Ba

Bayesian shrinkage methods have generated a lot of recent interest as tools for high-dimensional regression and model selection. These methods naturally facilitate tractable uncertainty quantification and incorporation of prior information.…

Methodology · Statistics 2017-04-21 Bala Rajaratnam , Doug Sparks , Kshitij Khare , Liyuan Zhang