English
Related papers

Related papers: Leave-one-out Singular Subspace Perturbation Analy…

200 papers

The matching problem is a notorious combinatorial optimization problem that has attracted for many years the attention of the statistical physics community. Here we analyze the Euclidean version of the problem, i.e. the optimal matching…

Disordered Systems and Neural Networks · Physics 2017-01-11 Carlo Lucibello , Giorgio Parisi , Gabriele Sicuro

We give the first outlier-robust efficient algorithm for clustering a mixture of $k$ statistically separated d-dimensional Gaussians (k-GMMs). Concretely, our algorithm takes input an $\epsilon$-corrupted sample from a $k$-GMM and whp in…

Data Structures and Algorithms · Computer Science 2020-12-15 Ainesh Bakshi , Pravesh Kothari

Seemingly unrelated linear regression models are introduced in which the distribution of the errors is a finite mixture of Gaussian components. Identifiability conditions are provided. The score vector and the Hessian matrix are derived.…

Methodology · Statistics 2014-03-18 Giuliano Galimberti , Elena Scardovi , Gabriele Soffritti

We propose a generalization of the random matrix theory following the basic prescription of the recently suggested concept of superstatistics. Spectral characteristics of systems with mixed regular-chaotic dynamics are expressed as weighted…

Statistical Mechanics · Physics 2007-05-23 A. Y. Abul-Magd

Cluster structure detection is a fundamental task for the analysis of graphs, in order to understand and to visualize their functional characteristics. Among the different cluster structure detection methods, spectral clustering is…

Machine Learning · Statistics 2020-04-09 Camille Champion , Blazère Mélanie , Burcelin Rémy , Loubes Jean-Michel , Risser Laurent

We give an efficient algorithm for robustly clustering of a mixture of two arbitrary Gaussians, a central open problem in the theory of computationally efficient robust estimation, assuming only that the the means of the component Gaussians…

Data Structures and Algorithms · Computer Science 2020-06-02 He Jia , Santosh Vempala

Perturbation theory is an important tool in the analysis of oscillators and their response to external stimuli. It is predicated on the assumption that the perturbations in question are "sufficiently weak", an assumption that is not always…

Neurons and Cognition · Quantitative Biology 2012-01-19 Kevin K. Lin , Kyle C. A. Wedgwood , Stephen Coombes , Lai-Sang Young

We introduce a new method for performing clustering with the aim of fitting clusters with different scatters and weights. It is designed by allowing to handle a proportion $\alpha$ of contaminating data to guarantee the robustness of the…

Statistics Theory · Mathematics 2008-12-18 Luis A. García-Escudero , Alfonso Gordaliza , Carlos Matrán , Agustin Mayo-Iscar

Mixture models are commonly used in applications with heterogeneity and overdispersion in the population, as they allow the identification of subpopulations. In the Bayesian framework, this entails the specification of suitable prior…

Methodology · Statistics 2023-06-21 Andrea Cremaschi , Timothy M. Wertz , Maria De Iorio

A model of two coupled complex scalar fields is studied at finite temperature and under an external magnetic field. The results are obtained in the context of the nonperturbative method of the optimized perturbation theory and contrasted…

High Energy Physics - Phenomenology · Physics 2021-11-19 R. L. S. Farias , Rudnei O. Ramos , Dérick S. Rosa

Although distance measures are used in many machine learning algorithms, the literature on the context-independent selection and evaluation of distance measures is limited in the sense that prior knowledge is used. In cluster analysis,…

Machine Learning · Computer Science 2021-08-24 Michael C. Thrun

We study the clustering task under anisotropic Gaussian Mixture Models where the covariance matrices from different clusters are unknown and are not necessarily the identical matrix. We characterize the dependence of signal-to-noise ratios…

Statistics Theory · Mathematics 2021-01-19 Xin Chen , Anderson Y. Zhang

This paper studies inference for quadratic forms of linear regression coefficients with clustered data and many covariates. Our framework covers three important special cases: instrumental variables regression with many instruments and…

Econometrics · Economics 2026-02-18 Michal Kolesár , Pengjin Min , Wenjie Wang , Yichong Zhang

The consideration of quantum fields defined on a spacetime lattice provides computational techniques which are invaluable for studying gauge theories nonperturbatively from first principles. Perturbation theory is an essential aspect of…

High Energy Physics - Lattice · Physics 2009-11-07 Stefano Capitani

This paper introduces {\em fusion subspace clustering}, a novel method to learn low-dimensional structures that approximate large scale yet highly incomplete data. The main idea is to assign each datum to a subspace of its own, and minimize…

Machine Learning · Computer Science 2022-05-24 Usman Mahmood , Daniel Pimentel-Alarcón

Patchwork learning arises as a new and challenging data collection paradigm where both samples and features are observed in fragmented subsets. Due to technological limits, measurement expense, or multimodal data integration, such patchwork…

Methodology · Statistics 2024-06-21 Lili Zheng , Andersen Chang , Genevera I. Allen

Despite a large and significant body of recent work focused on estimating the out-of-sample risk of regularized models in the high dimensional regime, a theoretical understanding of this problem for non-differentiable penalties such as…

Statistics Theory · Mathematics 2024-02-15 Haolin Zou , Arnab Auddy , Kamiar Rahnama Rad , Arian Maleki

Matrix perturbation bounds play an essential role in the design and analysis of spectral algorithms. In this paper, we use a "contour bootstrapping" argument to derive several new perturbation bounds. As applications, we discuss new bounds…

Numerical Analysis · Mathematics 2024-10-22 Phuc Tran , Van Vu

The singular value matrix decomposition plays a ubiquitous role throughout statistics and related fields. Myriad applications including clustering, classification, and dimensionality reduction involve studying and exploiting the geometric…

Statistics Theory · Mathematics 2018-10-03 Joshua Cape , Minh Tang , Carey E. Priebe

We consider the problem of estimating common community structures in multi-layer stochastic block models, where each single layer may not have sufficient signal strength to recover the full community structure. In order to efficiently…

Statistics Theory · Mathematics 2022-03-08 Jing Lei , Kevin Z. Lin