English
Related papers

Related papers: Finding a dense submatrix of a random matrix. Shar…

200 papers

A fundamental problem arising in many applications in Web science and social network analysis is, given an arbitrary approximation factor $c>1$, to output a set $S$ of nodes that with high probability contains all nodes of PageRank at least…

Data Structures and Algorithms · Computer Science 2015-03-20 Christian Borgs , Michael Brautbar , Jennifer Chayes , Shang-Hua Teng

The development of randomized algorithms for numerical linear algebra, e.g. for computing approximate QR and SVD factorizations, has recently become an intense area of research. This paper studies one of the most frequently discussed…

Numerical Analysis · Computer Science 2013-08-28 Rafi Witten , Emmanuel Candes

Tensor network contractions are widely used in statistical physics, quantum computing, and computer science. We introduce a method to efficiently approximate tensor network contractions using low-rank approximations, where each intermediate…

Quantum Physics · Physics 2025-01-01 Linjian Ma , Matthew Fishman , Miles Stoudenmire , Edgar Solomonik

We propose a novel approach to estimating the precision matrix of multivariate Gaussian data that relies on decomposing them into a low-rank and a diagonal component. Such decompositions are very popular for modeling large covariance…

Methodology · Statistics 2022-08-18 Noirrit Kiran Chandra , Peter Mueller , Abhra Sarkar

We review the literature on algorithms for estimating the index space in a multi-index model. The primary focus is on computationally efficient (polynomial-time) algorithms in Gaussian space, the assumptions under which consistency is…

Machine Learning · Statistics 2025-06-17 Joan Bruna , Daniel Hsu

Finding dense subgraphs is a core problem in graph mining with many applications in diverse domains. At the same time many real-world networks vary over time, that is, the dataset can be represented as a sequence of graph snapshots. Hence,…

Data Structures and Algorithms · Computer Science 2023-08-31 Chamalee Wickrama Arachchi , Nikolaj Tatti

We address the problem of estimating a high-dimensional matrix from linear measurements, with a focus on designing optimal rank-adaptive algorithms. These algorithms infer the matrix by estimating its singular values and the corresponding…

Information Theory · Computer Science 2026-05-12 Frédéric Zheng , Yassir Jedra , Alexandre Proutiere

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

We consider the problem of estimating a rank-one matrix in Gaussian noise under a probabilistic model for the left and right factors of the matrix. The probabilistic model can impose constraints on the factors including sparsity and…

Information Theory · Computer Science 2015-09-16 Alyson K. Fletcher , Sundeep Rangan

Global discrete optimization is notoriously difficult due to the lack of gradient information and the curse of dimensionality, making exhaustive search infeasible. Tensor cross approximation is an efficient technique to approximate…

Computation · Statistics 2025-02-19 Sergey Dolgov , Dmitry Savostyanov

We consider models of Bayesian inference of signals with vectorial components of finite dimensionality. We show that, under a proper perturbation, these models are replica symmetric in the sense that the overlap matrix concentrates. The…

Information Theory · Computer Science 2020-01-27 Jean Barbier

Sparse coding--that is, modelling data vectors as sparse linear combinations of basis elements--is widely used in machine learning, neuroscience, signal processing, and statistics. This paper focuses on the large-scale matrix factorization…

Machine Learning · Statistics 2010-02-11 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro

In phase retrieval, the goal is to recover a complex signal from the magnitude of its linear measurements. While many well-known algorithms guarantee deterministic recovery of the unknown signal using i.i.d. random measurement matrices,…

Information Theory · Computer Science 2017-03-24 Boshra Rajaei , Sylvain Gigan , Florent Krzakala , Laurent Daudet

Motivated by a sampling problem basic to computational statistical inference, we develop a nearly optimal algorithm for a fundamental problem in spectral graph theory and numerical analysis. Given an $n\times n$ SDDM matrix ${\bf…

Data Structures and Algorithms · Computer Science 2014-10-21 Dehua Cheng , Yu Cheng , Yan Liu , Richard Peng , Shang-Hua Teng

In this paper, we consider the problem of approximating the densest subgraph in the dynamic graph stream model. In this model of computation, the input graph is defined by an arbitrary sequence of edge insertions and deletions and the goal…

Data Structures and Algorithms · Computer Science 2015-06-16 Andrew McGregor , David Tench , Sofya Vorotnikova , Hoa T. Vu

We study the problem of learning latent variables in Gaussian graphical models. Existing methods for this problem assume that the precision matrix of the observed variables is the superposition of a sparse and a low-rank component. In this…

Machine Learning · Statistics 2017-07-12 Mohammadreza Soltani , Chinmay Hegde

In Compressed Sensing, a real-valued sparse vector has to be estimated from an underdetermined system of linear equations. In many applications, however, the elements of the sparse vector are drawn from a finite set. For the estimation of…

Information Theory · Computer Science 2016-08-24 Susanne Sparrer , Robert F. H. Fischer

Estimation of the covariance matrix has attracted a lot of attention of the statistical research community over the years, partially due to important applications such as Principal Component Analysis. However, frequently used empirical…

Statistics Theory · Mathematics 2018-06-19 Stanislav Minsker

Estimation of a high dimensional precision matrix is a critical problem to many areas of statistics including Gaussian graphical models and inference on high dimensional data. Working under the structural assumption of sparsity, we propose…

Methodology · Statistics 2020-12-17 Adam B Kashlak

Streaming tensor factorization is a powerful tool for processing high-volume and multi-way temporal data in Internet networks, recommender systems and image/video data analysis. Existing streaming tensor factorization algorithms rely on…

Machine Learning · Statistics 2019-01-01 Cole Hawkins , Zheng Zhang