English
Related papers

Related papers: Finding a dense submatrix of a random matrix. Shar…

200 papers

We study online robust matrix completion on graphs. At each iteration a vector with some entries missing is revealed and our goal is to reconstruct it by identifying the underlying low-dimensional subspace from which the vectors are drawn.…

Information Theory · Computer Science 2016-05-16 Symeon Chouvardas , Mohammed Amin Abdullah , Lucas Claude , Moez Draief

A simple model to study subspace clustering is the high-dimensional $k$-Gaussian mixture model where the cluster means are sparse vectors. Here we provide an exact asymptotic characterization of the statistically optimal reconstruction…

Machine Learning · Statistics 2023-04-04 Luca Pesce , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

Dynamic networks models describe a growing number of important scientific processes, from cell biology and epidemiology to sociology and finance. There are many aspects of dynamical networks that require statistical considerations. In this…

Methodology · Statistics 2012-05-15 E. C. Wit , A. Abbruzzo

What is the optimal number of independent observations from which a sparse Gaussian Graphical Model can be correctly recovered? Information-theoretic arguments provide a lower bound on the minimum number of samples necessary to perfectly…

Machine Learning · Computer Science 2018-11-20 Sidhant Misra , Marc Vuffray , Andrey Y. Lokhov

Large scale optimization problems are ubiquitous in machine learning and data analysis and there is a plethora of algorithms for solving such problems. Many of these algorithms employ sub-sampling, as a way to either speed up the…

Optimization and Control · Mathematics 2016-02-29 Farbod Roosta-Khorasani , Michael W. Mahoney

We construct a deterministic approximation algorithm for computing a permanent of a $0,1$ $n$ by $n$ matrix to within a multiplicative factor $(1+\epsilon)^n$, for arbitrary $\epsilon>0$. When the graph underlying the matrix is a constant…

Combinatorics · Mathematics 2007-05-23 David Gamarnik , Dmitriy Katz

We consider a variant of the densest subgraph problem in networks with single or multiple edge attributes. For example, in a social network, the edge attributes may describe the type of relationship between users, such as friends, family,…

Social and Information Networks · Computer Science 2024-02-15 Lutz Oettershagen , Honglian Wang , Aristides Gionis

This article deals with the computation of the characteristic polynomial of dense matrices over small finite fields and over the integers. We first present two algorithms for the finite fields: one is based on Krylov iterates and Gaussian…

Symbolic Computation · Computer Science 2016-08-16 Jean-Guillaume Dumas , Clément Pernet , Zhendong Wan

In this work, we study the classic submodular maximization problem under knapsack constraints and beyond. We first present an $(7/16-\varepsilon)$-approximate algorithm for single knapsack constraint, which requires…

Data Structures and Algorithms · Computer Science 2020-12-22 Wenxin Li

Non-Gaussian likelihoods are essential for modelling complex real-world observations but pose significant computational challenges in learning and inference. Even with Gaussian priors, non-Gaussian likelihoods often lead to analytically…

Machine Learning · Statistics 2024-10-29 Thang D. Bui

We consider the Low Rank Approximation problem, where the input consists of a matrix $A \in \mathbb{R}^{n_R \times n_C}$ and an integer $k$, and the goal is to find a matrix $B$ of rank at most $k$ that minimizes $\| A - B \|_0$, which is…

Data Structures and Algorithms · Computer Science 2023-11-03 Vincent Cohen-Addad , Chenglin Fan , Suprovat Ghoshal , Euiwoong Lee , Arnaud de Mesmay , Alantha Newman , Tony Chang Wang

We present a general class of compressed sensing matrices which are then demonstrated to have associated sublinear-time sparse approximation algorithms. We then develop methods for constructing specialized matrices from this class which are…

Numerical Analysis · Mathematics 2011-06-01 J. Bailey , M. A. Iwen , C. V. Spencer

This paper presents an algorithm to simulate Gaussian random vectors whose precision matrix can be expressed as a polynomial of a sparse matrix. This situation arises in particular when simulating Gaussian Markov random fields obtained by…

Methodology · Statistics 2020-04-07 Mike Pereira , Nicolas Desassis

The growing amount of applications that generate vast amount of data in short time scales render the problem of partial monitoring, coupled with prediction, a rather fundamental one. We study the aforementioned canonical problem under the…

Data Structures and Algorithms · Computer Science 2016-08-02 Michalis Kallitsis , Stilian Stoev , George Michailidis

We analyse the matrix factorization problem. Given a noisy measurement of a product of two matrices, the problem is to estimate back the original matrices. It arises in many applications such as dictionary learning, blind matrix…

Numerical Analysis · Computer Science 2016-07-19 Yoshiyuki Kabashima , Florent Krzakala , Marc Mézard , Ayaka Sakata , Lenka Zdeborová

We study causal effect estimation under interference from network data. We work under the chain-graph formulation pioneered in Tchetgen Tchetgen et. al (2021). Our first result shows that polynomial time evaluation of treatment effects is…

Statistics Theory · Mathematics 2025-12-10 Sohom Bhattacharya , Subhabrata Sen

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

We design a new distribution over $\poly(r \eps^{-1}) \times n$ matrices $S$ so that for any fixed $n \times d$ matrix $A$ of rank $r$, with probability at least 9/10, $\norm{SAx}_2 = (1 \pm \eps)\norm{Ax}_2$ simultaneously for all $x \in…

Data Structures and Algorithms · Computer Science 2013-04-08 Kenneth L. Clarkson , David P. Woodruff

We study the approximability of instances of the minimum entropy set cover problem, parameterized by the average frequency of a random element in the covering sets. We analyze an algorithm combining a greedy approach with another one biased…

Data Structures and Algorithms · Computer Science 2012-08-01 Cosmin Bonchis , Gabriel Istrate

Devising optimal operating strategies for a compressor station relies on the knowledge of compressor characteristics. As the compressor characteristics change with time and use, it is necessary to provide accurate models of the…

Computational Engineering, Finance, and Science · Computer Science 2021-11-24 Akhil Ahmed , Marta Zagorowska , Ehecatl Antonio del Rio-Chanona , Mehmet Mercangöz