English
Related papers

Related papers: Derandomizing Matrix Concentration Inequalities fr…

200 papers

Matrix concentration inequalities provide information about the probability that a random matrix is close to its expectation with respect to the $l_2$ operator norm. This paper uses semigroup methods to derive sharp nonlinear matrix…

Probability · Mathematics 2021-01-08 De Huang , Joel A. Tropp

Analyzing concentration of large random matrices is a common task in a wide variety of fields. Given independent random variables, many tools are available to analyze random matrices whose entries are linear in the variables, e.g. the…

Computational Complexity · Computer Science 2023-01-19 Goutham Rajendran , Madhur Tulsiani

We consider the matrix completion problem where the aim is to esti-mate a large data matrix for which only a relatively small random subset of its entries is observed. Quite popular approaches to matrix completion problem are iterative…

Statistics Theory · Mathematics 2015-02-03 Olga Klopp

We propose a new method for identifying and estimating the CP-factor models for matrix time series. Unlike the generalized eigenanalysis-based method of Chang et al. (2023) for which the convergence rates of the associated estimators may…

Methodology · Statistics 2025-07-29 Jinyuan Chang , Yue Du , Guanglin Huang , Qiwei Yao

The theoretical models providing mathematical abstractions for several significant optimization problems in machine learning, combinatorial optimization, computer vision and statistical physics have intrinsic similarities. We propose a…

Data Structures and Algorithms · Computer Science 2018-04-18 Yi-Kai Wang

We give polynomial time algorithms for quantitative (and qualitative) reachability analysis for Branching Markov Decision Processes (BMDPs). Specifically, given a BMDP, and given an initial population, where the objective of the controller…

Computational Complexity · Computer Science 2016-04-08 Kousha Etessami , Alistair Stewart , Mihalis Yannakakis

In the field of constraint satisfaction problems (CSP), promise CSPs are an exciting new direction of study. In a promise CSP, each constraint comes in two forms: "strict" and "weak," and in the associated decision problem one must…

Data Structures and Algorithms · Computer Science 2020-12-03 Joshua Brakensiek , Venkatesan Guruswami , Marcin Wrochna , Stanislav Živný

We propose a new fast randomized algorithm for interpolative decomposition of matrices which utilizes CountSketch. We then extend this approach to the tensor interpolative decomposition problem introduced by Biagioni et al. (J. Comput.…

Numerical Analysis · Mathematics 2024-12-20 Osman Asif Malik , Stephen Becker

In light of recent data science trends, new interest has fallen in alternative matrix factorizations. By this, we mean various ways of factorizing particular data matrices so that the factors have special properties and reveal insights into…

Optimization and Control · Mathematics 2023-02-21 Andries Steenkamp

In this era of large-scale data, distributed systems built on top of clusters of commodity hardware provide cheap and reliable storage and scalable processing of massive data. Here, we review recent work on developing and implementing…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-28 Jiyan Yang , Xiangrui Meng , Michael W. Mahoney

We propose a novel distribution-free scheme to solve optimization problems where the goal is to minimize the expected value of a cost function subject to probabilistic constraints. Unlike standard sampling-based methods, our idea consists…

Optimization and Control · Mathematics 2025-05-28 Francesco Cordiano , Matin Jafarian , Bart De Schutter

We introduce a new concept of approximation applicable to decision problems and functions, inspired by Bayesian probability. From the perspective of a Bayesian reasoner with limited computational resources, the answer to a problem that…

Computational Complexity · Computer Science 2025-06-27 Vanessa Kosoy , Alexander Appel

We focus on \emph{row sampling} based approximations for matrix algorithms, in particular matrix multipication, sparse matrix reconstruction, and \math{\ell_2} regression. For \math{\matA\in\R^{m\times d}} (\math{m} points in \math{d\ll m}…

Data Structures and Algorithms · Computer Science 2011-03-29 Malik Magdon-Ismail

Low-rank matrix approximations, such as the truncated singular value decomposition and the rank-revealing QR decomposition, play a central role in data analysis and scientific computing. This work surveys and extends recent research which…

Numerical Analysis · Mathematics 2014-04-29 Nathan Halko , Per-Gunnar Martinsson , Joel A. Tropp

The three domatic number problem asks whether a given undirected graph can be partitioned into at least three dominating sets, i.e., sets whose closed neighborhood equals the vertex set of the graph. Since this problem is NP-complete, no…

Computational Complexity · Computer Science 2007-05-23 Tobias Riege , Jörg Rothe

We present a novel method for approximately equilibrating a matrix $A \in {\bf R}^{m \times n}$ using only multiplication by $A$ and $A^T$. Our method is based on convex optimization and projected stochastic gradient descent, using an…

Optimization and Control · Mathematics 2016-02-23 Steven Diamond , Stephen Boyd

The martingale method is used to establish concentration inequalities for a class of dependent random sequences on a countable state space, with the constants in the inequalities expressed in terms of certain mixing coefficients. Along the…

Probability · Mathematics 2009-01-22 Leonid , Kontorovich , Kavita Ramanan

A novel orthogonalization-free method together with two specific algorithms are proposed to solve extreme eigenvalue problems. On top of gradient-based algorithms, the proposed algorithms modify the multi-column gradient such that earlier…

Numerical Analysis · Mathematics 2021-10-15 Weiguo Gao , Yingzhou Li , Bichen Lu

The Metropolis process (MP) and Simulated Annealing (SA) are stochastic local search heuristics that are often used in solving combinatorial optimization problems. Despite significant interest, there are very few theoretical results…

Data Structures and Algorithms · Computer Science 2023-12-22 Zongchen Chen , Dan Mikulincer , Daniel Reichman , Alexander S. Wein

We present techniques for decreasing the error probability of randomized algorithms and for converting randomized algorithms to deterministic (non-uniform) algorithms. Unlike most existing techniques that involve repetition of the…

Data Structures and Algorithms · Computer Science 2015-09-29 Ofer Grossman , Dana Moshkovitz