English
Related papers

Related papers: A New Framework for Matrix Discrepancy: Partial Co…

200 papers

Recent work by Woodworth et al. (2020) shows that the optimization dynamics of gradient descent for overparameterized problems can be viewed as low-dimensional dual dynamics induced by a mirror map, explaining the implicit regularization…

Machine Learning · Computer Science 2024-10-21 Shuyang Wang , Diego Klabjan

Low-rank matrix estimation plays a central role in various applications across science and engineering. Recently, nonconvex formulations based on matrix factorization are provably solved by simple gradient descent algorithms with strong…

Signal Processing · Electrical Eng. & Systems 2021-04-07 Cong Ma , Yuanxin Li , Yuejie Chi

Matrix completion under interval uncertainty can be cast as matrix completion with element-wise box constraints. We present an efficient alternating-direction parallel coordinate-descent method for the problem. We show that the method…

Optimization and Control · Mathematics 2018-02-20 Jakub Marecek , Peter Richtarik , Martin Takac

We show that any $n\times m$ matrix $A$ can be approximated in operator norm by a submatrix with a number of columns of order the stable rank of $A$. This improves on existing results by removing an extra logarithmic factor in the size of…

Functional Analysis · Mathematics 2018-07-19 Omer Friedland , Pierre Youssef

Existing color sampling based alpha matting methods use the compositing equation to estimate alpha at a pixel from pairs of foreground (F) and background (B) samples. The quality of the matte depends on the selected (F,B) pairs. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-04-26 Jubin Johnson , Ehsan Shahrian Varnousfaderani , Hisham Cholakkal , Deepu Rajan

We prove that the sum of entries of the suitably normalized groundstate vector of the O(1) loop model with periodic boundary conditions on a periodic strip of size 2n is equal to the total number of n x n alternating sign matrices. This is…

Mathematical Physics · Physics 2007-05-23 P. Di Francesco , P. Zinn-Justin

We introduce a technically and conceptually simple approach to magnification of circuit and formula lower bounds. Central to the method are so-called distinguishers, sparse matrices that retain some of the key properties of error-correcting…

Computational Complexity · Computer Science 2025-06-24 Albert Atserias , Moritz Müller

Suppose we are given a matrix that is formed by adding an unknown sparse matrix to an unknown low-rank matrix. Our goal is to decompose the given matrix into its sparse and low-rank components. Such a problem arises in a number of…

Optimization and Control · Mathematics 2011-08-09 Venkat Chandrasekaran , Sujay Sanghavi , Pablo A. Parrilo , Alan S. Willsky

This paper considers a large class of problems where we seek to recover a low rank matrix and/or sparse vector from some set of measurements. While methods based on convex relaxations suffer from a (possibly large) estimator bias, and other…

Machine Learning · Statistics 2021-09-28 April Sagan , John E. Mitchell

For a large Hermitian matrix $A\in \mathbb{C}^{N\times N}$, it is often the case that the only affordable operation is matrix-vector multiplication. In such case, randomized method is a powerful way to estimate the spectral density (or…

Numerical Analysis · Mathematics 2015-11-24 Lin Lin

We consider the problem of sampling from constrained distributions, which has posed significant challenges to both non-asymptotic analysis and algorithmic design. We propose a unified framework, which is inspired by the classical mirror…

Machine Learning · Computer Science 2021-01-01 Ya-Ping Hsieh , Ali Kavis , Paul Rolland , Volkan Cevher

In a connected simple graph G = (V,E), each vertex of V is colored by a color from the set of colors C={c1, c2,..., c_{\alpha}}$. We take a subset S of V, such that for every vertex v in V\S, at least one vertex of the same color is present…

Computational Geometry · Computer Science 2024-05-24 Bubai Manna

We devise a new embedding technique, which we call measured descent, based on decomposing a metric space locally, at varying speeds, according to the density of some probability measure. This provides a refined and unified framework for the…

Data Structures and Algorithms · Computer Science 2007-05-23 Robert Krauthgamer , James R. Lee , Manor Mendel , Assaf Naor

We show how to select an item with the majority color from $n$ two-colored items, given access to the items only through an oracle that returns the discrepancy of subsets of $k$ items. We use $n/\lfloor\tfrac{k}{2}\rfloor+O(k)$ queries,…

Data Structures and Algorithms · Computer Science 2018-03-01 David Eppstein , Daniel S. Hirschberg

This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax…

Statistics Theory · Mathematics 2013-02-14 T. Tony Cai , Harrison H. Zhou

An unknown $m$ by $n$ matrix $X_0$ is to be estimated from noisy measurements $Y=X_0+Z$, where the noise matrix $Z$ has i.i.d. Gaussian entries. A popular matrix denoising scheme solves the nuclear norm penalization problem $\operatorname…

Statistics Theory · Mathematics 2014-11-05 David Donoho , Matan Gavish

This paper considers inference for a function of a parameter vector in a partially identified model with many moment inequalities. This framework allows the number of moment conditions to grow with the sample size, possibly at exponential…

Statistics Theory · Mathematics 2018-07-02 Alexandre Belloni , Federico Bugni , Victor Chernozhukov

The objective of the matrix selection problem is to select a submatrix $A_{S}\in \mathbb{R}^{n\times k}$ from $A\in \mathbb{R}^{n\times m}$ such that its minimum singular value is maximized. In this paper, we employ the interlacing…

Functional Analysis · Mathematics 2025-08-15 Zhiqiang Xu

We study stochastic convex optimization under infinite noise variance. Specifically, when the stochastic gradient is unbiased and has uniformly bounded $(1+\kappa)$-th moment, for some $\kappa \in (0,1]$, we quantify the convergence rate of…

Machine Learning · Statistics 2022-02-24 Nuri Mert Vural , Lu Yu , Krishnakumar Balasubramanian , Stanislav Volgushev , Murat A. Erdogdu

In seminal work, Lov\'asz, Spencer, and Vesztergombi [European J. Combin., 1986] proved a lower bound for the hereditary discrepancy of a matrix $A \in \mathbb{R}^{m \times n}$ in terms of the maximum $|\det(B)|^{1/k}$ over all $k \times k$…

Data Structures and Algorithms · Computer Science 2021-11-03 Haotian Jiang , Victor Reis
‹ Prev 1 4 5 6 7 8 10 Next ›