English
Related papers

Related papers: High-Girth Matrices and Polarization

200 papers

Gradient descent for matrix factorization exhibits an implicit bias toward approximately low-rank solutions. While existing theories often assume the boundedness of iterates, empirically the bias persists even with unbounded sequences. This…

Machine Learning · Computer Science 2025-11-04 Yikun Hou , Suvrit Sra , Alp Yurtsever

In this paper, we study the symmetric rank of products of linear forms and an irreducible quadratic form. The main result presents a new, non-trivial lower bound for the rank, and the arguments rely on the apolarity lemma. In the special…

Algebraic Geometry · Mathematics 2026-01-07 Liena Colarte-Gómez , Francesco Galuppi

We explain theoretically a curious empirical phenomenon: "Approximating a matrix by deterministically selecting a subset of its columns with the corresponding largest leverage scores results in a good low-rank matrix surrogate". To obtain…

Data Structures and Algorithms · Computer Science 2014-06-04 Dimitris Papailiopoulos , Anastasios Kyrillidis , Christos Boutsidis

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation…

Machine Learning · Computer Science 2011-06-09 Shai Shalev-Shwartz , Alon Gonen , Ohad Shamir

This article studies how to form CUR decompositions of low-rank matrices via primarily random sampling, though deterministic methods due to previous works are illustrated as well. The primary problem is to determine when a column submatrix…

Numerical Analysis · Mathematics 2020-01-10 Keaton Hamm , Longxiu Huang

We study the link between the degree growth of integrable birational mappings of order higher than two and their singularity structures. The higher order mappings we use in this study are all obtained by coupling mappings that are…

Exactly Solvable and Integrable Systems · Physics 2024-08-07 Ralph Willox , Takafumi Mase , Alfred Ramani , Basil Grammaticos

We produce explicit elliptic curves over \Bbb F_p(t) whose Mordell-Weil groups have arbitrarily large rank. Our method is to prove the conjecture of Birch and Swinnerton-Dyer for these curves (or rather the Tate conjecture for related…

Number Theory · Mathematics 2007-05-23 Douglas Ulmer

This paper, broadly speaking, covers the use of randomness in two main areas: low-rank approximation and kernel methods. Low-rank approximation is very important in numerical linear algebra. Many applications depend on matrix decomposition…

Numerical Analysis · Mathematics 2020-08-12 Rishi Advani , Madison Crim , Sean O'Hagan

Many data analysis applications deal with large matrices and involve approximating the matrix using a small number of ``components.'' Typically, these components are linear combinations of the rows and columns of the matrix, and are thus…

Data Structures and Algorithms · Computer Science 2007-08-29 Petros Drineas , Michael W. Mahoney , S. Muthukrishnan

When a linear system Ax = y is solved by means of iterative methods (mainly CG and GMRES) and the convergence rate is slow, one may consider a preconditioner P. The use of such preconditioner changes the spectrum of the matrix defining the…

Numerical Analysis · Mathematics 2013-04-03 F. Tudisco , C. Di Fiore , E. E. Tyrtyshnikov

Information-efficient approaches for extracting randomness from imperfect sources have been extensively studied, but simpler and faster ones are required in the high-speed applications of random number generation. In this paper, we focus on…

Information Theory · Computer Science 2012-09-05 Hongchao Zhou , Jehoshua Bruck

In problems involving matrix computations, the concept of leverage has found a large number of applications. In particular, leverage scores, which relate the columns of a matrix to the subspaces spanned by its leading singular vectors, are…

Machine Learning · Computer Science 2022-06-17 Bruno Ordozgoiti , Antonis Matakos , Aristides Gionis

The rigidity of a matrix A for target rank r is the minimum number of entries of A that must be changed to ensure that the rank of the altered matrix is at most r. Since its introduction by Valiant (1977), rigidity and similar…

Computational Complexity · Computer Science 2015-01-27 Abhinav Kumar , Satyanarayana V. Lokam , Vijay M. Patankar , Jayalal Sarma M. N

We use techniques from (tracial noncommutative) polynomial optimization to formulate hierarchies of semidefinite programming lower bounds on matrix factorization ranks. In particular, we consider the nonnegative rank, the positive…

Optimization and Control · Mathematics 2018-11-06 Sander Gribling , David de Laat , Monique Laurent

Copositive and completely positive matrices play an increasingly important role in Applied Mathematics, namely as a key concept for approximating NP-hard optimization problems. The cone of copositive matrices of a given order and the cone…

Optimization and Control · Mathematics 2017-01-31 Naomi Shaked-Monderer , Abraham Berman , Immanuel M. Bomze , Florian Jarre , Werner Schachinger

Matrices are exceptionally useful in various fields of study as they provide a convenient framework to organize and manipulate data in a structured manner. However, modern matrices can involve billions of elements, making their storage and…

Machine Learning · Computer Science 2023-10-18 Rajarshi Saha , Varun Srivastava , Mert Pilanci

Matrices arising in scientific applications frequently admit linear low-rank approximations due to smoothness in the physical and/or temporal domain of the problem. In large-scale problems, computing an optimal low-rank approximation can be…

Numerical Analysis · Mathematics 2021-05-05 Alec Michael Dunton , Alireza Doostan

Identifying discrete patterns in binary data is an important dimensionality reduction tool in machine learning and data mining. In this paper, we consider the problem of low-rank binary matrix factorisation (BMF) under Boolean arithmetic.…

Optimization and Control · Mathematics 2021-08-05 Reka A. Kovacs , Oktay Gunluk , Raphael A. Hauser

We consider the problem of counting the number of possible sets of rankings (called ranking patterns) generated by unfolding models of codimension one. We express the ranking patterns as slices of the braid arrangement and show that all…

Combinatorics · Mathematics 2011-06-10 Hidehiko Kamiya , Akimichi Takemura , Hiroaki Terao

Probabilistic circuits (PCs) are a prominent representation of probability distributions with tractable inference. While parameter learning in PCs is rigorously studied, structure learning is often more based on heuristics than on…

Machine Learning · Computer Science 2023-02-24 Yang Yang , Gennaro Gala , Robert Peharz