English
Related papers

Related papers: Fast Matrix Rank Algorithms and Applications

200 papers

We study tensor networks as a model of arithmetic computation for evaluating multilinear maps. These capture any algorithm based on low border rank tensor decompositions, such as $O(n^{\omega+\epsilon})$ time matrix multiplication, and in…

Computational Complexity · Computer Science 2018-11-16 Per Austrin , Petteri Kaski , Kaie Kubjas

In the ordinal Matroid Secretary Problem (MSP), elements from a weighted matroid are presented in random order to an algorithm that must incrementally select a large weight independent set. However, the algorithm can only compare pairs of…

Data Structures and Algorithms · Computer Science 2018-02-07 José A. Soto , Abner Turkieltaub , Victor Verdugo

A common way of doing algorithm selection is to train a machine learning model and predict the best algorithm from a portfolio to solve a particular problem. While this method has been highly successful, choosing only a single algorithm has…

Artificial Intelligence · Computer Science 2013-11-19 Lars Kotthoff

We consider the number of linear extensions of an N-free order P. We give upper and lower bounds on this number in terms of parameters of the corresponding arc diagram. We propose a dynamic programming algorithm to calculate the number. The…

Combinatorics · Mathematics 2017-06-16 Stefan Felsner , Thibault Manneville

We consider the problem of exact low-rank matrix completion from a geometric viewpoint: given a partially filled matrix M, we keep the positions of specified and unspecified entries fixed, and study how the minimal completion rank depends…

Statistics Theory · Mathematics 2019-09-24 Daniel Irving Bernstein , Grigoriy Blekherman , Rainer Sinn

Originally developed for imputing missing entries in low rank, or approximately low rank matrices, matrix completion has proven widely effective in many problems where there is no reason to assume low-dimensional linear structure in the…

Statistics Theory · Mathematics 2021-05-06 Yunhua Xiang , Tianyu Zhang , Xu Wang , Ali Shojaie , Noah Simon

We consider the problem of flexible modeling of higher order Markov chains when an upper bound on the order of the chain is known but the true order and nature of the serial dependence are unknown. We propose Bayesian nonparametric…

Methodology · Statistics 2015-10-21 Abhra Sarkar , David B. Dunson

The sorting operation is one of the most commonly used building blocks in computer programming. In machine learning, it is often used for robust statistics. However, seen as a function, it is piecewise linear and as a result includes many…

Machine Learning · Statistics 2020-07-01 Mathieu Blondel , Olivier Teboul , Quentin Berthet , Josip Djolonga

This paper studies the matrix completion problem under arbitrary sampling schemes. We propose a new estimator incorporating both max-norm and nuclear-norm regularization, based on which we can conduct efficient low-rank matrix recovery…

Machine Learning · Statistics 2016-09-27 Ethan X. Fang , Han Liu , Kim-Chuan Toh , Wen-Xin Zhou

We determine the rank of a random matrix over an arbitrary field with prescribed numbers of non-zero entries in each row and column. As an application we obtain a formula for the rate of low-density parity check codes. This formula…

Combinatorics · Mathematics 2024-06-21 Amin Coja-Oghlan , Alperen A. Ergür , Pu Gao , Samuel Hetterich , Maurice Rolvien

Motivated by recent Linear Programming solvers, we design dynamic data structures for maintaining the inverse of an $n\times n$ real matrix under $\textit{low-rank}$ updates, with polynomially faster amortized running time. Our data…

Data Structures and Algorithms · Computer Science 2020-04-17 Shunhua Jiang , Zhao Song , Omri Weinstein , Hengjie Zhang

We study the following generalized matrix rank estimation problem: given an $n \times n$ matrix and a constant $c \geq 0$, estimate the number of eigenvalues that are greater than $c$. In the distributed setting, the matrix of interest is…

Data Structures and Algorithms · Computer Science 2015-02-09 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

Efficient and automated design of optimizers plays a crucial role in full-stack AutoML systems. However, prior methods in optimizer search are often limited by their scalability, generability, or sample efficiency. With the goal of…

Machine Learning · Computer Science 2022-09-29 Ruochen Wang , Yuanhao Xiong , Minhao Cheng , Cho-Jui Hsieh

Multi-agent reinforcement learning (MARL) algorithms have accomplished remarkable breakthroughs in solving large-scale decision-making tasks. Nonetheless, most existing MARL algorithms are model-free, limiting sample efficiency and…

Machine Learning · Computer Science 2024-05-21 Qihan Liu , Jianing Ye , Xiaoteng Ma , Jun Yang , Bin Liang , Chongjie Zhang

Matrix rank minimization (RM) problems recently gained extensive attention due to numerous applications in machine learning, system identification and graphical models. In RM problem, one aims to find the matrix with the lowest rank that…

Information Theory · Computer Science 2011-02-22 Amin Khajehnejad , Samet Oymak , Babak Hassibi

The last decade has seen a revolution in the theory and application of machine learning and pattern recognition. Through these advancements, variable ranking has emerged as an active and growing research area and it is now beginning to be…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Giorgio Roffo

The article considers arrowhead and diagonal-plus-rank-one matrices in F^(nxn) where F in R,C or H. H is a non-commutative field of quaternions. We give unified formulas for fast matrix-vector multiplications, determinants, and inverses for…

Numerical Analysis · Mathematics 2022-12-22 Nevena Jakovcevic Stor , Ivan Slapnicar

Multiplying matrices is among the most fundamental and compute-intensive operations in machine learning. Consequently, there has been significant work on efficiently approximating matrix multiplies. We introduce a learning-based algorithm…

Machine Learning · Computer Science 2021-08-17 Davis Blalock , John Guttag

We say a zero-one matrix $A$ avoids another zero-one matrix $P$ if no submatrix of $A$ can be transformed to $P$ by changing some ones to zeros. A fundamental problem is to study the extremal function $ex(n,P)$, the maximum number of…

Discrete Mathematics · Computer Science 2017-04-19 P. A. CrowdMath

Motivated by complexity questions in integer programming, this paper aims to contribute to the understanding of combinatorial properties of integer matrices of row rank $r$ and with bounded subdeterminants. In particular, we study the…

Combinatorics · Mathematics 2023-09-08 Björn Kriepke , Gohar M. Kyureghyan , Matthias Schymura