English
Related papers

Related papers: Simultaneously Satisfying Linear Equations Over $\…

200 papers

Here, we give an algorithm for deciding if the nonnegative rank of a matrix $M$ of dimension $m \times n$ is at most $r$ which runs in time $(nm)^{O(r^2)}$. This is the first exact algorithm that runs in time singly-exponential in $r$. This…

Data Structures and Algorithms · Computer Science 2012-05-02 Ankur Moitra

The Knapsack problem is one of the most fundamental NP-complete problems at the intersection of computer science, optimization, and operations research. A recent line of research worked towards understanding the complexity of…

Data Structures and Algorithms · Computer Science 2024-02-27 Karl Bringmann

We give a stochastic optimization algorithm that solves a dense $n\times n$ real-valued linear system $Ax=b$, returning $\tilde x$ such that $\|A\tilde x-b\|\leq \epsilon\|b\|$ in time: $$\tilde O((n^2+nk^{\omega-1})\log1/\epsilon),$$ where…

Data Structures and Algorithms · Computer Science 2024-06-10 Michał Dereziński , Jiaming Yang

We study Sparse Multiple Kernel Learning (SMKL), which is the problem of selecting a sparse convex combination of prespecified kernels for support vector binary classification. Unlike prevailing l1 regularized approaches that approximate a…

Machine Learning · Statistics 2025-12-03 Dimitris Bertsimas , Caio de Prospero Iglesias , Nicholas A. G. Johnson

The problem of non-monotone $k$-submodular maximization under a knapsack constraint ($\kSMK$) over the ground set size $n$ has been raised in many applications in machine learning, such as data summarization, information propagation, etc.…

Data Structures and Algorithms · Computer Science 2023-09-22 Dung T. K. Ha , Canh V. Pham , Tan D. Tran , Huan X. Hoang

We study the multi-task linear regression problem in the presence of contaminated tasks. We address the setting where the unknown parameters of a majority of tasks are close in the $\ell_2$-norm, while a fraction of tasks are arbitrary…

Machine Learning · Statistics 2026-05-19 Seok-Jin Kim

We consider the problem of finding an independent set of maximum weight simultaneously contained in $k$ matroids over a common ground set. This $k$-matroid intersection problem appears naturally in many contexts, for example in generalizing…

Data Structures and Algorithms · Computer Science 2024-12-10 Neta Singer , Theophile Thiery

We revisit the MaxSAT problem in the data stream model. In this problem, the stream consists of $m$ clauses that are disjunctions of literals drawn from $n$ Boolean variables. The objective is to find an assignment to the variables that…

Data Structures and Algorithms · Computer Science 2022-08-22 Hoa T. Vu

Weighted low rank approximation is a fundamental problem in numerical linear algebra, and it has many applications in machine learning. Given a matrix $M \in \mathbb{R}^{n \times n}$, a non-negative weight matrix $W \in \mathbb{R}_{\geq…

Machine Learning · Computer Science 2025-02-18 Zhao Song , Mingquan Ye , Junze Yin , Lichen Zhang

The problem of rectangle tiling binary arrays is defined as follows. Given an $n \times n$ array $A$ of zeros and ones and a natural number $p$, our task is to partition $A$ into at most $p$ rectangular tiles, so that the maximal weight of…

Computational Geometry · Computer Science 2024-07-17 Pratik Ghosal , Syed Mohammad Meesum , Katarzyna Paluch

We present an algorithm that given a linear program with $n$ variables, $m$ constraints, and constraint matrix $A$, computes an $\epsilon$-approximate solution in $\tilde{O}(\sqrt{rank(A)}\log(1/\epsilon))$ iterations with high probability.…

Data Structures and Algorithms · Computer Science 2020-09-02 Yin Tat Lee , Aaron Sidford

For a primal-dual pair of conic linear problems that are described by convex cones $S\subset X$, $T\subset Y$, bilinear symmetric objective functions $\langle\cdot,\cdot\rangle_X$, $\langle\cdot,\cdot\rangle_Y$ and a linear operator…

Optimization and Control · Mathematics 2023-01-23 Nick Dimou

We derive closed formulas for the condition number of a linear function of the total least squares solution. Given an over determined linear system Ax=b, we show that this condition number can be computed using the singular values and the…

Numerical Analysis · Computer Science 2010-12-30 Marc Baboulin , Serge Gratton

Meta-kernelization theorems are general results that provide polynomial kernels for large classes of parameterized problems. The known meta-kernelization theorems, in particular the results of Bodlaender et al. (FOCS'09) and of Fomin et al.…

Data Structures and Algorithms · Computer Science 2013-04-22 Robert Ganian , Friedrich Slivovsky , Stefan Szeider

In this paper we propose a variant of the linear least squares model allowing practitioners to partition the input features into groups of variables that they require to contribute similarly to the final result. The output allows…

Machine Learning · Computer Science 2024-07-17 Roberto Esposito , Mattia Cerrato , Marco Locatelli

Consider the classical problem of solving a general linear system of equations $Ax=b$. It is well known that the (successively over relaxed) Gauss-Seidel scheme and many of its variants may not converge when $A$ is neither diagonally…

Optimization and Control · Mathematics 2019-05-14 Meisam Razaviyayn , Mingyi Hong , Navid Reyhanian , Zhi-Quan Luo

The problem of detecting and removing redundant constraints is fundamental in optimization. We focus on the case of linear programs (LPs), given by $d$ variables with $n$ inequality constraints. A constraint is called \emph{redundant}, if…

Data Structures and Algorithms · Computer Science 2016-10-11 Komei Fukuda , May Szedlak

We apply our recent Quantum Approximate Optimization Algorithm to the combinatorial problem of bounded occurrence Max E3LIN2. The input is a set of linear equations each of which contains exactly three boolean variables and each equation…

Quantum Physics · Physics 2015-06-26 Edward Farhi , Jeffrey Goldstone , Sam Gutmann

In this paper, we prove a new identity for the least-square solution of an over-determined set of linear equation $Ax=b$, where $A$ is an $m\times n$ full-rank matrix, $b$ is a column-vector of dimension $m$, and $m$ (the number of…

Optimization and Control · Mathematics 2015-02-27 Saeid Haghighatshoar , Mohammad J. Taghizadeh , Afsaneh Asaei

In this paper, based on the theory of adjoint operators and dual norms, we define condition numbers for a linear solution function of the weighted linear least squares problem. The explicit expressions of the normwise and componentwise…

Numerical Analysis · Mathematics 2017-05-23 Huai-An Diao , Liming Liang , Sanzheng Qiao