English
Related papers

Related papers: Near-Linear Runtime for a Classical Matrix Precond…

200 papers

The approximation of $e^{tA}B$ where $A$ is a large sparse matrix and $B$ a rectangular matrix is the key ingredient in many scientific and engineering computations. A powerful tool to manage the matrix exponential function is to resort to…

Numerical Analysis · Mathematics 2014-05-06 Gang Wu , Hong-kui Pang , Jiang-li Sun

Positive linear programs (LP), also known as packing and covering linear programs, are an important class of problems that bridges computer science, operations research, and optimization. Despite the consistent efforts on this problem, all…

Data Structures and Algorithms · Computer Science 2016-11-15 Zeyuan Allen-Zhu , Lorenzo Orecchia

Computational problem certificates are additional data structures for each output, which can be used by a-possibly randomized-verification algorithm that proves the correctness of each output. In this paper, we give an algorithm that…

Symbolic Computation · Computer Science 2019-12-03 Jean-Guillaume Dumas , Erich Kaltofen , Emmanuel Thomé , Gilles Villard

In the recent literature on machine learning and decision making, calibration has emerged as a desirable and widely-studied statistical property of the outputs of binary prediction models. However, the algorithmic aspects of measuring model…

Machine Learning · Computer Science 2024-06-24 Lunjia Hu , Arun Jambulapati , Kevin Tian , Chutong Yang

Matrix approximation is a common tool in machine learning for building accurate prediction models for recommendation systems, text mining, and computer vision. A prevalent assumption in constructing matrix approximations is that the…

Machine Learning · Computer Science 2013-01-16 Joonseok Lee , Seungyeon Kim , Guy Lebanon , Yoram Singer

In this paper we present a new algorithm for solving linear programs that requires only $\tilde{O}(\sqrt{rank(A)}L)$ iterations to solve a linear program with $m$ constraints, $n$ variables, and constraint matrix $A$, and bit complexity…

Data Structures and Algorithms · Computer Science 2015-03-06 Yin Tat Lee , Aaron Sidford

Magnetic tapes are often considered as an outdated storage technology, yet they are still used to store huge amounts of data. Their main interests are a large capacity and a low price per gigabyte, which come at the cost of a much larger…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-05 Valentin Honoré , Bertrand Simon , Frédéric Suter

We present an efficient, nearly optimal quantum algorithm for solving linear matrix differential equations, with applications to the simulation of open quantum systems and beyond. For unitary or dissipative dynamics, the algorithm computes…

Quantum Physics · Physics 2026-05-18 Sophia Simon , Dominic W. Berry , Rolando D. Somma

A prominent problem in scheduling theory is the weighted flow time problem on one machine. We are given a machine and a set of jobs, each of them characterized by a processing time, a release time, and a weight. The goal is to find a…

Data Structures and Algorithms · Computer Science 2023-08-14 Alexander Armbruster , Lars Rohwedder , Andreas Wiese

Optimization in machine learning, both theoretical and applied, is presently dominated by first-order gradient methods such as stochastic gradient descent. Second-order optimization methods, that involve second derivatives and/or second…

Machine Learning · Computer Science 2021-03-08 Rohan Anil , Vineet Gupta , Tomer Koren , Kevin Regan , Yoram Singer

This work aims to accelerate the convergence of proximal gradient methods used to solve regularized linear inverse problems. This is achieved by designing a polynomial-based preconditioner that targets the eigenvalue spectrum of the normal…

Orthogonal Matching Pursuit and Basis Pursuit are popular reconstruction algorithms for recovery of sparse signals. The exact recovery property of both the methods has a relation with the coherence of the underlying redundant dictionary,…

Optimization and Control · Mathematics 2021-06-10 Pradip Sasmal , Prasad Theeda , Phanindra Jampana , C. S. Sastry

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

We introduce a unified framework for computing approximately-optimal preconditioners for solving linear and non-linear systems of equations. We demonstrate that the condition number minimization problem, under structured transformations…

Optimization and Control · Mathematics 2025-12-09 M. Levent Doğan , Alperen Ergür , Elias Tsigaridas

This research addresses the multiprocessor scheduling problem of hard real-time systems, and it especially focuses on optimal and global schedulers when practical constraints are taken into account. First, we propose an improvement of the…

Operating Systems · Computer Science 2011-01-25 Shelby Funk , Vincent Nelis , Joel Goossens , Dragomir Milojevic , Geoffrey Nelissen

In this paper, we study the almost sure boundedness and the convergence of the stochastic approximation (SA) algorithm. At present, most available convergence proofs are based on the ODE method, and the almost sure boundedness of the…

Machine Learning · Statistics 2023-01-10 M. Vidyasagar

McDonald, Pestana and Wathen (SIAM J. Sci. Comput. 40(2), pp. A2012-A1033, 2018) present a method for preconditioning of time-dependent PDEs via approximation by a nearby time-periodic problem, that is, they employ circulant-related…

Numerical Analysis · Mathematics 2018-10-02 Anthony Goddard , Andrew Wathen

Quantum algorithms for solving linear systems of equations have generated excitement because of the potential speed-ups involved and the importance of solving linear equations in many applications. However, applying these algorithms can be…

We conducted an extensive computational experiment, lasting multiple CPU-years, to optimally select parameters for two important classes of algorithms for finding sparse solutions of underdetermined systems of linear equations. We make the…

Numerical Analysis · Computer Science 2015-05-14 Arian Maleki , David L. Donoho

Motivated by recent Linear Programming solvers, we design dynamic data structures for maintaining the inverse of an $n\times n$ real matrix under $\textit{low-rank}$ updates, with polynomially faster amortized running time. Our data…

Data Structures and Algorithms · Computer Science 2020-04-17 Shunhua Jiang , Zhao Song , Omri Weinstein , Hengjie Zhang