English
Related papers

Related papers: Limited-memory polynomial methods for large-scale …

200 papers

First-order methods have been popularly used for solving large-scale problems. However, many existing works only consider unconstrained problems or those with simple constraint. In this paper, we develop two first-order methods for…

Optimization and Control · Mathematics 2017-11-23 Yangyang Xu

The need to approximate functions is ubiquitous in science, either due to empirical constraints or high computational cost of accessing the function. In high-energy physics, the precise computation of the scattering cross-section of a…

High Energy Physics - Phenomenology · Physics 2022-06-08 Ibrahim Chahrour , James D. Wells

In various areas of applied numerics, the problem of calculating the logarithm of a matrix A emerges. Since series expansions of the logarithm usually do not converge well for matrices far away from the identity, the standard numerical…

Numerical Analysis · Computer Science 2007-07-19 Gernot Schaller

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation…

Machine Learning · Computer Science 2011-06-09 Shai Shalev-Shwartz , Alon Gonen , Ohad Shamir

Matrix Factorization (MF) on large scale matrices is computationally as well as memory intensive task. Alternative convergence techniques are needed when the size of the input matrix is higher than the available memory on a Central…

Machine Learning · Computer Science 2019-01-21 Prasad G Bhavana , Vineet C Nair

We seek random versions of some classical theorems on complex approximation by polynomials and rational functions, as well as investigate properties of random compact sets in connection to complex approximation.

Complex Variables · Mathematics 2017-09-26 Simon St-Amant , Jérémie Turcotte

We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank…

Numerical Analysis · Mathematics 2014-07-01 Gil Shabat , Yaniv Shmueli , Amir Averbuch

The performance of numerical micromagnetic models is limited by the demagnetizing field computation, which typically accounts for the majority of the computation time. For magnetization dynamics simulations explicit evaluation methods are…

Computational Physics · Physics 2022-06-15 Serban Lepadatu

In this paper, we study first-order methods on a large variety of low-rank matrix optimization problems, whose solutions only live in a low dimensional eigenspace. Traditional first-order methods depend on the eigenvalue decomposition at…

Optimization and Control · Mathematics 2019-04-25 Yongfeng Li , Haoyang Liu , Zaiwen Wen , Yaxiang Yuan

Linear programming (LP) is an extremely useful tool and has been successfully applied to solve various problems in a wide range of areas, including operations research, engineering, economics, or even more abstract mathematical areas such…

Data Structures and Algorithms · Computer Science 2020-03-19 Agniva Chowdhury , Palma London , Haim Avron , Petros Drineas

The development of randomized algorithms for numerical linear algebra, e.g. for computing approximate QR and SVD factorizations, has recently become an intense area of research. This paper studies one of the most frequently discussed…

Numerical Analysis · Computer Science 2013-08-28 Rafi Witten , Emmanuel Candes

We derive sharp approximation error bounds for inverse block Toeplitz matrices associated with multivariate long-memory stationary processes. The error bounds are evaluated for both column and row sums. These results are used to prove the…

Statistics Theory · Mathematics 2024-06-11 Akihiko Inoue , Junho Yang

To approximate solutions of a linear differential equation, we project, via trigonometric interpolation, its solution space onto a finite-dimensional space of trigonometric polynomials and construct a matrix representation of the…

Numerical Analysis · Mathematics 2011-08-30 Oksana Bihun , Austin Bren , Michael Dyrud , Kristin Heysse

In the present paper, we propose a block variant of the extended Hessenberg process for computing approximations of matrix functions and other problems producing large-scale matrices. Applications to the computation of a matrix function…

Numerical Analysis · Mathematics 2024-01-09 A. H. Bentbib , M. EL Ghomari , K. Jbilou , EL. M. Sadek

Computation of the trace of a matrix function plays an important role in many scientific computing applications, including applications in machine learning, computational physics (e.g., lattice quantum chromodynamics), network analysis and…

Data Structures and Algorithms · Computer Science 2017-03-10 Insu Han , Dmitry Malioutov , Haim Avron , Jinwoo Shin

Models based on approximation capabilities have recently been studied in the context of Optimal Recovery. These models, however, are not compatible with overparametrization, since model- and data-consistent functions could then be…

Optimization and Control · Mathematics 2020-04-02 Simon Foucart

We introduce a new approximate solution technique for first-order Markov decision processes (FOMDPs). Representing the value function linearly w.r.t. a set of first-order basis functions, we compute suitable weights by casting the…

Artificial Intelligence · Computer Science 2012-07-09 Scott Sanner , Craig Boutilier

We present a novel algorithm attaining excessively fast, the sought solution of linear systems of equations. The algorithm is short in its basic formulation and, by definition, vectorized, while the memory allocation demands are trivial,…

Machine Learning · Computer Science 2023-09-26 Nikolaos P. Bakas

Linear programming (LP) is an extremely useful tool which has been successfully applied to solve various problems in a wide range of areas, including operations research, engineering, economics, or even more abstract mathematical areas such…

Data Structures and Algorithms · Computer Science 2022-09-26 Agniva Chowdhury , Gregory Dexter , Palma London , Haim Avron , Petros Drineas

The task of approximating a function of d variables from its evaluations at a given number of points is ubiquitous in numerical analysis and engineering applications. When d is large, this task is challenged by the so-called curse of…

Numerical Analysis · Mathematics 2016-12-21 Albert Cohen , Giovanni Migliorati