English
Related papers

Related papers: Mixed-precision iterative refinement for low-rank …

200 papers

This paper proposes a new algorithm for solving MAX2SAT problems based on combining search methods with semidefinite programming approaches. Semidefinite programming techniques are well-known as a theoretical tool for approximating maximum…

Optimization and Control · Mathematics 2018-12-18 Po-Wei Wang , J. Zico Kolter

In the present paper, we consider large-scale differential Lyapunov matrix equations having a low rank constant term. We present two new approaches for the numerical resolution of such differential matrix equations. The first approach is…

Numerical Analysis · Mathematics 2017-05-30 M. Hached , K. Jbilou

Alternating minimization represents a widely applicable and empirically successful approach for finding low-rank matrices that best fit the given data. For example, for the problem of low-rank matrix completion, this method is believed to…

Machine Learning · Statistics 2012-12-04 Prateek Jain , Praneeth Netrapalli , Sujay Sanghavi

This article presents the first mixed-integer linear programming (MILP)-based iterative algorithm to solve factorable mixed-integer nonlinear programs (MINLPs) with bounded, differentiable periodic functions to global optimality with an…

Optimization and Control · Mathematics 2025-10-01 Christopher Montez , Sujeevraja Sanjeevi , Kaarthik Sundar

We propose a numerical integrator for determining low-rank approximations to solutions of large-scale matrix differential equations. The considered differential equations are semilinear and stiff. Our method consists of first splitting the…

Numerical Analysis · Mathematics 2019-06-03 Alexander Ostermann , Chiara Piazzola , Hanna Walach

In this paper, several Kaczmarz-type numerical methods for solving the matrix equation $AX=B$ and $XA=C$ are proposed, where the coefficient matrix $A$ may be full rank or rank deficient. These methods are iterative methods without matrix…

Numerical Analysis · Mathematics 2023-06-01 Weiguo Li , Wendi Bao , Lili Xing , Zhiwei Guo

In this letter, we propose an algorithm for recovery of sparse and low rank components of matrices using an iterative method with adaptive thresholding. In each iteration, the low rank and sparse components are obtained using a thresholding…

Numerical Analysis · Computer Science 2017-04-13 Nematollah Zarmehi , Farokh Marvasti

We present here a new splitting method to solve Lyapunov equations of the type $AP + PA^T=-BB^T$ in a Kronecker product form. Although that resulting matrix is of order $n^2$, each iteration of the method demands only two operations with…

Numerical Analysis · Mathematics 2023-09-26 Licio Hernanes Bezerra , Felipe Wisniewski

Since numbers in the computer are represented with a fixed number of bits, loss of accuracy during calculation is unavoidable. At high precision where more bits (e.g. 64) are allocated to each number, round-off errors are typically small.…

Numerical Analysis · Mathematics 2022-10-11 Yizhou Chen , Xiaoyun Gong , Xiang Ji

A zero-finding technique for solving nonlinear equations more efficiently than they usually are with traditional iterative methods in which the order of convergence is improved is presented. The key idea in deriving this procedure is to…

Numerical Analysis · Mathematics 2011-06-07 Miquel Grau-Sánchez , José Luis Díaz-Barrero

We are concerned with structured $\ell_0$-norms regularization problems, with a twice continuously differentiable loss function and a box constraint. This class of problems have a wide range of applications in statistics, machine learning…

Optimization and Control · Mathematics 2023-12-27 Yuqia Wu , Shaohua Pan , Xiaoqi Yang

We present a proximal augmented Lagrangian based solver for general convex quadratic programs (QPs), relying on semismooth Newton iterations with exact line search to solve the inner subproblems. The exact line search reduces in this case…

Optimization and Control · Mathematics 2020-04-02 Ben Hermans , Andreas Themelis , Panagiotis Patrinos

There are some types of ill-conditioned algebraic equations that have difficulty in obtaining accurate roots and coefficients that must be expressed with a multiple precision floating-point number. When all their roots are simple, the…

Numerical Analysis · Mathematics 2023-02-07 Tomonori Kouya

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

The efficient numerical integration of large-scale matrix differential equations is a topical problem in numerical analysis and of great importance in many applications. Standard numerical methods applied to such problems require an unduly…

Numerical Analysis · Mathematics 2018-01-22 Hermann Mena , Alexander Ostermann , Lena-Maria Pfurtscheller , Chiara Piazzola

This article studies a combination of the two state-of-the-art algorithms for the exact solution of linear programs (LPs) over the rational numbers, i.e., without any roundoff errors or numerical tolerances. By integrating the method of…

Optimization and Control · Mathematics 2023-11-15 Leon Eifler , Jules Nicolas-Thouvenin , Ambros Gleixner

We describe a three precision variant of Newton's method for nonlinear equations. We evaluate the nonlinear residual in double precision, store the Jacobian matrix in single precision, and solve the equation for the Newton step with…

Numerical Analysis · Mathematics 2023-10-11 C. T. Kelley

Many problems in data science can be treated as estimating a low-rank matrix from highly incomplete, sometimes even corrupted, observations. One popular approach is to resort to matrix factorization, where the low-rank matrix factors are…

Machine Learning · Computer Science 2021-04-23 Tian Tong , Cong Ma , Yuejie Chi

In this paper, we theoretically investigate the low-rank matrix recovery problem in the context of the unconstrained regularized nuclear norm minimization (RNNM) framework. Our theoretical findings show that, the RNNM method is able to…

Numerical Analysis · Mathematics 2021-03-09 Wendong Wang , Feng Zhang , Jianjun Wang

We present two matrix-free methods for approximately solving exact penalty subproblems that arise when solving large-scale optimization problems. The first approach is a novel iterative re-weighting algorithm (IRWA), which iteratively…

Optimization and Control · Mathematics 2017-01-02 James V. Burke , Frank E. Curtis , Hao Wang , Jiashan Wang