English
Related papers

Related papers: A Low-Rank BUG Method for Sylvester-Type Equations

200 papers

This paper introduces and rigorously analyzes a least-squares weak Galerkin (LS-WG) finite element method for the severely ill-posed Cauchy problem associated with the Helmholtz equation. By utilizing a weak Laplacian operator defined on a…

Numerical Analysis · Mathematics 2026-05-21 Chunmei Wang , Shangyou Zhang

In this paper, we introduce a new stochastic approximation (SA) type algorithm, namely the randomized stochastic gradient (RSG) method, for solving an important class of nonlinear (possibly nonconvex) stochastic programming (SP) problems.…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan

In the iterative solution of dense linear systems from boundary integral equations or systems involving kernel matrices, the main challenges are the expensive matrix-vector multiplication and the storage cost which are usually tackled by…

Numerical Analysis · Mathematics 2018-11-13 Xin Xing , Edmond Chow

This paper considers the problem of minimizing the sum of a smooth function and the Schatten-$p$ norm of the matrix. Our contribution involves proposing accelerated iteratively reweighted nuclear norm methods designed for solving the…

Optimization and Control · Mathematics 2024-06-27 Hao Wang , Ye Wang , Xiangyu Yang

Formulated is a new systematic method for obtaining higher order corrections in numerical simulation of stochastic differential equations (SDEs), i.e., Langevin equations. Random walk step algorithms within a given order of finite $\Delta…

High Energy Physics - Lattice · Physics 2009-10-28 H. Nakajima , S. Furui

We propose a new stochastic proximal quasi-Newton method for minimizing the sum of two convex functions in the particular context that one of the functions is the average of a large number of smooth functions and the other one is nonsmooth.…

Optimization and Control · Mathematics 2024-12-24 Yongcun Song , Zimeng Wang , Xiaoming Yuan , Hangrui Yue

Various applications in signal processing and machine learning give rise to highly structured spectral optimization problems characterized by low-rank solutions. Two important examples that motivate this work are optimization problems from…

Optimization and Control · Mathematics 2018-08-23 Michael P. Friedlander , Ives Macedo

We consider the Low Rank Approximation problem, where the input consists of a matrix $A \in \mathbb{R}^{n_R \times n_C}$ and an integer $k$, and the goal is to find a matrix $B$ of rank at most $k$ that minimizes $\| A - B \|_0$, which is…

Data Structures and Algorithms · Computer Science 2023-11-03 Vincent Cohen-Addad , Chenglin Fan , Suprovat Ghoshal , Euiwoong Lee , Arnaud de Mesmay , Alantha Newman , Tony Chang Wang

The Runge--Kutta (RK) discontinuous Galerkin (DG) method is a mainstream numerical algorithm for solving hyperbolic equations. In this paper, we use the linear advection equation in one and two dimensions as a model problem to prove the…

Numerical Analysis · Mathematics 2024-10-02 Zheng Sun

A reduced-rank framework with set-membership filtering (SMF) techniques is presented for adaptive beamforming problems encountered in radar systems. We develop and analyze stochastic gradient (SG) and recursive least squares (RLS)-type…

Information Theory · Computer Science 2013-02-05 L. Wang , R. C. de Lamare

We present a high-order spacetime numerical method for discretizing and solving linear initial-boundary value problems using wavelet-based techniques with user-prescribed error estimates. The spacetime wavelet discretization yields a system…

Numerical Analysis · Mathematics 2025-09-04 Cody D. Cochran , Karel Matous

In this contribution, we are concerned with parameter optimization problems that are constrained by multiscale PDE state equations. As an efficient numerical solution approach for such problems, we introduce and analyze a new relaxed and…

Numerical Analysis · Mathematics 2023-04-13 Tim Keil , Mario Ohlberger

We consider the problem of finding a low rank symmetric matrix satisfying a system of linear equations, as appears in phase retrieval. In particular, we solve the gauge dual formulation, but use a fast approximation of the spectral…

Optimization and Control · Mathematics 2020-06-02 Ron Estrin , Yifan Sun , Halyun Jeong , Michael Friedlander

The Sylvester smallest enclosing circle problem involves finding the smallest circle that encloses a finite number of points in the plane. We consider generalized versions of the Sylvester problem in which the points are replaced by sets.…

Optimization and Control · Mathematics 2015-03-18 Nguyen Thai An , Daniel Giles , Nguyen Mau Nam , R. Blake Rector

Kernel methods are widespread in machine learning; however, they are limited by the quadratic complexity of the construction, application, and storage of kernel matrices. Low-rank matrix approximation algorithms are widely used to address…

Machine Learning · Statistics 2021-05-05 Ruoxi Wang , Yingzhou Li , Michael W. Mahoney , Eric Darve

Efficient structural reanalysis for high-rank modification plays an important role in engineering computations which require repeated evaluations of structural responses, such as structural optimization and probabilistic analysis. To…

Computational Engineering, Finance, and Science · Computer Science 2025-05-20 Wenxiong Li , Suiyin Chen , Huan Huang

In this work, we deal with rank-constrained integer least-squares optimization problems arising in low-rank matrix factorization related applications. We propose a solution for constrained integer least-squares problem subject to equality,…

Optimization and Control · Mathematics 2018-11-06 Arun Ayyar , Nirav Bhatt

In this paper, we develop an efficient numerical solver for unsteady diffusion-type partial differential equations with random coefficients. A major computational challenge in such problems lies in repeatedly handling large-scale linear…

Numerical Analysis · Mathematics 2026-01-19 Yujun Zhu , Min Li , Yulan Ning , Ju Ming

Dynamical low-rank approximation allows for solving large-scale matrix differential equations (MDEs) with significantly fewer degrees of freedom and has been applied to a growing number of applications. However, most existing techniques…

Numerical Analysis · Mathematics 2024-08-30 Mohammad Hossein Naderi , Sara Akhavan , Hessam Babaee

Low-rank approximation of a matrix by means of structured random sampling has been consistently efficient in its extensive empirical studies around the globe, but adequate formal support for this empirical phenomenon has been missing so…

Numerical Analysis · Mathematics 2016-07-21 Victor Pan , John Svadlenka , Liang Zhao