English
Related papers

Related papers: Weakly intrusive low-rank approximation method for…

200 papers

In this paper, we propose a novel approach to the rank minimization problem, termed rank residual constraint (RRC) model. Different from existing low-rank based approaches, such as the well-known nuclear norm minimization (NNM) and the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Zhiyuan Zha , Xin Yuan , Bihan Wen , Jiantao Zhou , Jiachao Zhang , Ce Zhu

Randomized sketching accelerates large-scale numerical linear algebra by reducing computational complexity. While the traditional sketch-and-solve approach reduces the problem size directly through sketching, the sketch-and-precondition…

Numerical Analysis · Mathematics 2025-05-23 Ruihan Xu , Yiping Lu

We address the numerical solution of minimal norm residuals of {\it nonlinear} equations in finite dimensions. We take inspiration from the problem of finding a sparse vector solution by using greedy algorithms based on iterative residual…

Numerical Analysis · Mathematics 2015-04-28 Juliane Sigl

A step-search sequential quadratic programming method is proposed for solving nonlinear equality constrained stochastic optimization problems. It is assumed that constraint function values and derivatives are available, but only stochastic…

Optimization and Control · Mathematics 2024-10-08 Albert S. Berahas , Miaolan Xie , Baoyu Zhou

The paper is devoted to the solution of a weighted nonlinear least-squares problem for low-rank signal estimation, which is related to Hankel structured low-rank approximation problems. A modified weighted Gauss-Newton method, which uses…

Numerical Analysis · Mathematics 2020-12-01 N. Zvonarev , N. Golyandina

A methodology for using random sketching in the context of model order reduction for high-dimensional parameter-dependent systems of equations was introduced in [Balabanov and Nouy 2019, Part I]. Following this framework, we here construct…

Numerical Analysis · Mathematics 2022-03-25 Oleg Balabanov , Anthony Nouy

The implicit compact finite-difference scheme was developed for evolutionary partial differential parabolic and Schr\"odinger-type equations and systems with a weak nonlinearity. To make a temporal step of the compact implicit scheme we…

Mathematical Physics · Physics 2018-12-31 Vladimir Gordin , Evgenii Tsymbalov

Inference and simulation in the context of high-dimensional dynamical systems remain computationally challenging problems. Some form of dimensionality reduction is required to make the problem tractable in general. In this paper, we propose…

Machine Learning · Statistics 2024-01-04 Jonathan Schmidt , Philipp Hennig , Jörg Nick , Filip Tronarp

Nonlinear least-squares problems are a special class of unconstrained optimization problems in which their gradient and Hessian have special structures. In this paper, we exploit these structures and proposed a matrix-free algorithm with a…

Optimization and Control · Mathematics 2020-02-06 Aliyu Muhammed Awwal , Poom Kumam , Hassan Mohammad

This paper proposes an adaptive hyper-reduction method to reduce the computational cost associated with the simulation of parametric particle-based kinetic plasma models, specifically focusing on the Vlasov-Poisson equation. Conventional…

Numerical Analysis · Mathematics 2026-02-05 Cecilia Pagliantini , Federico Vismara

Structured Low-Rank Approximation is a problem arising in a wide range of applications in Numerical Analysis and Engineering Sciences. Given an input matrix $M$, the goal is to compute a matrix $M'$ of given rank $r$ in a linear or affine…

Numerical Analysis · Computer Science 2014-10-28 Éric Schost , Pierre-Jean Spaenlehauer

This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and…

Optimization and Control · Mathematics 2026-03-03 Pham Duy Khanh , Boris S. Mordukhovich , Vo Thanh Phat

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

Second-order methods are of great importance for composite convex optimization problems due to their local super-linear convergence rates (under appropriate assumptions). However, the presence of even a simple nonsmooth function in the…

Optimization and Control · Mathematics 2025-12-19 Dan Garber

We propose and analyse a numerical integrator that computes a low-rank approximation to large time-dependent matrices that are either given explicitly via their increments or are the unknown solution to a matrix differential equation.…

Numerical Analysis · Mathematics 2020-10-06 Gianluca Ceruti , Christian Lubich

A novel algorithm for the recovery of low-rank matrices acquired via compressive linear measurements is proposed and analyzed. The algorithm, a variation on the iterative hard thresholding algorithm for low-rank recovery, is designed to…

Numerical Analysis · Mathematics 2018-10-30 Simon Foucart , Srinivas Subramanian

The numerical integration of stiff equations is a challenging problem that needs to be approached by specialized numerical methods. Exponential integrators form a popular class of such methods since they are provably robust to stiffness and…

Numerical Analysis · Mathematics 2024-05-15 Benjamin Carrel , Bart Vandereycken

In this paper, we propose an efficient and scalable low rank matrix completion algorithm. The key idea is to extend orthogonal matching pursuit method from the vector case to the matrix case. We further propose an economic version of our…

Machine Learning · Computer Science 2014-04-17 Zheng Wang , Ming-Jun Lai , Zhaosong Lu , Wei Fan , Hasan Davulcu , Jieping Ye

Neural networks have achieved tremendous success in a large variety of applications. However, their memory footprint and computational demand can render them impractical in application settings with limited hardware or energy resources. In…

Machine Learning · Computer Science 2022-10-19 Steffen Schotthöfer , Emanuele Zangrando , Jonas Kusch , Gianluca Ceruti , Francesco Tudisco

This work proposes a sampling-based (non-intrusive) approach within the context of low-rank separated representations to tackle the issue of curse-of-dimensionality associated with the solution of models, e.g., PDEs/ODEs, with…

Mathematical Physics · Physics 2013-06-20 Alireza Doostan , AbdoulAhad Validi , Gianluca Iaccarino