English
Related papers

Related papers: Low-Rank Solution Methods for Stochastic Eigenvalu…

200 papers

Composite convex optimization problems which include both a nonsmooth term and a low-rank promoting term have important applications in machine learning and signal processing, such as when one wishes to recover an unknown matrix that is…

Machine Learning · Computer Science 2018-09-28 Dan Garber , Atara Kaplan

This paper presents a weakly intrusive strategy for computing a low-rank approximation of the solution of a system of nonlinear parameter-dependent equations. The proposed strategy relies on a Newton-like iterative solver which only…

Numerical Analysis · Mathematics 2020-05-06 Loic Giraldi , Anthony Nouy

We introduce a mini-batch stochastic variance-reduced algorithm to solve finite-sum scale invariant problems which cover several examples in machine learning and statistics such as principal component analysis (PCA) and estimation of…

Optimization and Control · Mathematics 2023-04-25 Cheolmin Kim , Youngseok Kim , Diego Klabjan

Rank minimization (RM) is a wildly investigated task of finding solutions by exploiting low-rank structure of parameter matrices. Recently, solving RM problem by leveraging non-convex relaxations has received significant attention. It has…

Machine Learning · Computer Science 2018-09-17 Zaiyi Chen

The low-rank matrix approximation problem is ubiquitous in computational mathematics. Traditionally, this problem is solved in spectral or Frobenius norms, where the accuracy of the approximation is related to the rate of decrease of the…

Numerical Analysis · Mathematics 2022-01-31 Stanislav Morozov , Nikolai Zamarashkin , Eugene Tyrtyshnikov

Optimization problems with rank constraints arise in many applications, including matrix regression, structured PCA, matrix completion and matrix decomposition problems. An attractive heuristic for solving such problems is to factorize the…

Statistics Theory · Mathematics 2015-09-11 Yudong Chen , Martin J. Wainwright

In this paper we study the numerical method for approximating the random periodic solution of semiliear stochastic evolution equations. The main challenge lies in proving a convergence over an infinite time horizon while simulating…

Probability · Mathematics 2022-05-12 Yue Wu , Chenggui Yuan

In this paper we analyze a zeroth-order proximal stochastic gradient method suitable for the minimization of weakly convex stochastic optimization problems. We consider nonsmooth and nonlinear stochastic composite problems, for which…

Optimization and Control · Mathematics 2025-04-21 Spyridon Pougkakiotis , Dionysios S. Kalogerias

In this paper, we tackle two important problems in low-rank learning, which are partial singular value decomposition and numerical rank estimation of huge matrices. By using the concepts of Krylov subspaces such as Golub-Kahan…

Machine Learning · Statistics 2021-09-07 Reza Godaz , Reza Monsefi , Faezeh Toutounian , Reshad Hosseini

We consider a class of elasticity equations in ${\mathbb R}^d$ whose elastic moduli depend on $n$ separated microscopic scales, are random and expressed as a linear expansion of a countable sequence of random variables which are…

Analysis of PDEs · Mathematics 2016-06-29 Viet Ha Hoang , Thanh Chung Nguyen , Bingxing Xia

We study the steady-state Navier-Stokes equations in the context of stochastic finite element discretizations. Specifically, we assume that the viscosity is a random field given in the form of a generalized polynomial chaos expansion. For…

Numerical Analysis · Mathematics 2016-04-26 Bedřich Sousedík , Howard C. Elman

We present the first systematic work for deriving a posteriori error estimates for general non-polynomial basis functions in an interior penalty discontinuous Galerkin (DG) formulation for solving eigenvalue problems associated with second…

Numerical Analysis · Mathematics 2016-03-16 Lin Lin , Benjamin Stamm

The work discusses a new low-rank Monte Carlo technique to solve Smoluchowski-like kinetic equations. It drastically decreases the computational complexity of modeling of size-polydisperse systems. For the studied systems it can outperform…

Statistical Mechanics · Physics 2023-12-06 Alexander Osinsky

We analyze a fully discrete scheme based on the discontinuous (in time) Galerkin approach, which is combined with conforming finite element subspaces in space, for the distributed optimal control problem of the three-dimensional…

Analysis of PDEs · Mathematics 2019-06-18 Cung The Anh , Tran Minh Nguyet

In this paper, we study the problem of image recovery from given partial (corrupted) observations. Recovering an image using a low-rank model has been an active research area in data analysis and machine learning. But often, images are not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Pawan Goyal , Hussam Al Daas , Peter Benner

Dynamical low-rank approximation (DLRA) is an emerging tool for reducing computational costs and provides memory savings when solving high-dimensional problems. In this work, we propose and analyze a semi-implicit dynamical low-rank…

Numerical Analysis · Mathematics 2023-08-14 Peimeng Yin , Eirik Endeve , Cory D. Hauck , Stefan R. Schnake

In this paper, we propose three methods to solve the PageRank problem for the transition matrices with both row and column sparsity. Our methods reduce the PageRank problem to the convex optimization problem over the simplex. The first…

Optimization and Control · Mathematics 2020-12-22 Anton Anikin , Alexander Gasnikov , Alexander Gornov , Dmitry Kamzolov , Yury Maximov , Yurii Nesterov

We revisit the use of Stochastic Gradient Descent (SGD) for solving convex optimization problems that serve as highly popular convex relaxations for many important low-rank matrix recovery problems such as \textit{matrix completion},…

Machine Learning · Computer Science 2020-06-16 Dan Garber

Computing effective eigenvalues for neutron transport often requires a fine numerical resolution. The main challenge of such computations is the high memory effort of classical solvers, which limits the accuracy of chosen discretizations.…

Numerical Analysis · Mathematics 2022-09-28 Jonas Kusch , Benjamin Whewell , Ryan McClarren , Martin Frank

In uncertainty quantification, a stochastic modelling is often applied, where parameters are substituted by random variables. We investigate linear dynamical systems of ordinary differential equations with a quantity of interest as output.…

Numerical Analysis · Mathematics 2019-09-23 Roland Pulch , Akil Narayan