English
Related papers

Related papers: Nonsymmetric multigrid preconditioning for conjuga…

200 papers

We design and investigate efficient multigrid solvers for multiphase Stokes problems discretised via mixed-degree local discontinuous Galerkin methods. Using the template of a standard multigrid V-cycle, we develop a smoother analogous to…

Numerical Analysis · Mathematics 2025-11-26 Robert I. Saye

Stochastic gradient descent~(SGD) and its variants have attracted much attention in machine learning due to their efficiency and effectiveness for optimization. To handle large-scale problems, researchers have recently proposed several…

Machine Learning · Statistics 2016-12-19 Shen-Yi Zhao , Gong-Duo Zhang , Wu-Jun Li

Differentiable model predictive control (MPC) offers a powerful framework for combining learning and control. However, its adoption has been limited by the inherently sequential nature of traditional optimization algorithms, which are…

Optimization and Control · Mathematics 2025-10-08 Emre Adabag , Marcus Greiff , John Subosits , Thomas Lew

We develop a $ P $-multigrid solver to simulate locally preconditioned unsteady compressible Navier-Stokes equations at low Mach numbers with implicit high-order methods. Specifically, the high-order flux reconstruction/correction procedure…

Computational Physics · Physics 2019-08-13 Lai Wang , Meilin Yu

The numerical analysis of higher-order mixed finite-element discretizations for saddle-point problems, such as the Stokes equations, has been well-studied in recent years. While the theory and practice of such discretizations is now…

Numerical Analysis · Mathematics 2025-03-24 Amin Rafiei , Scott MacLachlan

We propose Score-based Relaxation-guided Generation (SRG), a generative framework based on an approximate formulation of relaxation-guided stochastic differential equations (SDEs) for mixed-integer linear programming. SRG employs a…

Machine Learning · Computer Science 2026-05-13 Ruobing Wang , Xin Li , Yujie Fang , Mingzhong Wang

Many subsurface engineering applications involve tight-coupling between fluid flow, solid deformation, fracturing, and similar processes. To better understand the complex interplay of different governing equations, and therefore design…

The Preconditioned Conjugate Gradient method is often employed for the solution of linear systems of equations arising in numerical simulations of physical phenomena. While being widely used, the solver is also known for its lack of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-18 Roman Iakymchuk , Maria Barreda , Stef Graillat , Jose I. Aliaga , Enrique S. Quintana-Orti

In this paper, we study the performance of a large family of SGD variants in the smooth nonconvex regime. To this end, we propose a generic and flexible assumption capable of accurate modeling of the second moment of the stochastic…

Optimization and Control · Mathematics 2020-06-15 Zhize Li , Peter Richtárik

Algebraic multigrid (AMG) is one of the most widely used solution techniques for linear systems of equations arising from discretized partial differential equations. The popularity of AMG stems from its potential to solve linear systems in…

Numerical Analysis · Mathematics 2026-04-03 Carlo Janna , Andrea Franceschini , Jacob B. Schroder , Luke Olson

Convex quadratic programming (QP) is an essential class of optimization problems with broad applications across various fields. Traditional QP solvers, typically based on simplex or barrier methods, face significant scalability challenges.…

Optimization and Control · Mathematics 2024-10-08 Yicheng Huang , Wanyu Zhang , Hongpei Li , Dongdong Ge , Huikang Liu , Yinyu Ye

The computational complexity of naive, sampling-based uncertainty quantification for 3D partial differential equations is extremely high. Multilevel approaches, such as multilevel Monte Carlo (MLMC), can reduce the complexity significantly,…

Computational Engineering, Finance, and Science · Computer Science 2016-07-13 Björn Gmeiner , Daniel Drzisga , Ulrich Ruede , Robert Scheichl , Barbara Wohlmuth

We investigate several robust preconditioners for solving the saddle-point linear systems that arise from spatial discretization of unsteady and steady variable-coefficient Stokes equations on a uniform staggered grid. Building on the…

Numerical Analysis · Mathematics 2016-08-24 M. Cai , A. J. Nonaka , J. B. Bell , B. E. Griffith , A. Donev

Stochastic gradient methods are dominant in nonconvex optimization especially for deep models but have low asymptotical convergence due to the fixed smoothness. To address this problem, we propose a simple yet effective method for improving…

Machine Learning · Computer Science 2018-05-25 Jun Li , Hongfu Liu , Bineng Zhong , Yue Wu , Yun Fu

The dual formulation for linear elasticity, in contrast to the primal formulation, is not affected by locking, as it is based on the stresses as main unknowns. Thus it is quite attractive for nearly incompressible and incompressible…

Numerical Analysis · Mathematics 2021-06-28 Gabriele Rovi , Rolf Krause

In this work we extend the shifted Laplacian approach to the elastic Helmholtz equation. The shifted Laplacian multigrid method is a common preconditioning approach for the discretized acoustic Helmholtz equation. In some cases, like…

Computational Engineering, Finance, and Science · Computer Science 2023-11-21 Eran Treister , Rachel Yovel

The paper proposes a combination of the subdomain deflation method and local algebraic multigrid as a scalable distributed memory preconditioner that is able to solve large linear systems of equations. The implementation of the algorithm is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-31 Denis Demidov , Riccardo Rossi

We study nonconvex finite-sum problems and analyze stochastic variance reduced gradient (SVRG) methods for them. SVRG and related methods have recently surged into prominence for convex optimization given their edge over stochastic gradient…

Optimization and Control · Mathematics 2016-04-06 Sashank J. Reddi , Ahmed Hefny , Suvrit Sra , Barnabas Poczos , Alex Smola

We investigate stochastic Bregman proximal gradient (SBPG) methods for minimizing a finite-sum nonconvex function $\Psi(x):=\frac{1}{n}\sum_{i=1}^nf_i(x)+\phi(x)$, where $\phi$ is convex and nonsmooth, while $f_i$, instead of gradient…

Optimization and Control · Mathematics 2025-09-23 Junyu Zhang

This paper develops a new algebraic multigrid (AMG) method for sparse least-squares systems of the form $A=G^TG$ motivated by challenging applications in scientific computing where classical AMG methods fail. First we review and relate the…

Numerical Analysis · Mathematics 2026-01-09 Ben S. Southworth , Hussam Al Daas , Golo A. Wimmer , Ed Threlfall