English
Related papers

Related papers: Generalized preconditioned conjugate gradients for…

200 papers

Learning Gaussian Mixture Models (GMMs) is a fundamental problem in machine learning, with the Expectation-Maximization (EM) algorithm and its popular variant gradient EM being arguably the most widely used algorithms in practice. In the…

Machine Learning · Computer Science 2025-06-10 Mo Zhou , Weihang Xu , Maryam Fazel , Simon S. Du

Primal-Dual Hybrid Gradient (PDHG) and Alternating Direction Method of Multipliers (ADMM) are two widely-used first-order optimization methods. They reduce a difficult problem to simple subproblems, so they are easy to implement and have…

Optimization and Control · Mathematics 2019-09-10 Yanli Liu , Yunbei Xu , Wotao Yin

Implicit time integration is key to robustly simulating stiff materials and large deformations, but its performance is often dominated by repeatedly solving large linear systems. Adaptive coarsening can reduce this cost by concentrating…

Graphics · Computer Science 2026-05-07 Xuan Wang , Zhaofeng Luo , Minchen Li , Taku Komura , Kemeng Huang

High order tensor arises more and more often in signal processing,data analysis, higher-order statistics, as well as imaging sciences. In this paper, an adaptive gradient (AG) method is presented for generalized tensor eigenpairs. Global…

Optimization and Control · Mathematics 2016-01-08 Gaohang Yu , Zefeng Yu , Yi Xu , Yisheng Song

We consider the problem of minimizing the sum of two convex functions: one is smooth and given by a gradient oracle, and the other is separable over blocks of coordinates and has a simple known structure over each block. We develop an…

Optimization and Control · Mathematics 2014-07-07 Qihang Lin , Zhaosong Lu , Lin Xiao

The state-of-the art proof of a global inf-sup condition on mixed finite element schemes does not allow for an analysis of truly indefinite, second-order linear elliptic PDEs. This paper, therefore, first analyses a nonconforming finite…

Numerical Analysis · Mathematics 2014-01-21 Carsten Carstensen , Asha K. Dond , Neela Nataraj , Amiya K. Pani

The implementation of efficient multigrid preconditioners for elliptic partial differential equations (PDEs) is a challenge due to the complexity of the resulting algorithms and corresponding computer code. For sophisticated finite element…

Mathematical Software · Computer Science 2016-10-07 Lawrence Mitchell , Eike Hermann Müller

A new finite element method (FEM) using meshes that do not necessarily align with the interface is developed for two- and three-dimensional anisotropic elliptic interface problems with nonhomogeneous jump conditions. The degrees of freedom…

Numerical Analysis · Mathematics 2025-05-20 Haifeng Ji , Zhilin Li

In recent years, the immersed finite element methods (IFEM) introduced in \cite{Li2003}, \cite{Li2004} to solve elliptic problems having an interface in the domain due to the discontinuity of coefficients are getting more attentions of…

Numerical Analysis · Mathematics 2015-07-06 Do Y. Kwak , Juho Lee

The use of multigrid and related preconditioners with the finite element method is often limited by the difficulty of applying the algorithm effectively to a problem, especially when the domain has a complex shape or adaptive refinement. We…

Numerical Analysis · Computer Science 2015-03-19 Peter R. Brune , Matthew G. Knepley , L. Ridgway Scott

To solve high-dimensional parameter-dependent partial differential equations (pPDEs), a neural network architecture is presented. It is constructed to map parameters of the model data to corresponding finite element solutions. To improve…

Numerical Analysis · Mathematics 2024-03-20 Janina E. Schütte , Martin Eigel

The use of neural networks to approximate partial differential equations (PDEs) has gained significant attention in recent years. However, the approximation of PDEs with localised phenomena, e.g., sharp gradients and singularities, remains…

Numerical Analysis · Mathematics 2025-01-30 Santiago Badia , Wei Li , Alberto F. Martín

We present numerical experiments for geophysics electromagnetic (EM) modeling based upon high-order edge elements and supervised $h+p$ refinement approaches on massively parallel computers. Our high-order $h+p$ refinement strategy is based…

The efficient solution of discretisations of coupled systems of partial differential equations (PDEs) is at the core of much of numerical simulation. Significant effort has been expended on scalable algorithms to precondition Krylov…

Mathematical Software · Computer Science 2018-02-22 Robert C. Kirby , Lawrence Mitchell

We present a Calder\'on preconditioning scheme for the symmetric formulation of the forward electroencephalographic (EEG) problem that cures both the dense discretization and the high-contrast breakdown. Unlike existing Calder\'on schemes…

Numerical Analysis · Mathematics 2023-08-16 Viviana Giunzioni , John E. Ortiz G. , Adrien Merlini , Simon B. Adrian , Francesco P. Andriulli

We describe main issues and design principles of an efficient implementation, tailored to recent generations of Nvidia Graphics Processing Units (GPUs), of an Algebraic Multigrid (AMG) preconditioner previously proposed by one of the…

Numerical Analysis · Mathematics 2018-10-11 Massimo Bernaschi , Pasqua D'Ambra , Dario Pasquini

In this paper, we present a finite element method (FEM) framework enhanced by an operator-adapted wavelet decomposition algorithm designed for the efficient analysis of multiscale electromagnetic problems. Usual adaptive FEM approaches,…

Computational Physics · Physics 2026-02-18 F. Şık , F. L. Teixeira , B. Shanker

We propose ALFCG (Adaptive Lipschitz-Free Conditional Gradient), the first \textit{adaptive} projection-free framework for stochastic composite nonconvex minimization that \textit{requires neither global smoothness constants nor line…

Machine Learning · Computer Science 2026-03-09 Ganzhao Yuan

In this paper, we consider an efficient iterative approach to the solution of the discrete Helmholtz equation with Dirichlet, Neumann and Sommerfeld-like boundary conditions based on a compact sixth order approximation scheme and…

Numerical Analysis · Mathematics 2012-12-07 Yury Gryazin

Multiphysics problems such as multicomponent diffusion, phase transformations in multiphase systems and alloy solidification involve numerical solution of a coupled system of nonlinear partial differential equations (PDEs). Numerical…

Materials Science · Physics 2022-11-24 Vir Karan , A. Maruthi Indresh , Saswata Bhattacharyya