English
Related papers

Related papers: A generalization of the Newton-based matrix splitt…

200 papers

We consider the convergence of iterative solvers for problems of nonlinear magnetostatics. Using the equivalence to an underlying minimization problem, we can establish global linear convergence of a large class of methods, including the…

Numerical Analysis · Mathematics 2024-03-28 Herbert Egger , Felix Engertsberger , Bogdan Radu

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

The conjugate gradient method is a widely used algorithm for the numerical solution of a system of linear equations. It is particularly attractive because it allows one to take advantage of sparse matrices and produces (in case of infinite…

Numerical Analysis · Mathematics 2017-11-27 Sergey Voronin , Christophe Zaroli , Naresh P. Cuntoor

The Newton iteration is a popular method for minimising a cost function on Euclidean space. Various generalisations to cost functions defined on manifolds appear in the literature. In each case, the convergence rate of the generalised…

Optimization and Control · Mathematics 2014-08-06 Jonathan H. Manton

H. Akbar-Zadeh has recently proposed (J Geom Phys 17 (1995) 342) a new geometric formulation of Einstein-Maxwell system with source in terms of what are called "Generalized Einstein manifolds". We show that, contrary to the claim, Maxwell…

General Relativity and Quantum Cosmology · Physics 2011-07-04 M. Panahi , M. Mehrafarin

We investigate a simple variation of the Generalized Harmonic method for evolving the Einstein equations. A flat space wave equation for metric perturbations is separated from the Ricci tensor, with the rest of the Ricci tensor becoming a…

General Relativity and Quantum Cosmology · Physics 2009-02-06 Travis Garrett

We study the generalized finite element methods (GFEMs) for the second-order elliptic eigenvalue problem with an interface in 1D. The linear stable generalized finite element methods (SGFEM) were recently developed for the elliptic source…

Numerical Analysis · Mathematics 2018-10-25 Quanling Deng , Victor Calo

A general framework based on Gaussian models and a MAP-EM algorithm is introduced in this paper for solving matrix/table completion problems. The numerical experiments with the standard and challenging movie ratings data show that the…

Machine Learning · Computer Science 2010-10-21 Flavien Léger , Guoshen Yu , Guillermo Sapiro

In this paper we consider systems of partial (multidimensional) linear difference equations. Specifically, such systems arise in scientific computing under discretization of linear partial differential equations and in computational high…

Symbolic Computation · Computer Science 2007-05-23 V. P. Gerdt

The paper develops a Newton multigrid (MG) method for one- and two-dimensional steady-state shallow water equations (SWEs) with topography and dry areas.It solves the nonlinear system arising from the well-balanced finite volume…

Numerical Analysis · Mathematics 2017-09-20 Kailiang Wu , Huazhong Tang

This paper concerns the generalized Nash equilibrium problem of polynomials (GNEPP). We apply the Gauss-Seidel method and Lasserre type Moment-SOS relaxations to solve GNEPPs. The convergence of the Gauss-Seidel method is known for some…

Optimization and Control · Mathematics 2020-09-08 Jiawang Nie , Xindong Tang , Lingling Xu

Learning a Gaussian Mixture Model (GMM) is hard when the number of parameters is too large given the amount of available data. As a remedy, we propose restricting the GMM to a Gaussian Markov Random Field Mixture Model (GMRF-MM), as well as…

Machine Learning · Computer Science 2022-01-25 Shahaf E. Finder , Eran Treister , Oren Freifeld

In this paper, we first describe a matricial Newton-type algorithm designed to solve the multivariable spectrum approximation problem. We then prove its global convergence. Finally, we apply this approximation procedure to multivariate…

Optimization and Control · Mathematics 2008-09-30 Federico Ramponi , Augusto Ferrante , Michele Pavon

We present a performant, general-purpose gradient-guided nested sampling algorithm, ${\tt GGNS}$, combining the state of the art in differentiable programming, Hamiltonian slice sampling, clustering, mode separation, dynamic nested…

Machine Learning · Computer Science 2023-12-08 Pablo Lemos , Nikolay Malkin , Will Handley , Yoshua Bengio , Yashar Hezaveh , Laurence Perreault-Levasseur

Splitting methods have emerged as powerful tools to address complex problems by decomposing them into smaller solvable components. In this work, we develop a general approach to forward-backward splitting methods for solving monotone…

Optimization and Control · Mathematics 2026-04-20 Minh N. Dao , Matthew K. Tam , Thang D. Truong

The aim of this paper is to introduce a new Newton-type iterative method and then to show that this process converges to the unique solution of the scalar nonlinear equation f(x)=0 under weaker conditions involving only f and f' by fixed…

General Mathematics · Mathematics 2017-06-27 Nazli Karaca , Isa Yildirim

GMRES is one of the most popular iterative methods for the solution of large linear systems of equations that arise from the discretization of linear well-posed problems, such as Dirichlet boundary value problems for elliptic partial…

Numerical Analysis · Mathematics 2018-06-19 Silvia Gazzola , Silvia Noschese , Paolo Novati , Lothar Reichel

In this paper, we introduce a Gauss-Newton method for solving the complex phase retrieval problem. In contrast to the real-valued setting, the Gauss-Newton matrix for complex-valued signals is rank-deficient and, thus, non-invertible. To…

Numerical Analysis · Mathematics 2024-06-17 Meng Huang

Multistep matrix splitting iterations serve as preconditioning for Krylov subspace methods for solving singular linear systems. The preconditioner is applied to the generalized minimal residual (GMRES) method and the flexible GMRES (FGMRES)…

Numerical Analysis · Mathematics 2021-11-09 Keiichi Morikuni

We propose new iterative methods for computing nontrivial extremal generalized singular values and vectors. The first method is a generalized Davidson-type algorithm and the second method employs a multidirectional subspace expansion…

Numerical Analysis · Mathematics 2017-05-18 Ian N. Zwaan , Michiel E. Hochstenbach