English
Related papers

Related papers: On the equivalence between SOR-type methods for li…

200 papers

We propose accelerated versions of the operator Sinkhorn iteration for operator scaling using successive overrelaxation. We analyze the local convergence rates of these accelerated methods via linearization, which allows us to determine the…

Optimization and Control · Mathematics 2026-04-27 Tasuku Soma , André Uschmajew

We show that the standard discrete update rule of transformer layers can be naturally interpreted as a forward Euler discretization of a continuous dynamical system. Our Transformer Flow Approximation Theorem demonstrates that, under…

Machine Learning · Computer Science 2025-05-26 Jacob Fein-Ashley

This paper is concerned with the adaptive numerical treatment of stochastic partial differential equations. Our method of choice is Rothe's method. We use the implicit Euler scheme for the time discretization. Consequently, in each step, an…

A review of the authors's results is given. Several methods are discussed for solving nonlinear equations $F(u)=f$, where $F$ is a monotone operator in a Hilbert space, and noisy data are given in place of the exact data. A discrepancy…

Numerical Analysis · Mathematics 2009-01-29 N. S. Hoang , A. G. Ramm

After characterizing the integrable discrete analogue of the Euler's elastica, we focus our attention on the problem of approximating a given discrete planar curve by an appropriate discrete Euler's elastica. We carry out the fairing…

Exactly Solvable and Integrable Systems · Physics 2022-06-10 Sebastián Elías Graiff Zurita , Kenji Kajiwara

Dynamical systems are a valuable asset for the study of population dynamics. On this topic, much has been done since Lotka and Volterra presented the very first continuous system to understand how the interaction between two species -- the…

Dynamical Systems · Mathematics 2023-09-26 Márcia Lemos-Silva , Delfim F. M. Torres

In the present work, we delve into further study of numerical approximations of SDEs with non-globally monotone coefficients. We design and analyze a new family of stopped increment-tamed time discretization schemes of Euler, Milstein and…

Numerical Analysis · Mathematics 2024-10-08 Lei Dai , Xiaojie Wang

We consider large linear and nonlinear fixed point problems, and solution with proximal algorithms. We show that there is a close connection between two seemingly different types of methods from distinct fields: 1) Proximal iterations for…

Numerical Analysis · Computer Science 2019-09-05 Dimitri P. Bertsekas

This paper aims to investigate the numerical approximation of semilinear non-autonomous stochastic partial differential equations (SPDEs) driven by multiplicative or additive noise. Such equations are more realistic than autonomous SPDEs…

Numerical Analysis · Mathematics 2020-11-18 Jean Daniel Mukam , Antoine Tambue

This paper is devoted to the analysis of linear second order discrete-time descriptor systems (or singular difference equations (SiDEs) with control). Following the algebraic approach proposed by Kunkel and Mehrmann for pencils of matrix…

Numerical Analysis · Mathematics 2020-05-13 Vu Hoang Linh , Ha Phi

Stiff systems of ordinary differential equations (ODEs) arise in a wide range of scientific and engineering disciplines and are traditionally solved using implicit integration methods due to their stability and efficiency. However, these…

Numerical Analysis · Mathematics 2024-12-02 Colby Fronk , Linda Petzold

The local convergence of alternating optimization methods with overrelaxation for low-rank matrix and tensor problems is established. The analysis is based on the linearization of the method which takes the form of an SOR iteration for a…

Numerical Analysis · Mathematics 2022-06-29 Ivan V. Oseledets , Maxim V. Rakhuba , André Uschmajew

We consider a sparse grid collocation method in conjunction with a time discretization of the differential equations for computing expectations of functionals of solutions to differential equations perturbed by time-dependent white noise.…

Numerical Analysis · Mathematics 2015-05-18 Z. Zhang , M. V. Tretyakov , B. Rozovskii , G. E. Karniadakis

Solving a linear system $Ax=b$ is a fundamental scientific computing primitive for which numerous solvers and preconditioners have been developed. These come with parameters whose optimal values depend on the system being solved and are…

Machine Learning · Computer Science 2024-05-03 Mikhail Khodak , Edmond Chow , Maria-Florina Balcan , Ameet Talwalkar

The Euler scheme is up to date the most important numerical method for ordinary differential inclusions, because the use of the available higher-order methods is prohibited by their enormous complexity after spatial discretization.…

Numerical Analysis · Mathematics 2013-08-19 Janosch Rieger

The ECME algorithm has proven to be an effective way of accelerating the EM algorithm for many problems. Recognising the limitation of using prefixed acceleration subspace in ECME, we propose the new Dynamic ECME (DECME) algorithm which…

Computation · Statistics 2010-04-06 Yunxiao He , Chuanhai Liu

Common techniques for the spatial discretisation of PDEs on a macroscale grid include finite difference, finite elements and finite volume methods. Such methods typically impose assumed microscale structures on the subgrid fields, so…

Dynamical Systems · Mathematics 2022-04-15 J. E. Bunder , A. J. Roberts

We introduce novel high order well-balanced finite volume methods for the full compressible Euler system with gravity source term. They require no a priori knowledge of the hydrostatic solution which is to be well-balanced and are not…

Numerical Analysis · Mathematics 2020-12-16 Jonas P. Berberich , Roger Käppeli , Praveen Chandrashekar , Christian Klingenberg

Model-free reinforcement learning attempts to find an optimal control action for an unknown dynamical system by directly searching over the parameter space of controllers. The convergence behavior and statistical properties of these…

Optimization and Control · Mathematics 2021-03-17 Hesameddin Mohammadi , Armin Zare , Mahdi Soltanolkotabi , Mihailo R. Jovanović

This paper applies the gradient discretisation method (GDM) for fourth order elliptic variational inequalities. The GDM provides a new formulation of error estimates and a complete convergence analysis of several numerical methods. We show…

Numerical Analysis · Mathematics 2023-05-31 Yahya Alnashri