Related papers: A Toolkit For Steady States of Nonlinear Wave Equa…
Two accelerated imaginary-time evolution methods are proposed for the computation of solitary waves in arbitrary spatial dimensions. For the first method (with traditional power normalization), the convergence conditions as well as…
Recent research has indicated a substantial rise in interest in understanding Nesterov's accelerated gradient methods via their continuous-time models. However, most existing studies focus on specific classes of Nesterov's methods, which…
In this work we propose a differential geometric motivation for Nesterov's accelerated gradient method (AGM) for strongly-convex problems. By considering the optimization procedure as occurring on a Riemannian manifold with a natural…
We present an arbitrary-order spectral element method for general-purpose simulation of non-overturning water waves, described by fully nonlinear potential theory. The method can be viewed as a high-order extension of the classical finite…
An exponential time-integrator scheme of second-order accuracy based on the predictor-corrector methodology, denoted PCEXP, is developed to solve multi-dimensional nonlinear partial differential equations pertaining to fluid dynamics. The…
An artificial intelligence-augmented Streamline Upwind/Petrov-Galerkin finite element scheme (AiStab-FEM) is proposed for solving singularly perturbed partial differential equations. In particular, an artificial neural network framework is…
Starting from a time-dependent Schr\"odinger equation, stationary states of 3D central potentials are obtained. An imaginary-time evolution technique coupled with the minimization of energy expectation value, subject to the orthogonality…
Nesterov's accelerated gradient method (NAG) is widely used in problems with machine learning background including deep learning, and is corresponding to a continuous-time differential equation. From this connection, the property of the…
This paper is concerned with the strong approximation of a semi-linear stochastic wave equation with strong damping, driven by additive noise. Based on a spatial discretization performed by a spectral Galerkin method, we introduce a kind of…
Recently, there has been great interest in connections between continuous-time dynamical systems and optimization methods, notably in the context of accelerated methods for smooth and unconstrained problems. In this paper we extend this…
Nesterov's well-known scheme for accelerating gradient descent in convex optimization problems is adapted to accelerating stationary iterative solvers for linear systems. Compared with classical Krylov subspace acceleration methods, the…
We derive a second-order ordinary differential equation (ODE) which is the limit of Nesterov's accelerated gradient method. This ODE exhibits approximate equivalence to Nesterov's scheme and thus can serve as a tool for analysis. We show…
Three new iteration methods, namely the squared-operator method, the modified squared-operator method, and the power-conserving squared-operator method, for solitary waves in general scalar and vector nonlinear wave equations are proposed.…
Despite their frequent slow convergence, proximal gradient schemes are widely used in large-scale optimization tasks due to their tremendous stability, scalability, and ease of computation. In this paper, we develop and investigate a…
In this paper we propose a new class of iterative regularization methods for solving ill-posed linear operator equations. The prototype of these iterative regularization methods is in the form of second order evolution equation with a…
The stability of classical semi-implicit scheme, and some more advanced iterative schemes recently proposed for Numerical Weather Prediction (NWP) purpose is examined. In all these schemes, the solution of the centred-implicit non-linear…
Lookahead-based acceleration methods, such as Nesterov's momentum, are widely used in optimization, but they often become unreliable in deep learning training mainly due to stochastic gradient noise and non-convex loss landscapes. In…
The Expectation-Maximization (EM) algorithm is a popular choice for learning latent variable models. Variants of the EM have been initially introduced, using incremental updates to scale to large datasets, and using Monte Carlo (MC)…
This paper explores the exponential stability of two nonlinear wave equations coupled through their velocities. The analysis is divided into two main cases. First, we consider a system where one equation is damped, while the other…
We develop a generalization of Nesterov's accelerated gradient descent method which is designed to deal with orthogonality constraints. To demonstrate the effectiveness of our method, we perform numerical experiments which demonstrate that…