Related papers: From Stationary Phase to Steepest Descent
We study finite-sum nonconvex optimization problems, where the objective function is an average of $n$ nonconvex functions. We propose a new stochastic gradient descent algorithm based on nested variance reduction. Compared with…
We present a dynamical system framework for understanding Nesterov's accelerated gradient method. In contrast to earlier work, our derivation does not rely on a vanishing step size argument. We show that Nesterov acceleration arises from…
We consider the inverse problem of recovering stationary coefficients in a class of dynamical Schr\"odinger equations with locally analytic nonlinear terms. Upon treating the well-posedness for small initial data and trivial boundary data,…
A phase-field model that takes into account the bending energy of fluid vesicles is presented. The Canham-Helfrich model is derived in the sharp-interface limit. A dynamic equation for the phase-field has been solved numerically to find…
The aim of this work is to establish a linear instability criterium of stationary solutions for the Korteweg-de Vries model on a star graph with a structure represented by a finite collections of semi-infinite edges. By considering a…
Nonlinear contraction theory is a comparatively recent dynamic control system design tool based on an exact differential analysis of convergence, in essence converting a nonlinear stability problem into a linear time-varying stability…
In this paper we propose a new method to stabilise non-symmetric indefinite problems. The idea is to solve a forward and an adjoint problem simultaneously using a suitable stabilised finite element method. Both stabilisation of the element…
Driven by the need to solve increasingly complex optimization problems in signal processing and machine learning, there has been increasing interest in understanding the behavior of gradient-descent algorithms in non-convex environments.…
This paper aims to investigate a multi-dimensional transport equation with nonlocal velocity and fractional dissipation.The balance between the nonlinearity and dissipation gives rise to three different cases, namely the subcritical,…
Dynamical systems governed by priority rules appear in the modeling of emergency organizations and road traffic. These systems can be modeled by piecewise linear time-delay dynamics, specifically using Petri nets with priority rules. A…
We consider the periodic non-linear Schr\"odinger equation with non-linearity given by $|u|^{p-1}u$ for odd $p > 1$ in dimension $1$. We first establish that the difference between the non-linear evolution and a phase rotation of the the…
The $\mu$-neutral linear fractional multi-delayed differential nonhomogeneous system with noncommutative coefficient matrices is introduced. The novel $\mu$-neutral multi-delayed perturbation of Mittag-Leffler type matrix function is…
This is the first in a series of papers which deal with the development of novel methods for solving a system of linear algebraic equations with a time complexity lower than existing algorithms. The NxN system of linear equations, Ax = b,…
In this article we give an overview of the concept of universal dynamics near non-thermal fixed points in isolated quantum many-body systems. We outline a non-perturbative kinetic theory derived within a Schwinger-Keldysh closed-time…
The stochastic subgradient method is a widely-used algorithm for solving large-scale optimization problems arising in machine learning. Often these problems are neither smooth nor convex. Recently, Davis et al. [1-2] characterized the…
We generalize the method of obtaining the fundamental linear partial differential equations such as the diffusion and Schrodinger equation, Dirac and telegrapher's equation from a simple stochastic consideration to arrive at certain…
The susceptibility of timestepping algorithms to numerical instabilities is an important consideration when simulating partial differential equations (PDEs). Here we identify and analyze a pernicious numerical instability arising in…
We consider the study of a numerical scheme for an initial- and Dirichlet boundary- value problem for a nonlinear Schr\"odinger equation. We approximate the solution using a, local (non-uniform) two level scheme in time (see C. Besse [6]…
In this paper, we study the problem of solving a simple bilevel optimization problem, where the upper-level objective is minimized over the solution set of the lower-level problem. We focus on the general setting in which both the upper-…
Von Neumann stability analysis, a well-known Fourier-based method, is a widely used technique for assessing stability in numerical computations. However, as noted in "Numerical Solution of Partial Differential Equations: Finite Difference…