Related papers: The Gentlest Ascent Dynamics
We present an improved high-index saddle dynamics (iHiSD) for finding saddle points and constructing solution landscapes, which is a crossover dynamics from gradient flow to traditional HiSD such that the Morse theory for gradient flow…
We apply methods of dynamical systems to study the behaviour of the Randall-Sundrum models. We determine evolutionary paths for all possible initial conditions in a 2-dimensional phase space and we investigate the set of accelerated models.…
In this paper we shall analyze the $f(\mathcal{G})$ gravity phase space, in the case that the corresponding dynamical system is autonomous. In order to make the dynamical system autonomous, we shall appropriately choose the independent…
We study the existence and uniqueness of (locally) absolutely continuous trajectories of a dynamical system governed by a nonexpansive operator. The weak convergence of the orbits to a fixed point of the operator is investigated by relying…
Bistability is a ubiquitous phenomenon in life sciences. In this paper, two kinds of bistable structures in dynamical systems are studied: One is two one-point attractors, another is a one-point attractor accompanied by a cycle attractor.…
Recently, the problem of local minima in very high dimensional non-convex optimization has been challenged and the problem of saddle points has been introduced. This paper introduces a dynamic type of normalization that forces the system to…
In this paper, we study discrete dynamics of phytoplankton-zooplankton system with Holling type II and Holling type III predator functional responses. The stability of positive fixed points are investigated. By finding invariant sets, the…
This paper presents an instability result of Hamiltonian systems associated with optimal swing-up control for a pendulum. The systems possess weak (higher-order) instability at the initial point of the swing-up control, the analysis for…
The basin of attraction is the set of initial points that will eventually converge to some attracting set. Its knowledge is important in understanding the dynamical behavior of a given dynamical system of interest. In this work, we address…
The dynamics of one dimensional iterative maps in the regime of fully developed chaos is studied in detail. Motivated by the observation of dynamical structures around the unstable fixed point we introduce the geometrical concept of a…
Despite the striking successes of deep neural networks trained with gradient-based optimization, these methods differ fundamentally from their biological counterparts. This gap raises key questions about how nature achieves robust,…
We study dynamics in a neighborhood of a nonhyperbolic fixed point or an irreducible homoclinic tangent point. General type conditions for the existence of infinite sets of periodic points are obtained. A new method, based on the study of…
We consider a general class of translation-invariant systems with a specific category of output nonlinearities motivated by biological sensing. We show that no dynamic output feedback can stabilize this class of systems to an isolated…
The dynamics of glass-forming liquids display several outstanding features, such as two-step relaxation and dynamic heterogeneities, which are difficult to predict quantitatively from first principles. In this work, we revisit a simple…
Multistable processes, that is, processes which are, at each "time", tangent to a stable process, but where the index of stability varies along the path, have been recently introduced as models for phenomena where the intensity of jumps is…
In this paper we consider solving saddle point problems using two variants of Gradient Descent-Ascent algorithms, Extra-gradient (EG) and Optimistic Gradient Descent Ascent (OGDA) methods. We show that both of these algorithms admit a…
We here describe the possibility of a synthetic description of the onset of Chaos in many degrees of freedom dynamical systems within the framework of the geometric description of dynamics. We show how this approach to instability helps to…
We present stability conditions for deterministic time-varying nonlinear discrete-time systems whose inputs aim to minimize an infinite-horizon time-dependent cost. Global asymptotic and exponential stability properties for general…
In centralized settings, it is well known that stochastic gradient descent (SGD) avoids saddle points and converges to local minima in nonconvex problems. However, similar guarantees are lacking for distributed first-order algorithms. The…
In these lecture notes we present different methods and concepts developed in statistical physics to analyze gradient descent dynamics in high-dimensional non-convex landscapes. Our aim is to show how approaches developed in physics, mainly…