English
Related papers

Related papers: Computing Nonlinear Eigenfunctions via Gradient Fl…

200 papers

In this work, multi-variable derivative-free optimization algorithms for unconstrained optimization problems are developed. A novel procedure for approximating the gradient of multi-variable objective functions based on non-commutative maps…

Optimization and Control · Mathematics 2021-11-17 Jan Feiling , Mohamed-Ali Belabbas , Christian Ebenbauer

We present a paradigm for developing arbitrarily high order, linear, unconditionally energy stable numerical algorithms for gradient flow models. We apply the energy quadratization (EQ) technique to reformulate the general gradient flow…

Numerical Analysis · Mathematics 2020-07-15 Yuezheng Gong , Jia Zhao , Qi Wang

We study the implicit bias of gradient flow (i.e., gradient descent with infinitesimal step size) on linear neural network training. We propose a tensor formulation of neural networks that includes fully-connected, diagonal, and…

Machine Learning · Computer Science 2021-09-13 Chulhee Yun , Shankar Krishnan , Hossein Mobahi

We study evolution equations on metric graphs with reservoirs, that is graphs where a one-dimensional interval is associated to each edge and, in addition, the vertices are able to store and exchange mass with these intervals. Focusing on…

Analysis of PDEs · Mathematics 2024-12-24 Georg Heinze , Jan-Frederik Pietschmann , André Schlichting

Nonlinear dimensionality reduction methods provide a valuable means to visualize and interpret high-dimensional data. However, many popular methods can fail dramatically, even on simple two-dimensional manifolds, due to problems such as…

Machine Learning · Statistics 2020-07-08 Daniel Ting , Michael I. Jordan

We provide some counterexamples concerning the uniqueness and regularity of weak solutions to the initial-boundary value problem for gradient flows of certain strongly polyconvex functionals by showing that such a problem can possess a…

Analysis of PDEs · Mathematics 2022-05-17 Baisheng Yan

Recent work of the authors and their collaborators has uncovered fundamental connections between the Dirichlet-to-Neumann map, the spectral flow of a certain family of self-adjoint operators, and the nodal deficiency of a Laplacian…

Spectral Theory · Mathematics 2023-03-07 Gregory Berkolaiko , Graham Cox , Bernard Helffer , Mikael Persson Sundqvist

Deep learning applications are computation-intensive and often employ GPU as the underlying computing devices. Deep learning frameworks provide powerful programming interfaces, but the gap between source codes and practical GPU operations…

Software Engineering · Computer Science 2017-07-13 Jiazhen Gu , Huan Liu , Yangfan Zhou , Xin Wang

This work proposes a hyper-reduction method for nonlinear parametric dynamical systems characterized by gradient fields such as Hamiltonian systems and gradient flows. The gradient structure is associated with conservation of invariants or…

Numerical Analysis · Mathematics 2023-07-24 Cecilia Pagliantini , Federico Vismara

In many experimental contexts, it is necessary to statistically remove the impact of instrumental effects in order to physically interpret measurements. This task has been extensively studied in particle physics, where the deconvolution…

High Energy Physics - Phenomenology · Physics 2024-12-17 Huanbiao Zhu , Krish Desai , Mikael Kuusela , Vinicius Mikuni , Benjamin Nachman , Larry Wasserman

We consider the problem of molecular graph generation using deep models. While graphs are discrete, most existing methods use continuous latent variables, resulting in inaccurate modeling of discrete graph structures. In this work, we…

Machine Learning · Computer Science 2021-06-03 Youzhi Luo , Keqiang Yan , Shuiwang Ji

Diffusion Map is a spectral dimensionality reduction technique which is able to uncover nonlinear submanifolds in high-dimensional data. And, it is increasingly applied across a wide range of scientific disciplines, such as biology,…

Machine Learning · Computer Science 2026-01-29 Sönke Beier , Paula Pirker-Díaz , Friedrich Pagenkopf , Karoline Wiesner

Fractional derivatives are a well-studied generalization of integer order derivatives. Naturally, for optimization, it is of interest to understand the convergence properties of gradient descent using fractional derivatives. Convergence…

Optimization and Control · Mathematics 2024-06-05 Ashwani Aggarwal

The purpose of this work is to study spectral methods to approximate the eigenvalues of nonlocal integral operators. Indeed, even if the spatial domain is an interval, it is very challenging to obtain closed analytical expressions for the…

Numerical Analysis · Mathematics 2021-10-13 Luciano Lopez , Sabrina Francesca Pellegrino

It is well-known that many diffusion equations can be recast as Wasserstein gradient flows. Moreover, in recent years, by modifying the Wasserstein distance appropriately, this technique has been transferred to further evolution equations…

Probability · Mathematics 2020-10-15 Kaveh Bashiri , Anton Bovier

The principal aim of this article is to establish an iteration method on the space of resurgent functions. We discuss endless continuability of iterated convolution products of resurgent functions and derive their estimates developing the…

Classical Analysis and ODEs · Mathematics 2016-10-20 Shingo Kamimoto

The gradient-flow dynamics of an arbitrary geometric quantity is derived using a generalization of Darcy's Law. We consider flows in both Lagrangian and Eulerian formulations. The Lagrangian formulation includes a dissipative modification…

Adaptation and Self-Organizing Systems · Physics 2008-04-28 Darryl D. Holm , Vakhtang Putkaradze , Cesare Tronci

We study the gradient flow of the potential energy on the infinite-dimensional Riemannian manifold of spatial curves parametrized by the arc length, which models overdamped motion of a falling inextensible string. We prove existence of…

Analysis of PDEs · Mathematics 2019-02-28 Wenhui Shi , Dmitry Vorotnikov

We present a finite difference method to compute the principal eigenvalue and the corresponding eigenfunction for a large class of second order elliptic operators including notably linear operators in nondivergence form and fully nonlinear…

Numerical Analysis · Mathematics 2016-02-18 Isabeau Birindelli , Fabio Camilli , Italo Capuzzo Dolcetta

This paper introduces a novel feature extraction technique for the analysis of spectral line Stokes profiles. The procedure is based on the use of an auto-associative artificial neural network containing non-linear hidden layers. The neural…

Astrophysics · Physics 2009-11-10 H. Socas-Navarro