English
Related papers

Related papers: Computing Nonlinear Eigenfunctions via Gradient Fl…

200 papers

Finding latent structures in data is drawing increasing attention in diverse fields such as image and signal processing, fluid dynamics, and machine learning. In this work we examine the problem of finding the main modes of gradient flows.…

Dynamical Systems · Mathematics 2020-12-29 Ido Cohen , Omri Azencot , Pavel Lifshitz , Guy Gilboa

This paper discusses the use of absolutely one-homogeneous regularization functionals in a variational, scale space, and inverse scale space setting to define a nonlinear spectral decomposition of input data. We present several theoretical…

Numerical Analysis · Computer Science 2016-01-13 Martin Burger , Guy Gilboa , Michael Moeller , Lina Eckardt , Daniel Cremers

In this paper, we present a theoretical and computational workflow for the non-parametric Bayesian inference of drift and diffusion functions of autonomous diffusion processes. We base the inference on the partial differential equations…

Computational Engineering, Finance, and Science · Computer Science 2024-11-05 Maximilian Kruse , Sebastian Krumscheid

Although Feynman integrals in general cannot be expressed as well-studied special functions, they can be calculated systematically and efficiently using the \texttt{AMFlow} method in combination with differential equations in the kinematic…

High Energy Physics - Phenomenology · Physics 2024-04-02 Zhi-Feng Liu , Yan-Qing Ma , Chen-Yu Wang

We derive explicit equations governing the cumulative biases and weights in Deep Learning with ReLU activation function, based on gradient descent for the Euclidean cost in the input layer, and under the assumption that the weights are, in…

Machine Learning · Computer Science 2025-01-15 Thomas Chen

The Evans function has been used extensively to study spectral stability of travelling-wave solutions in spatially extended partial differential equations. To compute Evans functions numerically, several shooting methods have been…

Numerical Analysis · Mathematics 2018-01-17 Blake Barker , Rose Nguyen , Björn Sandstone , Nathan Ventura , Colin Wahl

Computing more than one eigenvalue for (large sparse) one-parameter polynomial and general nonlinear eigenproblems, as well as for multiparameter linear and nonlinear eigenproblems, is a much harder task than for standard eigenvalue…

Numerical Analysis · Mathematics 2021-10-19 Michiel E. Hochstenbach , Bor Plestenjak

In this paper, we propose novel algorithms integrated projection-free techniques with accelerated gradient flows to minimize bending energies for nonlinear plates with non-convex metric constraints. We discuss the stability and constraint…

Numerical Analysis · Mathematics 2025-06-18 Guozhi Dong , Hailong Guo , Shuo Yang

Nonlinear variational methods have become very powerful tools for many image processing tasks. Recently a new line of research has emerged, dealing with nonlinear eigenfunctions induced by convex functionals. This has provided new insights…

Computer Vision and Pattern Recognition · Computer Science 2016-09-28 Raz Z. Nossek , Guy Gilboa

Using backpropagation to compute gradients of objective functions for optimization has remained a mainstay of machine learning. Backpropagation, or reverse-mode differentiation, is a special case within the general family of automatic…

Machine Learning · Computer Science 2022-02-18 Atılım Güneş Baydin , Barak A. Pearlmutter , Don Syme , Frank Wood , Philip Torr

Convolutional neural networks (CNNs) have been widely used over many areas in compute vision. Especially in classification. Recently, FlowNet and several works on opti- cal estimation using CNNs shows the potential ability of CNNs in doing…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Junxuan Li

A spectral decomposition method is used to obtain solutions to a class of nonlinear differential equations. We extend this approach to the analysis of the fractional form of these equations and demonstrate the method by applying it to the…

Mathematical Physics · Physics 2015-08-14 Malgorzata Turalska , Bruce J. West

We present the first numerical application of a method that we have recently proposed to solve the Non Perturbative Renormalization Group equations and obtain the n-point functions for arbitrary external momenta. This method leads to flow…

High Energy Physics - Theory · Physics 2008-11-26 Jean-Paul Blaizot , Ramon Mendez-Galain , Nicolas Wschebor

We present a structure-preserving Eulerian algorithm for solving $L^2$-gradient flows and a structure-preserving Lagrangian algorithm for solving generalized diffusions. Both algorithms employ neural networks as tools for spatial…

Numerical Analysis · Mathematics 2024-04-16 Ziqing Hu , Chun Liu , Yiwei Wang , Zhiliang Xu

In this paper we give a description of the asymptotic behavior, as $\epsilon\to 0$, of the $\epsilon$-gradient flow in the finite dimensional case. Under very general assumptions we prove that it converges to an evolution obtained by…

Functional Analysis · Mathematics 2007-05-23 Chiara Zanini

This paper is dedicated to the unique continuation properties of the solutions to nonlinear variational problems. Our analysis covers the case of nonlinear autonomous functionals depending on the gradient, as well as more general double…

Analysis of PDEs · Mathematics 2024-08-02 Lorenzo Ferreri , Luca Spolaor , Bozhidar Velichkov

A recent line of work has shown remarkable behaviors of the generalization error curves in simple learning models. Even the least-squares regression has shown atypical features such as the model-wise double descent, and further works have…

Machine Learning · Statistics 2022-12-20 Antoine Bodin , Nicolas Macris

This paper concerns an extension of discrete gradient methods to finite-dimensional Riemannian manifolds termed discrete Riemannian gradients, and their application to dissipative ordinary differential equations. This includes Riemannian…

Numerical Analysis · Mathematics 2018-10-10 Elena Celledoni , Sølve Eidnes , Brynjulf Owren , Torbjørn Ringholm

Contraction analysis establishes exponential incremental convergence of a nonlinear system by solving a linear matrix inequality for a contraction metric, and has become a standard resource for solving problems in nonlinear control and…

Dynamical Systems · Mathematics 2026-03-03 Winfried Lohmiller , Jean-Jacques Slotine

The flow equation approach investigated by Wegner et al. is applied to an unbounded Hamiltonian system with a generalization. We show that a well-known quantized complex energy eigenvalues which is related to decay widths can be given with…

Quantum Physics · Physics 2009-11-07 Yukiko Ohira , Kentaro Imafuku