English
Related papers

Related papers: Convergence analysis for minimum action methods co…

200 papers

The celebrated minimum residual method (MINRES), proposed in the seminal paper of Paige and Saunders, has seen great success and widespread use in solving Hermitian (and complex-symmetric) linear systems. Unless the system is consistent,…

Numerical Analysis · Mathematics 2025-05-22 Yang Liu , Andre Milzarek , Fred Roosta

We propose some new mixed finite element methods for the time dependent stochastic Stokes equations with multiplicative noise, which use the Helmholtz decomposition of the driving multiplicative noise. It is known [16] that the pressure…

Numerical Analysis · Mathematics 2020-06-09 Xiaobing Feng , Andreas Prohl , Liet Vo

The elliptic Monge-Amp\`ere equation is a fully nonlinear Partial Differential Equation that originated in geometric surface theory and has been applied in dynamic meteorology, elasticity, geometric optics, image processing and image…

Numerical Analysis · Mathematics 2011-06-06 Brittany D. Froese , Adam M. Oberman

We propose and analyse a new type of fully discrete finite element approximation of a class of linear stochastic parabolic evolution equations with additive noise. Our discretization differs from previous ones in that we use a finite…

Numerical Analysis · Mathematics 2025-01-23 Øyvind Stormark Auestad , Geir-Arne Fuglstad , Espen Robstad Jakobsen , Annika Lang

Stochastic differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with random fluctuations, dictated by a diffusion function. The accurate estimation (or discovery)…

Machine Learning · Computer Science 2025-10-22 Patrick Seifner , Kostadin Cvejoski , David Berghaus , Cesar Ojeda , Ramses J. Sanchez

Estimating parameters of drift and diffusion coefficients for multidimensional stochastic delay equations with small noise are considered. The delay structure is written as an integral form with respect to a delay measure. Our contrast…

Statistics Theory · Mathematics 2023-03-21 Hiroki Nemoto , Yasutaka Shimizu

We propose a new method for computing Dynamic Mode Decomposition (DMD) evolution matrices, which we use to analyze dynamical systems. Unlike the majority of existing methods, our approach is based on a variational formulation consisting of…

Numerical Analysis · Mathematics 2019-05-24 Omri Azencot , Wotao Yin , Andrea Bertozzi

This study focuses on solving group zero-norm regularized robust loss minimization problems. We propose a proximal Majorization-Minimization (PMM) algorithm to address a class of equivalent Difference-of-Convex (DC) surrogate optimization…

Optimization and Control · Mathematics 2025-05-30 Ling Liang , Shujun Bi

Sharpness-aware minimization (SAM) has emerged as a highly effective technique to improve model generalization, but its underlying principles are not fully understood. We investigate m-sharpness, where SAM performance improves monotonically…

Machine Learning · Computer Science 2026-04-03 Haocheng Luo , Mehrtash Harandi , Dinh Phung , Trung Le

Numerical approximation of a stochastic partial integro-differential equation driven by a space- time white noise is studied by truncating a series representation of the noise, with finite element method for spatial discretization and…

Numerical Analysis · Mathematics 2017-11-07 Max Gunzburger , Buyang Li , Jilu Wang

In this work and its accompanying Part II [1], we develop an accelerated algorithmic framework, DAMA (Decentralized Accelerated Minimax Approach), for nonconvex Polyak-Lojasiewicz minimax optimization over decentralized multi-agent…

Optimization and Control · Mathematics 2025-12-17 Haoyuan Cai , Sulaiman A. Alghunaim , Ali H. Sayed

Classical stochastic gradient methods are well suited for minimizing expected-value objective functions. However, they do not apply to the minimization of a nonlinear function involving expected values or a composition of two expected-value…

Machine Learning · Statistics 2014-11-17 Mengdi Wang , Ethan X. Fang , Han Liu

Numerical methods: mimetic finite differences and finite elements, are analyzed from a numerical point of view. It seeks to conclude on the efficiency, order of convergence and computational cost of these methods. The analysis is done in…

Numerical Analysis · Mathematics 2015-04-21 Abdul Lugo , Giovanni Calderón

In many industries, including aerospace and defense, waveform analysis is commonly conducted to compute the resonance of physical objects, with the Finite Element Method (FEM) being the standard approach. The Finite Difference Method (FDM)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-09 Juliette Florin

This paper proposes a stochastic gradient descent method with an adaptive Gaussian noise term for the global minimization of nearly convex functions, which are nonconvex and possess multiple strict local minimizers. The noise term,…

Optimization and Control · Mathematics 2025-08-05 Chenglong Bao , Liang Chen , Weizhi Shao

Inverse problems, which involve estimating parameters from incomplete or noisy observations, arise in various fields such as medical imaging, geophysics, and signal processing. These problems are often ill-posed, requiring regularization…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Shadab Ahamed , Eldad Haber

A random walk-based method is proposed to efficiently compute the solution of a large class of fractional in time linear systems of differential equations (linear F-ODE systems), along with the derivatives with respect to the system…

Numerical Analysis · Mathematics 2024-08-09 Andrés Centeno , Juan A. Acebrón , José Monteiro

In this paper, the solution to the empirical risk minimization problem with $f$-divergence regularization (ERM-$f$DR) is presented and conditions under which the solution also serves as the solution to the minimization of the expected…

Machine Learning · Statistics 2026-01-21 Francisco Daunas , Iñaki Esnaola , Samir M. Perlaza , H. Vincent Poor

We study the asymptotics of a two-dimensional stochastic differential system with a degenerate diffusion matrix. This system describes the dynamics of a population where individuals contribute to the degradation of their environment through…

Dynamical Systems · Mathematics 2024-05-06 Pierre Collet , Claire Ecotière , Sylvie Méléard

In this paper, we prove that an Adam-type algorithm with smooth clipping approaches the global minimizer of the regularized non-convex loss function. Adding smooth clipping and taking the state space as the set of all trajectories, we can…

Machine Learning · Computer Science 2023-12-06 Keisuke Suzuki