English
Related papers

Related papers: Convergence analysis for minimum action methods co…

200 papers

We present a new method, called Analysis-of-marginal-Tail-Means (ATM), for effective robust optimization of discrete black-box problems. ATM has important applications to many real-world engineering problems (e.g., manufacturing…

Methodology · Statistics 2018-10-23 Simon Mak , C. F. Jeff Wu

In this paper we consider the convergence analysis of adaptive finite element method for elliptic optimal control problems with pointwise control constraints. We use variational discretization concept to discretize the control variable and…

Numerical Analysis · Mathematics 2016-08-31 Wei Gong , Ningning Yan

The article discusses the gradient discretisation method (GDM) for distributed optimal control problems governed by diffusion equation with pure Neumann boundary condition. Using the GDM framework enables to develop an analysis that…

Numerical Analysis · Mathematics 2018-10-09 Jerome Droniou , Neela Nataraj , Devika Shylaja

Stochastic compositional optimization minimizes objectives of the form $\min_{\bm{x} \in \mathcal{X}} F(\bm{f}(\bm{x}), \bm{x})$, where $\bm{f}$ is accessible only through noisy stochastic queries. Existing methods for this problem assume…

Optimization and Control · Mathematics 2026-05-18 El Mahdi Chayti

We introduce an explicit adaptive Milstein method for stochastic differential equations (SDEs) with no commutativity condition. The drift and diffusion are separately locally Lipschitz and together satisfy a monotone condition. This method…

Numerical Analysis · Mathematics 2022-11-22 Cónall Kelly , Gabriel Lord , Fandi Sun

We develop a fully discrete, semi-implicit mixed finite element method for approximating solutions to a class of fourth-order stochastic partial differential equations (SPDEs) with non-globally Lipschitz and non-monotone nonlinearities,…

Numerical Analysis · Mathematics 2026-02-17 Beniamin Goldys , Agus L. Soenjaya , Thanh Tran

Sharpness-aware minimization (SAM) has been instrumental in improving deep neural network training by minimizing both the training loss and the sharpness of the loss landscape, leading the model into flatter minima that are associated with…

Machine Learning · Computer Science 2024-10-03 Van-Anh Nguyen , Quyen Tran , Tuan Truong , Thanh-Toan Do , Dinh Phung , Trung Le

Federated Learning (FL) enables collaborative model training across decentralized edge devices while preserving data privacy. However, statistical heterogeneity among clients, often manifested as non-IID label distributions, poses…

Machine Learning · Computer Science 2026-01-06 Sameer Rahil , Zain Abdullah Ahmad , Talha Asif

This paper is concerned with fully discrete finite element methods for approximating variational solutions of nonlinear stochastic elastic wave equations with multiplicative noise. A detailed analysis of the properties of the weak solution…

Numerical Analysis · Mathematics 2022-10-04 Xiaobing Feng , Yukun Li , Yujian Lin

We provide a minimax optimal estimation procedure for F and W in matrix valued linear models Y = F W + Z where the parameter matrix W and the design matrix F are unknown but the latter takes values in a known finite set. The proposed finite…

Statistics Theory · Mathematics 2021-02-19 Merle Behr , Axel Munk

We consider the variational problem associated with the Freidlin--Wentzell Large Deviation Principle of the Stochastic Heat Equation (SHE). The logarithm of the minimizer of the variational problem gives the most probable shape of the…

Probability · Mathematics 2022-10-12 Yier Lin , Li-Cheng Tsai

Motivated by problems where the response is needed at select localized regions in a large computational domain, we devise a novel finite element discretization that results in exponential convergence at pre-selected points. The two key…

Numerical Analysis · Mathematics 2016-08-03 Murthy N. Guddati , Vladimir Druskin , Ali Vaziri Astaneh

The solution to empirical risk minimization with $f$-divergence regularization (ERM-$f$DR) is presented under mild conditions on $f$. Under such conditions, the optimal measure is shown to be unique. Examples of the solution for particular…

Machine Learning · Statistics 2024-10-25 Francisco Daunas , Iñaki Esnaola , Samir M. Perlaza , H. Vincent Poor

In this article, we establish the Freidlin-Wentzell type large deviation principle and central limit theorem for stochastic fractional conservation laws with small multiplicative noise in kinetic formulation framework. The weak convergence…

Probability · Mathematics 2023-06-08 Soumya Ranjan Behera , Ananta K. Majee

Modern deep learning models are over-parameterized, where different optima can result in widely varying generalization performance. The Sharpness-Aware Minimization (SAM) technique modifies the fundamental loss function that steers gradient…

Convection-diffusion equations arise in a variety of applications such as particle transport, electromagnetics, and magnetohydrodynamics. Simulation of the convection-dominated regime for these problems, even with high-fidelity techniques,…

Numerical Analysis · Mathematics 2023-05-24 James H. Adler , Casey Cavanaugh , Xiaozhe Hu , Andy Huang , Nathaniel Trask

Although generative diffusion models (GDMs) are widely used in practice, their theoretical foundations remain limited, especially concerning the impact of different discretization schemes applied to the underlying stochastic differential…

Numerical Analysis · Mathematics 2026-01-27 Emanuel Pfarr , Radu Timofte , Frank Werner

The problem of noise covariance matrix identification of stochastic linear time-varying state-space models is addressed. The measurement difference method (MDM) is generalized to time-varying dimensions of the measurement and control. Three…

Signal Processing · Electrical Eng. & Systems 2024-12-11 Oliver Kost , Jindrch Dunik , Ondrej Straka

The numerical approximation of the solution to a stochastic partial differential equation with additive spatial white noise on a bounded domain is considered. The differential operator is assumed to be a fractional power of an integer order…

Numerical Analysis · Mathematics 2018-12-12 David Bolin , Kristin Kirchner , Mihály Kovács

Functional Principal Component Analysis is a reference method for dimension reduction of curve data. Its theoretical properties are now well understood in the simplified case where the sample curves are fully observed without noise.…

Methodology · Statistics 2025-04-28 Ryad Belhakem , Franck Picard , Vincent Rivoirard , Angelina Roche