English
Related papers

Related papers: The regularizing properties of multistep methods f…

200 papers

We consider a class of semilinear Volterra type stochastic evolution equation driven by multiplicative Gaussian noise. The memory kernel, not necessarily analytic, is such that the deterministic linear equation exhibits a parabolic…

Probability · Mathematics 2016-02-25 Boris Baeumer , Matthias Geissert , Mihaly Kovacs

The existence of strong solutions and pathwise uniqueness are established for one-dimensional stochastic Volterra equations with locally H{\"o}lder continuous diffusion coefficients and sufficiently regular kernels. Moreover, we study the…

Probability · Mathematics 2023-06-02 David J. Prömel , David Scheffels

In this paper, we are interested in comparing solutions to stochastic Volterra equations for the convex order on the space of continuous $\R^d$-valued paths and for the monotonic convex order when $d=1$. Even if in general these solutions…

Probability · Mathematics 2022-11-21 Benjamin Jourdain , Gilles Pagès

Neural Networks have been widely used to solve Partial Differential Equations. These methods require to approximate definite integrals using quadrature rules. Here, we illustrate via 1D numerical examples the quadrature problems that may…

Numerical Analysis · Mathematics 2022-03-09 Jon A. Rivera , Jamie M. Taylor , Ángel J. Omella , David Pardo

This study aims to discuss the existence and uniqueness of solution of fuzzy Volterra integral equation with piecewise continuous kernel. Such problems appears in many balance problems for hereditary dynamic systems, e.g. in electric load…

General Mathematics · Mathematics 2024-01-18 Samad Noeiaghdam , Aliona I. Dreglea , Denis N. Sidorov

We study iterative regularization for linear models, when the bias is convex but not necessarily strongly convex. We characterize the stability properties of a primal-dual gradient based approach, analyzing its convergence in the presence…

Machine Learning · Statistics 2020-10-30 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

We analyze the learning properties of the stochastic gradient method when multiple passes over the data and mini-batches are allowed. We study how regularization properties are controlled by the step-size, the number of passes and the…

Machine Learning · Computer Science 2019-03-18 Junhong Lin , Lorenzo Rosasco

This paper studies multistep methods for the integration of reversible dynamical systems, with particular emphasis on the planar Kepler problem. It has previously been shown by Cano & Sanz-Serna that reversible linear multisteps for…

Astrophysics · Physics 2009-10-31 Wyn Evans , Scott Tremaine

Adaptive cubic regularization methods have emerged as a credible alternative to linesearch and trust-region for smooth nonconvex optimization, with optimal complexity amongst second-order methods. Here we consider a general/new class of…

Optimization and Control · Mathematics 2018-11-20 Coralia Cartis , Nicholas I. M. Gould , Philippe L. Toint

Stochastic gradient descent is one of the most successful approaches for solving large-scale problems, especially in machine learning and statistics. At each iteration, it employs an unbiased estimator of the full gradient computed from one…

Numerical Analysis · Mathematics 2018-12-05 Bangti Jin , Xiliang Lu

We construct the basis of a stochastic calculus for so-called Volterra processes, i.e., processes which are defined as the stochastic integral of a time-dependent kernel with respect to a standard Brownian motion. For these processes which…

Probability · Mathematics 2007-05-23 L. Decreusefond

In this text matrix Volterra integral equation of the first kind is addressed. It is assumed that kernels of the equation have jump discontinuities on non-intersecting curves. Such equations appear in the theory of evolving dynamic systems.…

Dynamical Systems · Mathematics 2012-09-03 Denis Sidorov

There is growing body of learning problems for which it is natural to organize the parameters into matrix, so as to appropriately regularize the parameters under some matrix norm (in order to impose some more sophisticated prior knowledge).…

Machine Learning · Computer Science 2010-10-19 Sham M. Kakade , Shai Shalev-Shwartz , Ambuj Tewari

We study in this paper the monotonicity properties of the numerical solutions to Volterra integral equations with nonincreasing completely positive kernels on nonuniform meshes. There is a duality between the complete positivity and the…

Numerical Analysis · Mathematics 2023-10-04 Yuanyuan Feng , Lei Li

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

In this paper, nonstandard multistep methods are considered. It is shown that under some (sufficient and necessary) conditions, these methods attain the same order as their standard counterparts - to prove this statement, a nonstandard…

Numerical Analysis · Mathematics 2026-01-19 Bálint Takács

In this paper, we suggest a new framework for analyzing primal subgradient methods for nonsmooth convex optimization problems. We show that the classical step-size rules, based on normalization of subgradient, or on the knowledge of optimal…

Optimization and Control · Mathematics 2023-11-27 Yurii Nesterov

Recently, an approach known as relaxation has been developed for preserving the correct evolution of a functional in the numerical solution of initial-value problems, using Runge-Kutta methods. We generalize this approach to multistep…

Numerical Analysis · Mathematics 2020-11-26 Hendrik Ranocha , Lajos Lóczi , David I. Ketcheson

For a wide variety of regularization methods, algorithms computing the entire solution path have been developed recently. Solution path algorithms do not only compute the solution for one particular value of the regularization parameter but…

Machine Learning · Computer Science 2009-03-30 Bernd Gärtner , Joachim Giesen , Martin Jaggi , Torsten Welsch

Solutions of partial differential equations can often be written as surface integrals having a kernel related to a singular fundamental solution. Special methods are needed to evaluate the integral accurately at points on or near the…

Numerical Analysis · Mathematics 2025-10-16 J. Thomas Beale , Svetlana Tlupova