Related papers: Second order linear differential equations with an…
A stochastic second-order trust region method is proposed, which can be viewed as a second-order extension of the trust-region-ish (TRish) algorithm proposed by Curtis et al. (INFORMS J. Optim. 1(3) 200-220, 2019). In each iteration, a…
The aim of this article is to construct solutions to second order in time stochastic partial differential equations and to show hypocoercivity of the corresponding transition semigroups. More generally, we analyze non-linear…
We derive a simple and precise approximation to probability density functions in sampling distributions based on the Fourier cosine series. After clarifying the required conditions, we illustrate the approximation on two examples: the…
We here adapt an extended version of the adaptive cubic regularisation method with dynamic inexact Hessian information for nonconvex optimisation in [3] to the stochastic optimisation setting. While exact function evaluations are still…
In this work, we develop analysis and algorithms for a class of (stochastic) bilevel optimization problems whose lower-level (LL) problem is strongly convex and linearly constrained. Most existing approaches for solving such problems rely…
As is well known, both sampling from the posterior and computing the mean of the posterior in Gaussian process regression reduces to solving a large linear system of equations. We study the use of stochastic gradient descent for solving…
We consider stochastic second-order methods for minimizing smooth and strongly-convex functions under an interpolation condition satisfied by over-parameterized models. Under this condition, we show that the regularized subsampled Newton…
The Frobenius method can be used to compute solutions of ordinary linear differential equations by generalized power series. Each series converges in a circle which at least extends to the nearest singular point; hence exponentially fast…
The aim of this paper is to obtain convergence in mean in the uniform topology of piecewise linear approximations of Stochastic Differential Equations (SDEs) with $C^1$ drift and $C^2$ diffusion coefficients with uniformly bounded…
A random walk-based method is proposed to efficiently compute the solution of a large class of fractional in time linear systems of differential equations (linear F-ODE systems), along with the derivatives with respect to the system…
We analyze convergence rates of stochastic optimization procedures for non-smooth convex optimization problems. By combining randomized smoothing techniques with accelerated gradient methods, we obtain convergence rates of stochastic…
This manuscript is dedicated to the numerical approximation of super-linear slow-fast stochastic differential equations (SFSDEs). Borrowing the heterogeneous multiscale idea, we propose an explicit multiscale Euler-Maruyama scheme suitable…
The work in this paper is four-fold. Firstly, we introduce an alternative approach to solve fractional ordinary differential equations as an expected value of a random time process. Using the latter, we present an interesting numerical…
In the first part of the paper we develop the sensitivity analysis for the nonlinear McKean-Vlasov diffusions stressing precise estimates of growth of solutions and their derivatives with respect to the initial data, under rather general…
This paper is devoted to the study of stochastic optimization problems under the generalized smoothness assumption. By considering the unbiased gradient oracle in Stochastic Gradient Descent, we provide strategies to achieve in bounds the…
In this article a stochastic particle system approximation to the parametric sensitivity in the Smoluchowski coagulation equation is introduced. The parametric sensitivity is the derivative of the solution to the equation with respect to…
Randomized smoothing is a widely adopted technique for optimizing nonsmooth objective functions. However, its efficiency analysis typically relies on global Lipschitz continuity, a condition rarely met in practical applications. To address…
We consider the probabilistic numerical scheme for fully nonlinear PDEs suggested in \cite{cstv}, and show that it can be introduced naturally as a combination of Monte Carlo and finite differences scheme without appealing to the theory of…
The object of this paper is a one-dimensional generalized porous media equation (PDE) with possibly discontinuous coefficient $\beta$, which is well-posed as an evolution problem in $L^1(\mathbb{R})$. In some recent papers of Blanchard et…
This paper studies the existence and global stability of generalized Ornstein-Uhlenbeck process for affine stochastic functional differential equations. Various very basic and important properties are established. In the applications, we…