Related papers: Improving solution accuracy and convergence for st…
We consider the time discretization of fractional stochastic wave equation with Gaussian noise, which is negatively correlated. Major obstacles to design and analyze time discretization of stochastic wave equation come from the…
We formulate and study a general family of (continuous-time) stochastic dynamics for accelerated first-order minimization of smooth convex functions. Building on an averaging formulation of accelerated mirror descent, we propose a…
Gradient optimization algorithms using epochs, that is those based on stochastic gradient descent without replacement (SGDo), are predominantly used to train machine learning models in practice. However, the mathematical theory of SGDo and…
Optimization problems with the objective function in the form of weighted sum and linear equality constraints are considered. Given that the number of local cost functions can be large as well as the number of constraints, a stochastic…
Stochastic integration \textit{wrt} Gaussian processes has raised strong interest in recent years, motivated in particular by its applications in Internet traffic modeling, biomedicine and finance. The aim of this work is to define and…
A fully discrete approximation of the one-dimensional stochastic heat equation driven by multiplicative space-time white noise is presented. The standard finite difference approximation is used in space and a stochastic exponential method…
The definition and manipulation of Langevin equations with multiplicative white noise require special care (one has to specify the time discretisation and a stochastic chain rule has to be used to perform changes of variables). While…
Stochastic optimization has found wide applications in minimizing objective functions in machine learning, which motivates a lot of theoretical studies to understand its practical success. Most of existing studies focus on the convergence…
Prediction via deterministic continuous-time models will always be subject to model error, for example due to unexplainable phenomena, uncertainties in any data driving the model, or discretisation/resolution issues. In this paper, we build…
We study the foundations of variational inference, which frames posterior inference as an optimisation problem, for probabilistic programming. The dominant approach for optimisation in practice is stochastic gradient descent. In particular,…
In this paper we present a rigorous asymptotic analysis for stochastic systems with two fast relaxation times. The mathematical model analyzed in this paper consists of a Langevin equation for the particle motion with time-dependent force…
Multi-time-scale stochastic approximation is an iterative algorithm for finding the fixed point of a set of $N$ coupled operators given their noisy samples. It has been observed that due to the coupling between the decision variables and…
A parameter estimation problem is considered for a one-dimensional stochastic wave equation driven by additive space-time Gaussian white noise. The estimator is of spectral type and utilizes a finite number of the spatial Fourier…
In this work we adapt a prediction-correction algorithm for continuous time-varying convex optimization problems to solve dynamic programs arising from Model Predictive Control. In particular, the prediction step tracks the evolution of the…
In scheduling problems, deterministic task durations are often assumed. This usually does not capture reality and may lead to schedules that are not robust to (small) changes to these task lengths. The use of stochastic task durations…
The article is devoted to the nonparametric estimation of the quadratic covariation of non-synchronously observed It\^o processes in an additive microstructure noise model. In a high-frequency setting, we aim at establishing an asymptotic…
We study a stochastic optimization problem in which the sampling distribution depends on the decision variable, and the available samples are generated through an iterate-dependent Markov chain. Such settings arise naturally in problems…
The influence of small random perturbations on a deterministic dynamical system with a locally stable equilibrium is considered. The perturbed system is described by the It\^{o} stochastic differential equation. It is assumed that the noise…
We study weighted Tikhonov regularization for large-scale linear discrete ill-posed problems with random noise. Under a polynomial upper-bound assumption on the generalized eigenvalues of the discrete forward operator, we derive stochastic…
Stochastic optimal control, which has the goal of driving the behavior of noisy systems, is broadly applicable in science, engineering and artificial intelligence. Our work introduces Stochastic Optimal Control Matching (SOCM), a novel…