English
Related papers

Related papers: Randomized derivative-free Milstein algorithm for …

200 papers

We consider the control of semilinear stochastic partial differential equations (SPDEs) via deterministic controls. In the case of multiplicative noise, existence of optimal controls and necessary conditions for optimality are derived. In…

Optimization and Control · Mathematics 2021-10-28 Wilhelm Stannat , Lukas Wessels

Distortion Risk Measures (DRMs) capture risk preferences in decision-making and serve as general criteria for managing uncertainty. This paper proposes gradient descent algorithms for DRM optimization based on two dual representations: the…

Machine Learning · Computer Science 2025-10-07 Jinyang Jiang , Bernd Heidergott , Jiaqiao Hu , Yijie Peng

Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.g., demand or travel times in delivery problems). A common strategy in such cases is…

We consider Galerkin finite element methods for semilinear stochastic partial differential equations (SPDEs) with multiplicative noise and Lipschitz continuous nonlinearities. We analyze the strong error of convergence for spatially…

Numerical Analysis · Mathematics 2014-11-26 Raphael Kruse

We consider the optimization problem of the form $\min_{x \in \mathbb{R}^d} f(x) \triangleq \mathbb{E}_{\xi} [F(x; \xi)]$, where the component $F(x;\xi)$ is $L$-mean-squared Lipschitz but possibly nonconvex and nonsmooth. The recently…

Optimization and Control · Mathematics 2024-05-15 Lesi Chen , Jing Xu , Luo Luo

We introduce a novel class of algorithms to efficiently approximate the unknown return distributions in policy evaluation problems from distributional reinforcement learning (DRL). The proposed distributional dynamic programming algorithms…

Machine Learning · Statistics 2024-07-22 Julian Gerstenberg , Ralph Neininger , Denis Spiegel

This paper aims to investigate the numerical approximation of a general second order parabolic stochastic partial differential equation(SPDE) driven by multiplicative and additive noise. Our main interest is on such SPDEs where the…

Numerical Analysis · Mathematics 2020-11-19 Jean Daniel Mukam , Antoine Tambue

We investigate existence, uniqueness and approximation of solutions to stochastic delay differential equations (SDDEs) under Carath\'eodory-type drift coefficients. Moreover, we also assume that both drift $f=f(t,x,z)$ and diffusion…

Numerical Analysis · Mathematics 2023-06-16 Paweł Przybyłowicz , Yue Wu , Xinheng Xie

Diffusion models have emerged as a powerful framework in generative modeling, typically relying on optimizing neural networks to estimate the score function via forward SDE simulations. In this work, we propose an alternative method that is…

Numerical Analysis · Mathematics 2025-06-17 Yuehaw Khoo , Mathias Oster , Yifan Peng

This paper introduces a drift optimization model of stochastic optimization problems driven by regulated stochastic processes. A broad range of problems across operations research, machine learning, and statistics can be viewed as…

Optimization and Control · Mathematics 2025-06-10 Zihe Zhou , Harsha Honnappa , Raghu Pasupathy

This paper focuses on deriving optimal-order full moment error estimates in strong norms for both velocity and pressure approximations in the Euler-Maruyama time discretization of the stochastic Navier-Stokes equations with multiplicative…

Numerical Analysis · Mathematics 2025-10-10 Xiaobing Feng , Liet Vo

We consider a fully discretized numerical scheme for parabolic stochastic partial differential equations with multiplicative noise. Our abstract framework can be applied to formulate a non-iterative domain decomposition approach. Such…

Numerical Analysis · Mathematics 2024-12-16 Monika Eisenmann , Eskil Hansen , Marvin Jans

We analyze convergence rates of stochastic optimization procedures for non-smooth convex optimization problems. By combining randomized smoothing techniques with accelerated gradient methods, we obtain convergence rates of stochastic…

Optimization and Control · Mathematics 2012-04-10 John C. Duchi , Peter L. Bartlett , Martin J. Wainwright

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

We introduce deterministic perturbation schemes for the recently proposed random directions stochastic approximation (RDSA) [17], and propose new first-order and second-order algorithms. In the latter case, these are the first second-order…

Optimization and Control · Mathematics 2019-03-29 Prashanth L A , Shalabh Bhatnagar , Nirav Bhavsar , Michael Fu , Steven I. Marcus

We propose a scalable divergence estimation method based on hashing. Consider two continuous random variables $X$ and $Y$ whose densities have bounded support. We consider a particular locality sensitive random hashing, and consider the…

Information Theory · Computer Science 2018-01-03 Morteza Noshad , Alfred O. Hero

We consider a discrete version of the Witsenhausen problem where all random variables are bounded and take on integer values. Our main goal is to understand the complexity of computing good strategies given the distributions for the initial…

Optimization and Control · Mathematics 2019-04-12 Alex Olshevsky

A class of implicit Milstein type methods is introduced and analyzed in the present article for stochastic differential equations (SDEs) with non-globally Lipschitz drift and diffusion coefficients. By incorporating a pair of method…

Numerical Analysis · Mathematics 2023-03-21 Xiaojie Wang

This paper studies the problem of differentially private empirical risk minimization (DP-ERM) for binary linear classification. We obtain an efficient $(\varepsilon,\delta)$-DP algorithm with an empirical zero-one risk bound of…

Machine Learning · Computer Science 2025-06-02 Erchi Wang , Yuqing Zhu , Yu-Xiang Wang

Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break the…

Machine Learning · Computer Science 2020-06-11 Quentin Berthet , Mathieu Blondel , Olivier Teboul , Marco Cuturi , Jean-Philippe Vert , Francis Bach