English
Related papers

Related papers: Pathwise approximations for the solution of the no…

200 papers

In this paper we present an inexact zeroth-order method suitable for the solution nonsmooth and nonconvex stochastic composite optimization problems, in which the objective is split into a real-valued Lipschitz continuous stochastic…

Optimization and Control · Mathematics 2025-12-11 Spyridon Pougkakiotis , Dionysis Kalogerias

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

Implicit particle filters for data assimilation generate high-probability samples by representing each particle location as a separate function of a common reference variable. This representation requires that a certain underdetermined…

Numerical Analysis · Mathematics 2015-05-27 Matthias Morzfeld , Xuemin Tu , Ethan Atkins , Alexandre J. Chorin

Various particle filters have been proposed over the last couple of decades with the common feature that the update step is governed by a type of control law. This feature makes them an attractive alternative to traditional sequential Monte…

Optimization and Control · Mathematics 2021-11-18 Sahani Pathiraja , Sebastian Reich , Wilhelm Stannat

We consider the problem of approximating optimal in the Minimum Mean Squared Error (MMSE) sense nonlinear filters in a discrete time setting, exploiting properties of stochastically convergent state process approximations. More…

Statistics Theory · Mathematics 2016-11-15 Dionysios S. Kalogerias , Athina P. Petropulu

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and…

Optimization and Control · Mathematics 2017-10-31 Abhishek Halder , Tryphon T. Georgiou

We present a comprehensive discretization scheme for linear and nonlinear stochastic differential equations (SDEs) driven by either Brownian motions or $\alpha$-stable processes. Our approach utilizes compound Poisson particle…

Probability · Mathematics 2023-07-14 Xicheng Zhang

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

Stochastic approximation techniques have been used in various contexts in data science. We propose a stochastic version of the forward-backward algorithm for minimizing the sum of two convex functions, one of which is not necessarily…

Optimization and Control · Mathematics 2016-02-26 Patrick L. Combettes , Jean-Christophe Pesquet

Path-dependent PDEs (PPDEs) are natural objects to study when one deals with non Markovian models. Recently, after the introduction of the so-called pathwise (or functional or Dupire) calculus (see [15]), in the case of finite-dimensional…

Probability · Mathematics 2017-03-07 Andrea Cosso , Salvatore Federico , Fausto Gozzi , Mauro Rosestolato , Nizar Touzi

We present a novel probabilistic approach for optimal path experimental design. In this approach a discrete path optimization problem is defined on a static navigation mesh, and trajectories are modeled as random variables governed by a…

Optimization and Control · Mathematics 2026-01-19 Ahmed Attia

Some variant of the Frank-Wolfe method for convex optimization problems with adaptive selection of the step parameter corresponding to information about the smoothness of the objective function (the Lipschitz constant of the gradient).…

Optimization and Control · Mathematics 2023-08-01 G. V. Aivazian , F. S. Stonyakin , D. A. Pasechnyuk , M. S. Alkousa , A. M. Raigorodskii

We describe a method for approximating a single-variable function $f$ using persistence diagrams of sublevel sets of $f$ from height functions in different directions. We provide algorithms for the piecewise linear case and for the smooth…

Algebraic Topology · Mathematics 2023-02-10 Aina Ferrà , Carles Casacuberta , Oriol Pujol

In partial differential equations-based (PDE-based) inverse problems with many measurements, many large-scale discretized PDEs must be solved for each evaluation of the misfit or objective function. In the nonlinear case, evaluating the…

Numerical Analysis · Mathematics 2018-07-18 Selin Aslan , Eric de Sturler , Misha E. Kilmer

By approximating posterior distributions with weighted samples, particle filters (PFs) provide an efficient mechanism for solving non-linear sequential state estimation problems. While the effectiveness of particle filters has been…

Machine Learning · Computer Science 2023-12-15 Xiongjie Chen , Yunpeng Li

Dual first-order methods are powerful techniques for large-scale convex optimization. Although an extensive research effort has been devoted to studying their convergence properties, explicit convergence rates for the primal iterates have…

Optimization and Control · Mathematics 2015-02-24 Jie Lu , Mikael Johansson

Multi-stage decision-making under uncertainty, where decisions are taken under sequentially revealing uncertain problem parameters, is often essential to faithfully model managerial problems. Given the significant computational challenges…

Optimization and Control · Mathematics 2026-04-30 Simon Thomä , Maximilian Schiffer , Wolfram Wiesemann

We consider a class of nonconvex nonsmooth optimization problems whose objective is the sum of a smooth function and a finite number of nonnegative proper closed possibly nonsmooth functions (whose proximal mappings are easy to compute),…

Optimization and Control · Mathematics 2018-05-29 Tianxiang Liu , Ting Kei Pong , Akiko Takeda

The discrete-time approximation for nonlinear filtering problems is related to both of strong and weak approximations of stochastic differential equations. In this paper, we propose a new method of proof for the convergence of approximate…

Probability · Mathematics 2014-05-26 Hideyuki Tanaka