English
Related papers

Related papers: Optimal Projection Filters

200 papers

In this paper, we propose a novel primal-dual inexact gradient projection method for nonlinear optimization problems with convex-set constraint. This method only needs inexact computation of the projections onto the convex set for each…

Optimization and Control · Mathematics 2019-11-19 Fan Zhang , Hao Wang , Jiashan Wang , Kai Yang

We consider stochastic strongly convex optimization with a complex inequality constraint. This complex inequality constraint may lead to computationally expensive projections in algorithmic iterations of the stochastic gradient…

Machine Learning · Computer Science 2016-05-25 Jianhui Chen , Tianbao Yang , Qihang Lin , Lijun Zhang , Yi Chang

The book is devoted to the strong approximation of iterated stochastic integrals (ISIs) in the context of numerical integration of Ito SDEs and non-commutative semilinear SPDEs with nonlinear multiplicative trace class noise. The monograph…

Probability · Mathematics 2026-05-04 Dmitriy F. Kuznetsov

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

In this paper, we propose a new technique named \textit{Stochastic Path-Integrated Differential EstimatoR} (SPIDER), which can be used to track many deterministic quantities of interest with significantly reduced computational cost. We…

Optimization and Control · Mathematics 2018-10-18 Cong Fang , Chris Junchi Li , Zhouchen Lin , Tong Zhang

This work extends our previous study from S. Shrestha et al. (2024) by introducing a new abstract framework for Variational Multiscale (VMS) methods at the discrete level. We introduce the concept of what we define as the optimal projector…

Numerical Analysis · Mathematics 2025-03-04 Suyash Shrestha , Marc Gerritsma , Gonzalo Rubio , Steven Hulshoff , Esteban Ferrer

We consider the stochastic variational inequality problem in which the map is expectation-valued in a component-wise sense. Much of the available convergence theory and rate statements for stochastic approximation schemes are limited to…

Optimization and Control · Mathematics 2019-11-25 Aswin Kannan , Uday V. Shanbhag

We consider the problem of approximating optimal in the Minimum Mean Squared Error (MMSE) sense nonlinear filters in a discrete time setting, exploiting properties of stochastically convergent state process approximations. More…

Statistics Theory · Mathematics 2016-11-15 Dionysios S. Kalogerias , Athina P. Petropulu

We present two stochastic descent algorithms that apply to unconstrained optimization and are particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained…

Optimization and Control · Mathematics 2019-04-30 David Kozak , Stephen Becker , Alireza Doostan , Luis Tenorio

Least squares (LS) fitting is one of the most fundamental techniques in science and engineering. It is used to estimate parameters from multiple noisy observations. In many problems the parameters are known a-priori to be bounded integer…

Information Theory · Computer Science 2009-01-05 Amir Leshem , Jacob Goldberger

Traditional algorithms for stochastic optimization require projecting the solution at each iteration into a given domain to ensure its feasibility. When facing complex domains, such as positive semi-definite cones, the projection operation…

Machine Learning · Computer Science 2013-04-03 Lijun Zhang , Tianbao Yang , Rong Jin , Xiaofei He

We derive optimal filters on the sphere in the context of detecting compact objects embedded in a stochastic background process. The matched filter and the scale adaptive filter are derived on the sphere in the most general setting,…

Astrophysics · Physics 2011-10-28 J. D. McEwen , M. P. Hobson , A. N. Lasenby

The projection filter is one of the approximations to the solution of the optimal filtering problem. It approximates the filtering density by projecting the dynamics of the square-root filtering density onto the tangent space of the…

Optimization and Control · Mathematics 2025-09-30 Muhammad Fuady Emzir

In this paper, practically computable low-order approximations of potentially high-dimensional differential equations driven by geometric rough paths are proposed and investigated. In particular, equations are studied that cover the linear…

Numerical Analysis · Mathematics 2023-07-03 Martin Redmann , Sebastian Riedel

We extend the result on the spectral projected gradient method by Birgin et al. in 2000 to a log-determinant semidefinite problem (SDP) with linear constraints and propose a spectral projected gradient method for the dual problem. Our…

Optimization and Control · Mathematics 2018-12-04 Takashi Nakagaki , Mituhiro Fukuda , Sunyoung Kim , Makoto Yamashita

A body of recent work has focused on constructing a variational family of filtered distributions using Sequential Monte Carlo (SMC). Inspired by this work, we introduce Particle Smoothing Variational Objectives (SVO), a novel backward…

Machine Learning · Statistics 2019-09-24 Antonio Khalil Moretti , Zizhao Wang , Luhuan Wu , Iddo Drori , Itsik Pe'er

A series of novel filters for probabilistic inference that propose an alternative way of performing Bayesian updates, called particle flow filters, have been attracting recent interest. These filters provide approximate solutions to…

Methodology · Statistics 2017-03-24 Flávio Eler De Melo , Simon Maskell , Matteo Fasiolo , Fred Daum

This paper presents an efficient gradient projection-based method for structural topological optimization problems characterized by a nonlinear objective function which is minimized over a feasible region defined by bilateral bounds and a…

Computational Engineering, Finance, and Science · Computer Science 2020-06-16 Zhi Zeng , Fulei Ma

We introduce a new "subpixel-smoothed projection" (SSP) formulation for differentiable binarization in topology optimization (TopOpt) as a drop-in replacement for previous projection schemes, which suffer from near-non-differentiability and…

A general way of representing Stochastic Differential Equations (SDEs) on smooth manifold is based on Schwartz morphism. In this manuscript we are interested in SDEs on a smooth manifold $M$ that are driven by p-dimensional Wiener process…

Differential Geometry · Mathematics 2023-07-28 Sumit Suthar , Soumyendu Raha