English
Related papers

Related papers: Fixed-point iterative algorithm for SVI model

200 papers

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

In this paper, we consider the stochastic iterative counterpart of the value iteration scheme wherein only noisy and possibly biased approximations of the Bellman operator are available. We call this counterpart as the approximate value…

Systems and Control · Computer Science 2021-06-01 Arunselvan Ramaswamy , Shalabh Bhatnagar

In this paper, we develop a stochastic set-valued optimization (SVO) framework tailored for robust machine learning. In the SVO setting, each decision variable is mapped to a set of objective values, and optimality is defined via set…

Optimization and Control · Mathematics 2026-03-19 Tommaso Giovannelli , Jingfu Tan , Luis Nunes Vicente

In this paper we consider iterative methods for stochastic variational inequalities (s.v.i.) with monotone operators. Our basic assumption is that the operator possesses both smooth and nonsmooth components. Further, only noisy observations…

Optimization and Control · Mathematics 2011-06-01 Anatoli Juditsky , Arkadii S. Nemirovskii , Claire Tauvel

Iterative solvers are frequently used in scientific applications and engineering computations. However, the memory-bound Sparse Matrix-Vector (SpMV) kernel computation hinders the efficiency of iterative algorithms. As modern hardware…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-08 Jianhua Gao , Jiayuan Shen , Yuxiang Zhang , Weixing Ji , Hua Huang

Most algorithms for solving optimization problems or finding saddle points of convex-concave functions are fixed-point algorithms. In this work we consider the generic problem of finding a fixed point of an average of operators, or an…

Machine Learning · Computer Science 2020-06-17 Grigory Malinovsky , Dmitry Kovalev , Elnur Gasanov , Laurent Condat , Peter Richtárik

Adaptive optimal control using value iteration (VI) initiated from a stabilizing policy is theoretically analyzed in various aspects including the continuity of the result, the stability of the system operated using any single/constant…

Systems and Control · Computer Science 2015-05-18 Ali Heydari

We propose a new financial model, the stochastic volatility model with sticky drawdown and drawup processes (SVSDU model), which enables us to capture the features of winning and losing streaks that are common across financial markets but…

Mathematical Finance · Quantitative Finance 2025-03-20 Yuhao Liu , Pingping Jiang , Gongqiu Zhang

In this paper, we develop stochastic variance reduced algorithms for solving a class of finite-sum hemivariational inequality (HVI) problem. In this HVI problem, the associated function is assumed to be differentiable, and both the vector…

Optimization and Control · Mathematics 2025-09-12 Kevin Huang , Nuozhou Wang , Shuzhong Zhang

The recognition network in deep latent variable models such as variational autoencoders (VAEs) relies on amortized inference for efficient posterior approximation that can scale up to large datasets. However, this technique has also been…

Machine Learning · Statistics 2019-02-28 Rui Shu , Hung H. Bui , Jay Whang , Stefano Ermon

We introduce a new class of local volatility models. Within this framework, we obtain expressions for both (i) the price of any European option and (ii) the induced implied volatility smile. As an illustration of our framework, we perform…

Computational Finance · Quantitative Finance 2012-11-12 Matthew Lorig

Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. However, practitioners are faced with a fragmented literature that offers a bewildering array of algorithmic options. First, the…

Machine Learning · Statistics 2018-11-29 Thang D. Bui , Cuong V. Nguyen , Siddharth Swaroop , Richard E. Turner

This paper introduces unified models for high-dimensional factor-based Ito process, which can accommodate both continuous-time Ito diffusion and discrete-time stochastic volatility (SV) models by embedding the discrete SV model in the…

Methodology · Statistics 2020-06-23 Donggyu Kim , Xinyu Song , Yazhen Wang

We exploit the observation that stochastic variational inference (SVI) is a form of annealing and present a modified SVI approach -- applicable to both large and small datasets -- that allows the amount of annealing done by SVI to be tuned.…

Machine Learning · Computer Science 2025-11-17 John Paisley , Ghazal Fazelnia , Brian Barr

This paper focuses on non-monotone stochastic variational inequalities (SVIs) that may not have a unique solution. A commonly used efficient algorithm to solve VIs is the Popov method, which is known to have the optimal convergence rate for…

Optimization and Control · Mathematics 2025-10-17 Daniil Vankov , Angelia Nedich , Lalitha Sankar

In this paper, we prove that convergence of a new iteration and S-iteration can be used to approximate to the fixed points of contractive-like operators. We also prove some data dependence results of this new iteration and S-iteration…

Functional Analysis · Mathematics 2012-12-19 Faik Gursoy , Vatan Karakaya , Billy E. Rhoades

Stein variational inference (SVI) is a sample-based approximate Bayesian inference technique that generates a sample set by jointly optimizing the samples' locations to minimize an information-theoretic measure of discrepancy with the…

Machine Learning · Computer Science 2024-10-22 Liam Pavlovic , David M. Rosen

Iterative refinement (IR) is a popular scheme for solving a linear system of equations based on gradually improving the accuracy of an initial approximation. Originally developed to improve upon the accuracy of Gaussian elimination,…

Numerical Analysis · Mathematics 2025-06-24 Chai Wah Wu , Mark S. Squillante , Vasileios Kalantzis , Lior Horesh

In this work, we design a machine learning based method, online adaptive primal support vector regression (SVR), to model the implied volatility surface (IVS). The algorithm proposed is the first derivation and implementation of an online…

Machine Learning · Statistics 2018-06-08 Yaxiong Zeng , Diego Klabjan

The core principle of Variational Inference (VI) is to convert the statistical inference problem of computing complex posterior probability densities into a tractable optimization problem. This property enables VI to be faster than several…

Machine Learning · Computer Science 2023-10-25 Ankush Ganguly , Sanjana Jain , Ukrit Watchareeruetai