English
Related papers

Related papers: New iterative algorithms for solving split variati…

200 papers

The proliferation of computing devices has brought about an opportunity to deploy machine learning models on new problem domains using previously inaccessible data. Traditional algorithms for training such models often require data to be…

Recently, Stochastic Variational Inference (SVI) has been increasingly attractive thanks to its ability to find good posterior approximations of probabilistic models. It optimizes the variational objective with stochastic optimization,…

Machine Learning · Computer Science 2022-03-16 Minta Liu , Suliang Bu

In this paper, we introduce and study a stochastic differential variational inequality (SDVI) which consists of a stochastic differential equation and a stochastic variational inequality. We obtain the existence and uniqueness of the…

Optimization and Control · Mathematics 2022-12-19 Yao-Jia Zhang , Tao Chen , Nan-jing Huang , Xue-song Li

Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. However, practitioners are faced with a fragmented literature that offers a bewildering array of algorithmic options. First, the…

Machine Learning · Statistics 2018-11-29 Thang D. Bui , Cuong V. Nguyen , Siddharth Swaroop , Richard E. Turner

In this paper we consider iterative methods for stochastic variational inequalities (s.v.i.) with monotone operators. Our basic assumption is that the operator possesses both smooth and nonsmooth components. Further, only noisy observations…

Optimization and Control · Mathematics 2011-06-01 Anatoli Juditsky , Arkadii S. Nemirovskii , Claire Tauvel

In this paper, we study the strong convergence of an algorithm to solve the variational inequality problem which extends(Thong et al, Numerical Algorithms. 78, 1045-1060 (2018)). We have reduced and refined some of their algorithm's…

Numerical Analysis · Mathematics 2021-05-11 Mostafa Ghadampour , Donal O'Regan , Ebrahim Soori , Ravi. p. Agarwal

Semi-implicit variational inference (SIVI) is introduced to expand the commonly used analytic variational distribution family, by mixing the variational parameter with a flexible distribution. This mixing distribution can assume any density…

Machine Learning · Statistics 2018-05-30 Mingzhang Yin , Mingyuan Zhou

We consider convex-concave saddle-point problems where the objective functions may be split in many components, and extend recent stochastic variance reduction methods (such as SVRG or SAGA) to provide the first large-scale linearly…

Machine Learning · Computer Science 2016-11-04 P Balamurugan , Francis Bach

This paper proposes to solve the Total Variation regularized models by finding the residual between the input and the unknown optimal solution. After analyzing a previous method, we developed a new iterative algorithm, named as Residual…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Yuanhao Gong

Power iteration has been generalized to solve many interesting problems in machine learning and statistics. Despite its striking success, theoretical understanding of when and how such an algorithm enjoys good convergence property is…

Optimization and Control · Mathematics 2020-06-12 Cheolmin Kim , Youngseok Kim , Diego Klabjan

We consider a class of quasi-variational inequalities (QVIs) for adaptive image restoration, where the adaptivity is described via solution-dependent constraint sets. In previous work we studied both theoretical and numerical issues. While…

Optimization and Control · Mathematics 2014-07-04 Frank Lenzen , Jan Lellmann , Florian Becker , Christoph Schnörr

We consider the problem of supervised learning with convex loss functions and propose a new form of iterative regularization based on the subgradient method. Unlike other regularization approaches, in iterative regularization no constraint…

Machine Learning · Statistics 2015-04-02 Junhong Lin , Lorenzo Rosasco , Ding-Xuan Zhou

In this paper, based on the Tikhonov regularization technique, we study a monotone general variational inequality (GVI) by considering an associated strongly monotone GVI, depending on a regularization parameter $\alpha,$ such that the…

Optimization and Control · Mathematics 2025-03-11 Pham Ky Anh , Trinh Ngoc Hai , Nguyen Van Manh

We present Sequential Neural Variational Inference (SNVI), an approach to perform Bayesian inference in models with intractable likelihoods. SNVI combines likelihood-estimation (or likelihood-ratio-estimation) with variational inference to…

Machine Learning · Statistics 2022-10-20 Manuel Glöckler , Michael Deistler , Jakob H. Macke

In the framework of a real Hilbert space we consider the problem of approaching solutions to a class of hierarchical variational inequality problems, subsuming several other problem classes including certain mathematical programs under…

Optimization and Control · Mathematics 2026-01-27 Pavel Dvurechensky , Meggie Marschner , Shimrit Shtern , Mathias Staudigl

In this paper we propose new averaged iterative algorithms designed for solving a split common fixed-point problem in the class of demicontractive mappings. The algorithms are obtained by inserting an averaged term into the algorithms used…

General Mathematics · Mathematics 2024-06-25 Vasile Berinde , Khairul Saleh

Over the past decade, various matrix completion algorithms have been developed. Thresholded singular value decomposition (SVD) is a popular technique in implementing many of them. A sizable number of studies have shown its theoretical and…

Methodology · Statistics 2016-05-10 Juhee Cho , Donggyu Kim , Karl Rohe

In this paper, a novel parallel hybrid iterative method is proposed for finding a common element of the set of solutions of a system of equilibrium problems, the set of solutions of variational inequalities for inverse strongly monotone…

Optimization and Control · Mathematics 2015-10-28 Dang Van Hieu

This paper presents a modified general viscosity iterative process designed to solve variational inclusion and fixed point problems involving multi-valued quasi-nonexpansive and demi-contractive operators. The modified iterative process…

Optimization and Control · Mathematics 2025-01-14 Furmose Mendy , John T Mendy

We consider a class of nonsmooth fractional programming problems with fixed-point constraints, where the numerator is convex and the denominator is concave. To solve this problem, we propose splitting algorithms that compute subgradient…

Optimization and Control · Mathematics 2025-09-03 Mootta Prangprakhon , Nimit Nimana