English
Related papers

Related papers: Convergence Rate Analysis for Fixed-Point Iteratio…

200 papers

Anomaly detection plays in many fields of research, along with the strongly related task of outlier detection, a very important role. Especially within the context of the automated analysis of video material recorded by surveillance…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Thomas Golda , Nils Murzyn , Chengchao Qu , Kristian Kroschel

Two optimization algorithms are proposed for solving a stochastic programming problem for which the objective function is given in the form of the expectation of convex functions and the constraint set is defined by the intersection of…

Optimization and Control · Mathematics 2017-10-09 Hideaki Iiduka

Generative Adversarial Networks (GANs) are powerful Machine Learning models capable of generating fully synthetic samples of a desired phenomenon with a high resolution. Despite their success, the training process of a GAN is highly…

Machine Learning · Computer Science 2022-09-07 Ángel González-Prieto , Alberto Mozo , Edgar Talavera , Sandra Gómez-Canaval

This paper proposes an algorithm for solving structured optimization problems, which covers both the backward-backward and the Douglas-Rachford algorithms as special cases, and analyzes its convergence. The set of fixed points of the…

Optimization and Control · Mathematics 2017-09-19 Nguyen Hieu Thao

We develop fixed-point algorithms for the approximation of structured matrices with rank penalties. In particular we use these fixed-point algorithms for making approximations by sums of exponentials, or frequency estimation. For the basic…

Numerical Analysis · Mathematics 2016-01-07 Fredrik Andersson , Marcus Carlsson

String-averaging is an algorithmic structure used when handling a family of operators in situations where the algorithm at hand requires to employ the operators in a specific order. Sequential orderings are well-known and a simultaneous…

Functional Analysis · Mathematics 2021-03-17 Yair Censor , Ariel Nisenbaum

Many popular first order algorithms for convex optimization, such as forward-backward splitting, Douglas-Rachford splitting, and the alternating direction method of multipliers (ADMM), can be formulated as averaged iteration of a…

Optimization and Control · Mathematics 2016-06-28 Pontus Giselsson , Mattias Fält , Stephen Boyd

This paper considers time-average optimization, where a decision vector is chosen every time step within a (possibly non-convex) set, and the goal is to minimize a convex function of the time averages subject to convex constraints on these…

Optimization and Control · Mathematics 2016-10-11 Sucha Supittayapornpong , Longbo Huang , Michael J. Neely

Generative Adversarial Networks (GAN) can achieve promising performance on learning complex data distributions on different types of data. In this paper, we first show a straightforward extension of existing GAN algorithm is not applicable…

Machine Learning · Computer Science 2018-10-16 Chun-Liang Li , Manzil Zaheer , Yang Zhang , Barnabas Poczos , Ruslan Salakhutdinov

We introduce a generalized forward-backward splitting method with penalty term for solving monotone inclusion problems involving the sum of a finite number of maximally monotone operators and the normal cone to the nonempty set of zeros of…

Optimization and Control · Mathematics 2018-07-31 Nimit Nimana , Narin Petrot

In this article a unified approach to iterative soft-thresholding algorithms for the solution of linear operator equations in infinite dimensional Hilbert spaces is presented. We formulate the algorithm in the framework of generalized…

Functional Analysis · Mathematics 2010-10-26 Kristian Bredies , Dirk A. Lorenz

Generative adversarial networks (GANs) are a novel approach to generative modelling, a task whose goal it is to learn a distribution of real data points. They have often proved difficult to train: GANs are unlike many techniques in machine…

Machine Learning · Computer Science 2018-07-02 Samuel A. Barnett

We study the convergence of random function iterations for finding an invariant measure of the corresponding Markov operator. We call the problem of finding such an invariant measure the stochastic fixed point problem. This generalizes…

Functional Analysis · Mathematics 2022-03-24 Neal Hermer , D. Russell Luke , Anja Sturm

We present a continual learning approach for generative adversarial networks (GANs), by designing and leveraging parameter-efficient feature map transformations. Our approach is based on learning a set of global and task-specific…

Machine Learning · Computer Science 2021-08-02 Sakshi Varshney , Vinay Kumar Verma , Srijith P K , Lawrence Carin , Piyush Rai

Since its invention, Generative adversarial networks (GANs) have shown outstanding results in many applications. Generative Adversarial Networks are powerful yet, resource-hungry deep-learning models. Their main difference from ordinary…

Machine Learning · Computer Science 2021-08-17 Dina Tantawy , Mohamed Zahran , Amr Wassal

Generative Adversarial Network (GAN) is a current focal point of research. The body of knowledge is fragmented, leading to a trial-error method while selecting an appropriate GAN for a given scenario. We provide a comprehensive summary of…

Machine Learning · Computer Science 2021-05-18 Tanya Motwani , Manojkumar Parmar

This paper provides a fixed point theorem and iterative construction of a common fixed point for a general class of nonlinear mappings in the setup of uniformly convex hyperbolic spaces. We translate a multi-step iteration, essentially due…

Functional Analysis · Mathematics 2013-12-23 Hafiz Fukhar-ud-din , Amna Kalsoom , Muhammad Aqeel Ahmad Khan

We study the convergence of the Augmented Decomposition Algorithm (ADA) proposed in [32] for solving multi-block separable convex minimization problems subject to linear constraints. We show that the global convergence rate of the exact ADA…

Optimization and Control · Mathematics 2018-08-28 Hongsheng Liu , Shu Lu

Nonconvex optimization problems arise in many areas of computational science and engineering and are (approximately) solved by a variety of algorithms. Existing algorithms usually only have local convergence or subsequence convergence of…

Optimization and Control · Mathematics 2015-08-21 Yangyang Xu , Wotao Yin

We propose an adaptive way to choose the anchoring parameters for the Halpern iteration to find a fixed point of a nonexpansive mapping in a real Hilbert space. We prove strong convergence of this adaptive Halpern iteration and obtain the…

Optimization and Control · Mathematics 2025-05-19 Songnian He , Hong-Kun Xu , Qiao-Li Dong , Na Mei