English
Related papers

Related papers: A note on the hybrid steepest descent methods

200 papers

The cyclic block coordinate descent-type (CBCD-type) methods, which performs iterative updates for a few coordinates (a block) simultaneously throughout the procedure, have shown remarkable computational performance for solving strongly…

Optimization and Control · Mathematics 2017-11-23 Xingguo Li , Tuo Zhao , Raman Arora , Han Liu , Mingyi Hong

In this paper, we propose two parallel extragradient - viscosity methods for finding a particular element in the common solution set of a system of equilibrium problems and finitely many fixed point problems. This particular point is the…

Optimization and Control · Mathematics 2016-03-08 Dang Van Hieu

In this paper, we introduce a system of split variational inequality problems in real Hilbert spaces. Using projection method, we propose an iterative algorithm for the system of split variational inequality problems. Further, we prove that…

Functional Analysis · Mathematics 2014-08-19 Kaleem Raza Kazmi

This work is devoted to the development and analysis of a linearization algorithm for microscopic elliptic equations, with scaled degenerate production, posed in a perforated medium and constrained by the homogeneous Neumann-Dirichlet…

Numerical Analysis · Mathematics 2020-08-11 Anh-Khoa Vo , Ekeoma Rowland Ijioma , Nhu-Ngoc Nguyen

In this paper, we introduce a novel family of iterative algorithms which carry out $\alpha$-divergence minimisation in a Variational Inference context. They do so by ensuring a systematic decrease at each step in the $\alpha$-divergence…

Computation · Statistics 2023-04-12 Kamélia Daudel , Randal Douc , François Roueff

The breakthrough ideas in the modern proximal splitting methodologies allow us to express the set of all minimizers of a superposition of multiple nonsmooth convex functions as the fixed point set of computable nonexpansive operators. In…

Optimization and Control · Mathematics 2022-07-01 Isao Yamada , Masao Yamagishi

In this paper we present the proximal point method for a special class of nonconvex function on a Hadamard manifold. The well definedness of the sequence generated by the proximal point method is guaranteed. Moreover, it is proved that each…

Optimization and Control · Mathematics 2010-04-14 G. C. Bento , O. P. Ferreira , P. R. Oliveira

The iterative absorption method has recently led to major progress in the area of (hyper-)graph decompositions. Amongst other results, a new proof of the Existence conjecture for combinatorial designs, and some generalizations, was…

Combinatorics · Mathematics 2020-03-02 Ben Barber , Stefan Glock , Daniela Kühn , Allan Lo , Richard Montgomery , Deryk Osthus

The objective of this paper is to prove the convergence of a linear implicit multi-step numerical method for ordinary differential equations. The algorithm is obtained via Taylor approximations. The convergence is proved following the…

Chaotic Dynamics · Physics 2011-03-08 Marius-F. Danca

Local convergence analysis of the proximal point method for special class of nonconvex function on Hadamard manifold is presented in this paper. The well definedness of the sequence generated by the proximal point method is guaranteed.…

Optimization and Control · Mathematics 2010-04-13 G. C. Bento , O. P. Ferreira , P. R. Oliveira

The purpose of this paper is to introduce a new Kirk type iterative algorithm called Kirk multistep iteration and to study its convergence. We also prove some theorems related with the stability results for the Kirk-multistep and Kirk-SP…

Functional Analysis · Mathematics 2013-06-11 Faik Gürsoy , Vatan Karakaya , B. E. Rhoades

Subgradient methods are the natural extension to the non-smooth case of the classical gradient descent for regular convex optimization problems. However, in general, they are characterized by slow convergence rates, and they require…

Optimization and Control · Mathematics 2023-11-20 Alessandro Scagliotti , Piero Colli Franzone

This work considers stepsize schedules for gradient descent on smooth convex objectives. We extend the existing literature and propose a unified technique for constructing stepsizes with analytic bounds for an arbitrary number of…

Optimization and Control · Mathematics 2026-02-17 Zehao Zhang , Rujun Jiang

The use of M-estimators in generalized linear regression models in high dimensional settings requires risk minimization with hard $L_0$ constraints. Of the known methods, the class of projected gradient descent (also known as iterative hard…

Machine Learning · Computer Science 2014-10-22 Prateek Jain , Ambuj Tewari , Purushottam Kar

In this paper, first we introduce a new mapping for finding a common fixed point of an infinite family of nonexpansive mappings then we consider iterative method for finding a common element of the set of fixed points of an infinite family…

Functional Analysis · Mathematics 2015-02-18 Vahid Darvish , S. M. Vaezpour

In this paper a novel hybrid approach for compensating the distortion of any interpolation has been proposed. In this hybrid method, a modular approach was incorporated in an iterative fashion. By using this approach we can get drastic…

Multimedia · Computer Science 2010-09-21 A. ParandehGheibi , M. A. Akhaee , A. Ayremlou , M. A. Rahimian , F. Marvasti

Nonmonotone gradient methods generally perform better than their monotone counterparts especially on unconstrained quadratic optimization. However, the known convergence rate of the monotone method is often much better than its nonmonotone…

Optimization and Control · Mathematics 2023-02-07 Xinrui Li , Yakui Huang

In this paper, we establish new convergence results for the quantized distributed gradient descent and suggest a novel strategy of choosing the stepsizes for the high-performance of the algorithm. Under the strongly convexity assumption on…

Optimization and Control · Mathematics 2023-07-03 Woocheol Choi , Myeong-Su Lee

For a class of stationary regularly varying and weakly dependent time series, we prove the so-called complete convergence result for the corresponding space-time point processes. As an application of our main theorem, we give a simple proof…

Probability · Mathematics 2019-07-17 Bojan Basrak , Azra Tafro

The exponential trapezoidal rule is proposed and analyzed for the numerical integration of semilinear integro-differential equations. Although the method is implicit, the numerical solution is easily obtained by standard fixed-point…

Numerical Analysis · Mathematics 2024-03-12 Alexander Ostermann , Nasrin Vaisi