English
Related papers

Related papers: Splitting methods with variable metric for KL func…

200 papers

Theoretical estimates of the convergence rate of many well-known gradient-type optimization methods are based on quadratic interpolation, provided that the Lipschitz condition for the gradient is satisfied. In this article we obtain a…

Optimization and Control · Mathematics 2018-12-18 Fedor S. Stonyakin

In this paper some adaptive mirror descent algorithms for problems of minimization convex objective functional with several convex Lipschitz (generally, non-smooth) functional constraints are considered. It is shown that the methods are…

Optimization and Control · Mathematics 2018-12-20 F. S. Stonyakin , M . S. Alkousa , A. A. Titov

A version of the so-called "convexification" numerical method for a coefficient inverse scattering problem for the 3D Hemholtz equation is developed analytically and tested numerically. Backscattering data are used, which result from a…

Numerical Analysis · Mathematics 2018-01-16 Michael V. Klibanov , Aleksandr E. Kolesov

We propose a subgradient-based method for finding the maximum feasible subsystem in a collection of closed sets with respect to a given closed set $C$ (MFS$_C$). In this method, we reformulate the MFS$_C$ problem as an $\ell_0$ optimization…

Optimization and Control · Mathematics 2018-05-09 Minglu Ye , Ting Kei Pong

We propose a descent subgradient algorithm for minimizing a real function, assumed to be locally Lipschitz, but not necessarily smooth or convex. To find an effective descent direction, the Goldstein subdifferential is approximated through…

Optimization and Control · Mathematics 2023-04-11 Morteza Maleknia , Majid Soleimani-damaneh

The main contribution of this paper is that every convex function with non-empty relative algebraic interior of its domain is Lipschitz and subdifferentiable in some algebraic sense without any additional topological constraints. The…

Optimization and Control · Mathematics 2016-11-09 Dmytro Voloshyn

In this paper we study a second order dynamical system with variable coefficients in connection to the minimization problem of a smooth nonconvex function. The convergence of the trajectories generated by the dynamical system to a critical…

Optimization and Control · Mathematics 2025-10-21 Szilárd Csaba László

We discuss a special form of gradient descent that in the literature has become known as the so-called linearised Bregman iteration. The idea is to replace the classical (squared) two norm metric in the gradient descent setting with a…

Optimization and Control · Mathematics 2016-12-28 Martin Benning , Marta M. Betcke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb

Nonconvex optimization problems arise in many areas of computational science and engineering and are (approximately) solved by a variety of algorithms. Existing algorithms usually only have local convergence or subsequence convergence of…

Optimization and Control · Mathematics 2015-08-21 Yangyang Xu , Wotao Yin

A new numerical method is proposed for a 1-D inverse medium scattering problem with multi-frequency data. This method is based on the construction of a weighted cost functional. The weight is a Carleman Weight Function (CWF). In other…

Numerical Analysis · Mathematics 2017-03-24 Michael V. Klibanov , Aleksandr E. Kolesov , Lam Nguyen , Anders Sullivan

We study first order methods to compute the barycenter of a probability distribution $P$ over the space of probability measures with finite second moment. We develop a framework to derive global rates of convergence for both gradient…

Statistics Theory · Mathematics 2020-06-16 Sinho Chewi , Tyler Maunu , Philippe Rigollet , Austin J. Stromme

In this paper we introduce two novel generalizations of the theory for gradient descent type methods in the proximal setting. First, we introduce the proportion function, which we further use to analyze all known (and many new)…

Optimization and Control · Mathematics 2017-09-12 Dominik Csiba , Peter Richtárik

Fractional Klein-Kramers equation can well describe subdiffusion in phase space. In this paper, we develop the fully discrete scheme for fractional Klein-Kramers equation based on the backward Euler convolution quadrature and local…

Numerical Analysis · Mathematics 2021-12-13 Jing Sun , Daxin Nie , Weihua Deng

We propose a variable metric framework for minimizing the sum of a self-concordant function and a possibly non-smooth convex function, endowed with an easily computable proximal operator. We theoretically establish the convergence of our…

Machine Learning · Statistics 2014-04-15 Quoc Tran-Dinh , Anastasios Kyrillidis , Volkan Cevher

In this paper, we focus on the local convergence rate analysis of the proximal iteratively reweighted $\ell_1$ algorithms for solving $\ell_p$ regularization problems, which are widely applied for inducing sparse solutions. We show that if…

Optimization and Control · Mathematics 2021-01-12 Hao Wang , Hao Zeng , Jiashan Wang

In this paper, we study the global convergence of majorization minimization (MM) algorithms for solving nonconvex regularized optimization problems. MM algorithms have received great attention in machine learning. However, when applied to…

Numerical Analysis · Computer Science 2015-05-01 Yangyang Kang , Zhihua Zhang , Wu-Jun Li

This paper concerns a class of constrained difference-of-convex (DC) optimization problems in which, the constraint functions are continuously differentiable and their gradients are strictly continuous. For such nonconvex and nonsmooth…

Optimization and Control · Mathematics 2025-07-08 Ruyu Liu , Shaohua Pan , Shujun Bi

We introduce a relaxed-projection splitting algorithm for solving variational inequalities in Hilbert spaces for the sum of nonsmooth maximal monotone operators, where the feasible set is defined by a nonlinear and nonsmooth continuous…

Optimization and Control · Mathematics 2015-12-31 J. Y. Bello Cruz , R. Diaz Millan

In this paper, we propose a fast and convergent algorithm to solve unassigned distance geometry problems (uDGP). Technically, we construct a novel quadratic measurement model by leveraging $\ell_0$-norm instead of $\ell_1$-norm in the…

Optimization and Control · Mathematics 2025-10-28 Jun Fan , Xiaoya Shan , Xianchao Xiu

The paper is devoted to new modifications of recently proposed adaptive methods of Mirror Descent for convex minimization problems in the case of several convex functional constraints. Methods for problems of two classes are considered. The…

Optimization and Control · Mathematics 2018-05-29 Fedor S. Stonyakin , Mohammad S. Alkousa , Alexey N. Stepanov , Maxim A. Barinov