English
Related papers

Related papers: A Robbins-Monro type algorithm for computing globa…

200 papers

This paper addresses the minimization of a finite sum of prox-convex functions under Lipschitz continuity of each component. We propose two variants of the splitting proximal point algorithms proposed in \cite{Bacak,Bertsekas}: one…

Optimization and Control · Mathematics 2026-01-13 Jose de Brito , Felipe Lara , Tran Van Thang

In the present paper, we consider Stancu type generalization of Baskakov-Sz\'{a}sz operators based on the q-integers and obtain statistical and weighted statistical approximation properties of these operators. Rates of statistical…

Classical Analysis and ODEs · Mathematics 2018-10-19 Vishnu Narayan Mishra , Preeti Sharma Joshi , Lakshmi Narayan Mishra

In this paper we propose a distributed version of a randomized block-coordinate descent method for minimizing the sum of a partially separable smooth convex function and a fully separable non-smooth convex function. Under the assumption of…

Optimization and Control · Mathematics 2015-11-23 Ion Necoara , Dragos Clipici

Parameterized convex minorant (PCM) method is proposed for the approximation of the objective function in amortized optimization. In the proposed method, the objective function approximator is expressed by the sum of a PCM and a nonnegative…

Machine Learning · Computer Science 2023-11-13 Jinrae Kim , Youdan Kim

We propose a new length formula that governs the iterates of the momentum method when minimizing differentiable semialgebraic functions with locally Lipschitz gradients. It enables us to establish local convergence, global convergence, and…

Optimization and Control · Mathematics 2024-01-09 Cédric Josz , Lexiao Lai , Xiaopeng Li

In the present paper, we use a generalised shift operator in order to define a generalised modulus of smoothness. By its means, we define generalised Lipschitz classes of functions, and we give their constructive characteristics.…

Functional Analysis · Mathematics 2014-01-28 Faton M. Berisha , Nimete Sh. Berisha

There exist efficient algorithms to project a point onto the intersection of a convex cone and an affine subspace. Those conic projections are in turn the work-horse of a range of algorithms in conic optimization, having a variety of…

Optimization and Control · Mathematics 2011-03-09 Didier Henrion , Jérôme Malick

The popular BFGS quasi-Newton minimization algorithm under reasonable conditions converges globally on smooth convex functions. This result was proved by Powell in 1976: we consider its implications for functions that are not smooth. In…

Optimization and Control · Mathematics 2017-03-21 Jiayi Guo , Adrian Lewis

We propose a random-subspace algorithmic framework for global optimization of Lipschitz-continuous objectives, and analyse its convergence using novel tools from conic integral geometry. X-REGO randomly projects, in a sequential or…

Optimization and Control · Mathematics 2021-07-28 Coralia Cartis , Estelle Massart , Adilet Otemissov

In this paper, we consider the class of quasiconvex functions and its proper subclass of conic functions. The integer minimization problem of these functions is considered in the paper, assuming that an optimized function is defined by the…

Optimization and Control · Mathematics 2022-11-30 A. Yu. Chirkov , D. V. Gribanov , D. S. Malyshev , P. M. Pardalos , S. I. Veselov , N. Yu. Zolotykh

Assume that f is a strict convex function with a unique minimum in R^n. We divide the vector of n-variables to d groups of vector subvariables with d at least two. We assume that we can find the partial minimum of f with respect to each…

Optimization and Control · Mathematics 2019-06-06 Shmuel Friedland

We seek to approximate a composite function h(x) = g(f(x)) with a global polynomial. The standard approach chooses points x in the domain of f and computes h(x) at each point, which requires an evaluation of f and an evaluation of g. We…

Numerical Analysis · Mathematics 2013-04-09 Paul G. Constantine , Eric T. Phipps

In this paper, we present new second-order algorithms for composite convex optimization, called Contracting-domain Newton methods. These algorithms are affine-invariant and based on global second-order lower approximation for the smooth…

Optimization and Control · Mathematics 2020-12-23 Nikita Doikov , Yurii Nesterov

We generalize the notion of Monk's schema in such a way to integrate finite dimensions. This allows us to lift a plathora of deep results proved for finite dimensions to the infinite dimensional case, like the solution to problem 2.12 in…

Logic · Mathematics 2013-09-04 Tarek Sayed Ahmed

Monotonic convergence is established for a general class of multiplicative algorithms introduced by Silvey, Titterington and Torsney [Comm. Statist. Theory Methods 14 (1978) 1379--1389] for computing optimal designs. A conjecture of…

Computation · Statistics 2010-10-06 Yaming Yu

In the field of global optimization, many existing algorithms face challenges posed by non-convex target functions and high computational complexity or unavailability of gradient information. These limitations, exacerbated by sensitivity to…

Optimization and Control · Mathematics 2023-10-16 Xinyu Zhang , Sujit Ghosh

This paper aims at developing two versions of the generalized Newton method to compute not merely arbitrary local minimizers of nonsmooth optimization problems but just those, which possess an important stability property known as tilt…

Optimization and Control · Mathematics 2021-01-01 Boris Mordukhovich , Ebrahim Sarabi

The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of…

Optimization and Control · Mathematics 2022-03-02 Boris S. Mordukhovich , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

We prove regularity results for the unique minimizer of the total variation functional, currently used in image processing analysis since the work by L. Rudin, S. Osher and E. Fatemi. In particular we show that if the source term $f$ is…

Analysis of PDEs · Mathematics 2019-09-05 Alessio Porretta

The paper proposes and develops new globally convergent algorithms of the generalized damped Newton type for solving important classes of nonsmooth optimization problems. These algorithms are based on the theory and calculations of…

Optimization and Control · Mathematics 2022-01-20 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat , Dat Ba Tran