English
Related papers

Related papers: A Robbins-Monro type algorithm for computing globa…

200 papers

This paper proposes and develops a new Newton-type algorithm to solve subdifferential inclusions defined by subgradients of extended-real-valued prox-regular functions. The proposed algorithm is formulated in terms of the second-order…

Optimization and Control · Mathematics 2022-09-16 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat

Finding the optimal solution to a complex optimization problem is of great importance in practically all fields of science, technology, technical design and econometrics. We demonstrate that a modified Grover's quantum algorithm can be…

Quantum Physics · Physics 2015-05-13 Jing Zhu , Zhen Huang , Sabre Kais

This paper is devoted to two different two-time-scale stochastic approximation algorithms for superquantile estimation. We shall investigate the asymptotic behavior of a Robbins-Monro estimator and its convexified version. Our main…

Statistics Theory · Mathematics 2020-07-30 Bernard Bercu , Manon Costa , Sébastien Gadat

A new and simple method for quasi-convex optimization is introduced from which its various applications can be derived. Especially, a global optimum under constrains can be approximated for all continuous functions.

Optimization and Control · Mathematics 2020-12-07 Sompong Dhompongsa , Poom Kumam

We develop and analyze the Generalized Multiplicative Gradient (GMG) method for solving a class of convex optimization problems over symmetric cones, where the objective function does not have Lipschitz gradient over the feasible region.…

Optimization and Control · Mathematics 2026-03-06 Renbo Zhao

The motivation of this paper is the development of an optimisation method for solving optimisation problems appearing in Chebyshev rational and generalised rational approximation problems, where the approximations are constructed as ratios…

Optimization and Control · Mathematics 2020-11-06 R. Díaz Millán , Nadezda Sukhorukova , Julien Ugon

We develop a general, functional calculus approach to approximation of $C_0$-semigroups on Banach spaces by bounded completely monotone functions of their generators. The approach comprises most of well-known approximation formulas, yields…

Functional Analysis · Mathematics 2018-07-10 A. Gomilko , S. Kosowicz , Yu. Tomilov

Global optimization problems with a quasi-concave objective function and linear constraints are studied. We point out that various other classes of global optimization problems can be expressed in this way. We present two algorithms, which…

Optimization and Control · Mathematics 2024-01-26 Daniel Ciripoi , Andreas Löhne , Benjamin Weißing

Machine learning algorithms typically perform optimization over a class of non-convex functions. In this work, we provide bounds on the fundamental hardness of identifying the global minimizer of a non convex function. Specifically, we…

Machine Learning · Computer Science 2021-07-07 Krishna Reddy Kesari , Jean Honorio

The aim of this paper is to apply an original computation method due to Malesevic and Makragic [5] to the problem of approximating some trigonometric functions. Inequalities of Wilker-Cusa-Huygens are discussed, but the method can be…

Classical Analysis and ODEs · Mathematics 2019-10-15 Marija Nenezic , Branko Malesevic , Cristinel Mortici

The objective of this work is to propose a new algorithm to fit a sphere on a noisy 3D point cloud distributed around a complete or a truncated sphere. More precisely, we introduce a projected Robbins-Monro algorithm and its averaged…

Statistics Theory · Mathematics 2016-06-15 Antoine Godichon-Baggioni , Bruno Portier

The minimization of a nonconvex composite function can model a variety of imaging tasks. A popular class of algorithms for solving such problems are majorization-minimization techniques which iteratively approximate the composite nonconvex…

Optimization and Control · Mathematics 2018-09-05 Jonas Geiping , Michael Moeller

This work extends the Mond-Pecaric method to functions with multiple operators as arguments by providing arbitrarily close approximations of the original functions. Instead of using linear functions to establish lower and upper bounds for…

Functional Analysis · Mathematics 2024-07-09 Shih-Yu Chang

We propose a generalized formulation of the Huber loss. We show that with a suitable function of choice, specifically the log-exp transform; we can achieve a loss function which combines the desirable properties of both the absolute and the…

Machine Learning · Statistics 2021-08-31 Kaan Gokcesu , Hakan Gokcesu

Given a proper convex lower semicontinuous function defined on a Hilbert space and whose solution set is supposed nonempty. For attaining a global minimizer when this convex function is continuously differentiable, we approach it by a…

Optimization and Control · Mathematics 2024-04-02 A. C. Bagy , Z. Chbani , H. Riahi

We propose an algorithm for general nonlinear conic programming which does not require the knowledge of the full cone, but rather a simpler, more tractable, approximation of it. We prove that the algorithm satisfies a strong global…

Optimization and Control · Mathematics 2025-04-22 Mituhiro Fukuda , Walter Gómez , Gabriel Haeser , Leonardo Makoto Mito

We introduce a new regularization technique, using what we refer to as the Steklov regularization function, and apply this technique to devise an algorithm that computes a global minimizer of univariate coercive functions. First, we show…

Optimization and Control · Mathematics 2018-09-13 Orhan Arıkan , Regina S. Burachik , C. Yalçın Kaya

In this paper, we propose a Robbins-Monro augmented Lagrangian method (RMALM) to solve a class of constrained stochastic convex optimization, which can be regarded as a hybrid of the Robbins-Monro type stochastic approximation method and…

Optimization and Control · Mathematics 2022-09-02 Rui Wang , Chao Ding

The generalized perturbative approach is an all purpose variant of Stein's method used to obtain rates of normal approximation. Originally developed for functions of independent random variables this method is here extended to functions of…

Probability · Mathematics 2020-10-12 Christian Houdré , George Kerchev

We study the smooth structure of convex functions by generalizing a powerful concept so-called self-concordance introduced by Nesterov and Nemirovskii in the early 1990s to a broader class of convex functions, which we call generalized…

Optimization and Control · Mathematics 2018-05-09 Tianxiao Sun , Quoc Tran-Dinh