English
Related papers

Related papers: On Opial's Lemma

200 papers

This work focuses on convergence analysis of the projected gradient method for solving constrained convex minimization problem in Hilbert spaces. We show that the sequence of points generated by the method employing the Armijo linesearch…

Optimization and Control · Mathematics 2015-08-10 Jose Yunier Bello Cruz , Welington de Oliveira

We deal with the random combinatorial structures called assemblies. By weakening the logarithmic condition which assures regularity of the number of components of a given order, we extend the notion of logarithmic assemblies. Using the…

Probability · Mathematics 2009-03-06 Eugenijus Manstavičius

In this paper we define the closure under weak convergence of the class of p-tempered {\alpha}-stable distributions. We give necessary and sufficient conditions for convergence of sequences in this class. Moreover, we show that any element…

Probability · Mathematics 2013-06-11 Michael Grabchak

We provide in a unified way quantitative forms of strong convergence results for numerous iterative procedures which satisfy a general type of Fejer monotonicity where the convergence uses the compactness of the underlying set. These…

Logic · Mathematics 2015-08-25 Ulrick Kohlenbach , Laurentiu Leustean , Adriana Nicolae

This paper is concerned with the performance of Orthogonal Matching Pursuit (OMP) algorithms applied to a dictionary $\mathcal{D}$ in a Hilbert space $\mathcal{H}$. Given an element $f\in \mathcal{H}$, OMP generates a sequence of…

Numerical Analysis · Mathematics 2015-06-17 Albert Cohen , Wolfgang Dahmen , Ronald DeVore

Fixed point iterations are a fundamental tool in numerical analysis and scientific computing for the approximation of solutions to nonlinear problems. Their convergence is often established via the Banach fixed point theorem, provided that…

Numerical Analysis · Mathematics 2026-04-29 Thomas P. Wihler

Divergences are quantities that measure discrepancy between two probability distributions and play an important role in various fields such as statistics and machine learning. Divergences are non-negative and are equal to zero if and only…

Statistics Theory · Mathematics 2019-10-22 Tomohiro Nishiyama

Fekete's lemma is a well known result from combinatorial mathematics that shows the existence of a limit value related to super- and subadditive sequences of real numbers. In this paper, we analyze Fekete's lemma in view of the arithmetical…

Information Theory · Computer Science 2024-09-02 Holger Boche , Yannik Böck , Christian Deppe

Some limit theorems of the type $\int_{\Omega}f_n dm_n -- --> \int_{\Omega}f dm$ are presented for scalar, (vector), (multi)-valued sequences of m_n-integrable functions f_n. The convergences obtained, in the vector and multivalued…

Functional Analysis · Mathematics 2025-01-14 Luisa Di Piazza , Valeria Marraffa , Kazimierz Musial , Anna Rita Sambucini

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

Ou et al. (2022) introduce the problem of learning set functions from data generated by a so-called optimal subset oracle. Their approach approximates the underlying utility function with an energy-based model, whose parameters are…

Machine Learning · Computer Science 2024-12-18 Gözde Özcan , Chengzhi Shi , Stratis Ioannidis

Recently, we systematically studied the basic theory of Bregman circumcenters in another paper. In this work, we aim to apply Bregman circumcenters to optimization algorithms. Here, we propose the forward Bregman monotonicity which is a…

Optimization and Control · Mathematics 2022-03-29 Hui Ouyang

The Doob-Dynkin Lemma gives conditions on two functions $X$ and $Y$ that ensure existence of a function ${\phi}$ so that $X = {\phi} \circ Y$. This communication proves different versions of the Doob-Dynkin Lemma, and shows how it is…

Statistics Theory · Mathematics 2018-01-04 Gunnar Taraldsen

Summation methods play a very important role in quantum field theory because all perturbation series are divergent and the expansion parameter is not always small. A number of methods have been tried in this context, most notably Pade…

Mathematical Physics · Physics 2010-01-06 Jean Zinn-Justin

Typically, the sequence of points generated by an optimization algorithm may have multiple limit points. Under convexity assumptions, however, (sub)gradient methods are known to generate a convergent sequence of points. In this paper, we…

Optimization and Control · Mathematics 2025-06-16 Andrea Cristofari

We study sequences of functions of the form F_p^n -> {0,1} for varying n, and define a notion of convergence based on the induced distributions from restricting the functions to a random affine subspace. Using a decomposition theorem and a…

Combinatorics · Mathematics 2013-08-20 Hamed Hatami , Pooya Hatami , James Hirst

We give a sharpened form of Siegel Lemma's w. r. t. the maximum norm. This implies a new lower bound on the greatest element of a sum-distinct set of positive integers (Erd\"os-Moser problem). The main tools are Minkowski's theorem on…

Number Theory · Mathematics 2007-05-23 Iskander Aliev

Optimization problems, generalized equations, and the multitude of other variational problems invariably lead to the analysis of sets and set-valued mappings as well as their approximations. We review the central concept of set-convergence…

Optimization and Control · Mathematics 2020-02-25 Johannes O. Royset

We consider the problem of approximating a given element $f$ from a Hilbert space $\mathcal{H}$ by means of greedy algorithms and the application of such procedures to the regression problem in statistical learning theory. We improve on the…

Statistics Theory · Mathematics 2009-09-29 Andrew R. Barron , Albert Cohen , Wolfgang Dahmen , Ronald A. DeVore

The third-order Jeffery-Hamel ODE governing the flow of an incompressible fluid in a two-dimensional wedge is briefly derived, and a C^1 finite element formulation of the equation is developed. This formulation has several advantages,…

Numerical Analysis · Mathematics 2016-12-20 John W. Peterson , Roy H. Stogner