English
Related papers

Related papers: Sum decomposition of divergence into three diverge…

200 papers

We propose an extension of a special form of gradient descent -- in the literature known as linearised Bregman iteration -- to a larger class of non-convex functions. We replace the classical (squared) two norm metric in the gradient…

Optimization and Control · Mathematics 2021-05-26 Martin Benning , Marta M. Betcke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb

Here we examine some connections between the notions of generalized arithmetic means, geodesics, Lagrange-Hamilton dynamics and Bregman divergences. In a previous paper we developed a predictive interpretation of generalized arithmetic…

Optimization and Control · Mathematics 2020-07-31 Henryk Gzyl

Similarity functions measure how comparable pairs of elements are, and play a key role in a wide variety of applications, e.g., notions of Individual Fairness abiding by the seminal paradigm of Dwork et al., as well as Clustering problems.…

Machine Learning · Computer Science 2023-10-24 Leonidas Tsepenekas , Ivan Brugere , Freddy Lecue , Daniele Magazzeni

In this paper we study upper and lower bounds on the Bregman divergence $\Delta_{\mathcal{F}}^{\xi}(y,x):=\mathcal{F}(y)-\mathcal{F}(x)-\langle \xi, y-x\rangle $ for some convex functional $\mathcal{F}$ on a normed space $\mathcal{X}$, with…

Numerical Analysis · Mathematics 2019-01-23 Benjamin Sprung

The well known Jensen inequality, holds true for every convex functions. However, we found that it is possible to apply it to some problems related to nonconvex functions for which Jensen's inequality holds true locally. Having considered a…

General Mathematics · Mathematics 2014-12-18 Adilsultan Lepes

The aim of this paper is to provide an overview of recent development related to Bregman distances outside its native areas of optimization and statistics. We discuss approaches in inverse problems and image processing based on Bregman…

Optimization and Control · Mathematics 2015-05-21 Martin Burger

Recently, Taneja studied two one parameter generalizations of J-divergence, Jensen-Shannon divergence and Arithmetic-Geometric divergence. These two generalizations in particular contain measures like: Hellinger discrimination, symmetric…

Information Theory · Computer Science 2011-05-16 G. A. T. F. da Costa , Inder Jeet Taneja

We reexamine the Riemann Rearrangement Theorem for different types of convergence. We consider series convergence with respect to a filter. We describe the Sum Range (SR) of a series along the 2n-filter and for statistically convergent…

Functional Analysis · Mathematics 2007-05-23 Yuriy Dybskiy , Konstantin Slutsky

We calculate some infinite sums containing the digamma function in closed-form. These sums are related either to the incomplete beta function or to the Bessel functions. The calculations yield interesting new results as by-products, such as…

Classical Analysis and ODEs · Mathematics 2023-04-28 Juan L. González-Santander , Fernando Sánchez Lasheras

DP-means clustering was obtained as an extension of $K$-means clustering. While it is implemented with a simple and efficient algorithm, it can estimate the number of clusters simultaneously. However, DP-means is specifically designed for…

Machine Learning · Computer Science 2021-08-26 Masahiro Kobayashi , Kazuho Watanabe

The main purpose of this survey is to gather results on the boundedness of the Bergman projection. First, we shall go over some equivalent norms on weighted Bergman spaces $A^p_\omega$ which are useful in the study of this question. In…

Complex Variables · Mathematics 2015-01-19 José Ángel Peláez , Jouni Rättyä

The theory of convergent graph sequences has been worked out in two extreme cases, dense graphs and bounded degree graphs. One can define convergence in terms of counting homomorphisms from fixed graphs into members of the sequence…

Combinatorics · Mathematics 2010-02-02 Christian Borgs , Jennifer Chayes , Jeff Kahn , László Lovász

The purpose of this paper is twofold. On a technical side, we propose an extension of the Hausdorff distance from metric spaces to spaces equipped with asymmetric distance measures. Specifically, we focus on the family of Bregman…

Machine Learning · Computer Science 2025-04-11 Tuyen Pham , Hana Dal Poz Kouřimská , Hubert Wagner

This work belongs to the framework of inverse problems with linear model. The resolution of this type of problem consists in minimizing (possibly under constraints) a function of discrepancy between the measurements and a physical model of…

Information Theory · Computer Science 2021-09-28 Henri Lantéri

An extension of sinc interpolation on $\mathbb{R}$ to the class of algebraically decaying functions is developed in the paper. Similarly to the classical sinc interpolation we establish two types of error estimates. First covers a wider…

Numerical Analysis · Mathematics 2018-09-27 Dmytro Sytnyk

This note gives a few rapidly convergent series representations of the sums of divisors functions. These series have various applications such as exact evaluations of some power series, computing estimates and proving the existence results…

General Mathematics · Mathematics 2014-07-29 N. A. Carella

We study the convergence of a family of numerical integration methods where the numerical integral is formulated as a finite matrix approximation to a multiplication operator. For bounded functions, the convergence has already been…

Numerical Analysis · Mathematics 2023-03-28 Juha Sarmavuori , Simo Särkkä

Blurring mean shift (BMS) algorithm, a variant of the mean shift algorithm, is a kernel-based iterative method for data clustering, where data points are clustered according to their convergent points via iterative blurring. In this paper,…

Machine Learning · Computer Science 2024-02-26 Ryoya Yamasaki , Toshiyuki Tanaka

The main goal of this paper is to provide a brief survey of recent results which connect together results from different areas of research. It is well known that numerical integration of functions with mixed smoothness is closely related to…

Numerical Analysis · Mathematics 2018-12-12 Vladimir Temlyakov

There are many information and divergence measures exist in the literature on information theory and statistics. The most famous among them are Kullback-Leiber relative information and Jeffreys J-divergence. The measures like, Bhattacharya…

Probability · Mathematics 2007-05-23 Inder Jeet Taneja