中文
相关论文

相关论文: Curved representational Bregman divergences and th…

200 篇论文

Kernel mean embeddings are a popular tool that consists in representing probability measures by their infinite-dimensional mean embeddings in a reproducing kernel Hilbert space. When the kernel is characteristic, mean embeddings can be used…

机器学习 · 计算机科学 2021-06-29 Boris Muzellec , Francis Bach , Alessandro Rudi

We introduce squared families, which are families of probability densities obtained by squaring a linear transformation of a statistic. Squared families are singular, however their singularity can easily be handled so that they form regular…

机器学习 · 统计学 2025-03-28 Russell Tsuchida , Jiawei Liu , Cheng Soon Ong , Dino Sejdinovic

The bias-variance decomposition is a central result in statistics and machine learning, but is typically presented only for the squared error. We present a generalization of the bias-variance decomposition where the prediction error is a…

机器学习 · 计算机科学 2025-11-13 David Pfau

A machine learning model is calibrated if its predicted probability for an outcome matches the observed frequency for that outcome conditional on the model prediction. This property has become increasingly important as the impact of machine…

机器学习 · 计算机科学 2025-02-25 Muthu Chidambaram , Rong Ge

We propose an extension of a special form of gradient descent -- in the literature known as linearised Bregman iteration -- to a larger class of non-convex functions. We replace the classical (squared) two norm metric in the gradient…

最优化与控制 · 数学 2021-05-26 Martin Benning , Marta M. Betcke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb

This work uncovers variational principles behind symmetrizing the Bregman divergences induced by generic mirror maps over the cone of positive definite matrices. We show that computing the canonical means for this symmetrization can be…

最优化与控制 · 数学 2026-04-08 Tushar Sial , Abhishek Halder

In this short note, we give the convergence analysis of the policy in the recent famous policy mirror descent (PMD). We mainly consider the unregularized setting following [11] with generalized Bregman divergence. The difference is that we…

最优化与控制 · 数学 2024-06-04 Dachao Lin , Zhihua Zhang

Separable Bregman divergences induce Riemannian metric spaces that are isometric to the Euclidean space after monotone embeddings. We investigate fixed rate quantization and its codebook Voronoi diagrams, and report on experimental…

机器学习 · 计算机科学 2018-10-26 Erika Gomes-Gonçalves , Henryk Gzyl , Frank Nielsen

The Bregman-Wasserstein divergence is the optimal transport cost when the underlying cost function is given by a Bregman divergence, and arises naturally in fields such as statistics and machine learning. We establish fundamental properties…

概率论 · 数学 2025-04-14 Amanjit Singh Kainth , Cale Rankin , Ting-Kam Leonard Wong

We investigate adaptive mixture methods that linearly combine outputs of $m$ constituent filters running in parallel to model a desired signal. We use "Bregman divergences" and obtain certain multiplicative updates to train the linear…

机器学习 · 计算机科学 2016-11-18 Mehmet A. Donmez , Huseyin A. Inan , Suleyman S. Kozat

This paper considers the problem of adaptive estimation of a mean pattern in a randomly shifted curve model. We show that this problem can be transformed into a linear inverse problem, where the density of the random shifts plays the role…

统计理论 · 数学 2010-10-21 Jérémie Bigot , Sébastien Gadat

The Bregman divergence have been the subject of several studies. We do not go to do an exhaustive study of its subclasses, but propose a proof that shows that the \b{eta}-divergence are subclasses of the Bregman divergences. It is in this…

统计方法学 · 统计学 2018-05-21 Macoumba Ndourand Mactar Ndaw , Papa Ngom

We examine the last-iterate convergence rate of Bregman proximal methods - from mirror descent to mirror-prox and its optimistic variants - as a function of the local geometry induced by the prox-mapping defining the method. For generality,…

最优化与控制 · 数学 2024-12-13 Waïss Azizian , Franck Iutzeler , Jérôme Malick , Panayotis Mertikopoulos

Estimating the Riesz representer is central to debiased machine learning for causal and structural parameter estimation. We propose generalized Riesz regression, a unified framework for estimating the Riesz representer by fitting a…

计量经济学 · 经济学 2026-02-11 Masahiro Kato

The Bregman divergence (Bregman distance, Bregman measure of distance) is a certain useful substitute for a distance, obtained from a well-chosen function (the "Bregman function"). Bregman functions and divergences have been extensively…

最优化与控制 · 数学 2019-04-10 Daniel Reem , Simeon Reich , Alvaro De Pierro

We introduce an approach to computing and comparing Covariance Descriptors (CovDs) in infinite-dimensional spaces. CovDs have become increasingly popular to address classification problems in computer vision. While CovDs offer some…

计算机视觉与模式识别 · 计算机科学 2014-06-12 Mehrtash Harandi , Mathieu Salzmann , Fatih Porikli

The purpose of this paper is twofold. On a technical side, we propose an extension of the Hausdorff distance from metric spaces to spaces equipped with asymmetric distance measures. Specifically, we focus on the family of Bregman…

机器学习 · 计算机科学 2025-04-11 Tuyen Pham , Hana Dal Poz Kouřimská , Hubert Wagner

The {\em focal curve} of an immersed smooth curve $\gamma:s\mapsto \gamma(s)$, in Euclidean space $\R^{m+1}$, consists of the centres of its osculating hyperspheres. The focal curve may be parametrised in terms of the Frenet frame of…

微分几何 · 数学 2019-11-05 Ricardo Uribe-Vargas

Kernel mean embeddings -- integrals of a kernel with respect to a probability distribution -- are essential in Bayesian quadrature, but also widely used in other computational tools for numerical integration or for statistical inference…

机器学习 · 统计学 2025-04-29 François-Xavier Briol , Alexandra Gessner , Toni Karvonen , Maren Mahsereci

We introduce an abstract algorithm that aims to find the Bregman projection onto a closed convex set. As an application, the asymptotic behaviour of an iterative method for finding a fixed point of a quasi Bregman nonexpansive mapping with…

泛函分析 · 数学 2013-09-26 Heinz H. Bauschke , Jiawei Chen , Xianfu Wang