中文
相关论文

相关论文: Hierarchical Gaussian Processes with Wasserstein-2…

200 篇论文

Motivated by questions in quantum theory, we study Hilbert space valued Gaussian processes, and operator-valued kernels, i.e., kernels taking values in B(H) (= all bounded linear operators in a fixed Hilbert space H). We begin with a…

泛函分析 · 数学 2024-08-21 Palle E. T. Jorgensen , James Tian

This work presents a family of parsimonious Gaussian process models which allow to build, from a finite sample, a model-based classifier in an infinite dimensional space. The proposed parsimonious models are obtained by constraining the…

统计方法学 · 统计学 2012-06-18 Charles Bouveyron , Stéphane Girard , Mathieu Fauvel

Optimal Transport (OT) metrics allow for defining discrepancies between two probability measures. Wasserstein distance is for longer the celebrated OT-distance frequently-used in the literature, which seeks probability distributions to be…

机器学习 · 计算机科学 2021-10-14 Mokhtar Z. Alaya , Gilles Gasso , Maxime Berar , Alain Rakotomamonjy

We propose a novel Wasserstein method with a distillation mechanism, yielding joint learning of word embeddings and topics. The proposed method is based on the fact that the Euclidean distance between word embeddings may be employed as the…

机器学习 · 计算机科学 2018-09-14 Hongteng Xu , Wenlin Wang , Wei Liu , Lawrence Carin

Wasserstein gradient flows of maximum mean discrepancy (MMD) functionals with non-smooth Riesz kernels show a rich structure as singular measures can become absolutely continuous ones and conversely. In this paper we contribute to the…

机器学习 · 计算机科学 2024-03-22 Fabian Altekrüger , Johannes Hertrich , Gabriele Steidl

Building spatial process models that capture nonstationary behavior while delivering computationally efficient inference is challenging. Nonstationary spatially varying kernels (see, e.g., Paciorek, 2003) offer flexibility and richness, but…

统计方法学 · 统计学 2025-07-01 Sébastien Coube-Sisqueille , Sudipto Banerjee , Benoît Liquet

Kernel methods have had great success in Statistics and Machine Learning. Despite their growing popularity, however, less effort has been drawn towards developing kernel based classification methods on Riemannian manifolds due to difficulty…

机器学习 · 统计学 2020-10-02 Hwiyoung Lee , Vic Patrangenaru

Recent works on Hierarchical Clustering (HC), a well-studied problem in exploratory data analysis, have focused on optimizing various objective functions for this problem under arbitrary similarity measures. In this paper we take the first…

数据结构与算法 · 计算机科学 2018-12-31 Moses Charikar , Vaggos Chatziafratis , Rad Niazadeh , Grigory Yaroslavtsev

Comparing probability distributions is at the crux of many machine learning algorithms. Maximum Mean Discrepancies (MMD) and Wasserstein distances are two classes of distances between probability distributions that have attracted abundant…

机器学习 · 统计学 2023-06-01 Titouan Vayer , Rémi Gribonval

Deep kernel learning (DKL) and related techniques aim to combine the representational power of neural networks with the reliable uncertainty estimates of Gaussian processes. One crucial aspect of these models is an expectation that, because…

机器学习 · 统计学 2021-07-08 Sebastian W. Ober , Carl E. Rasmussen , Mark van der Wilk

In this work, we propose a novel generalized Wasserstein-2 distance approach for efficiently training stochastic neural networks to reconstruct random field models, where the target random variable comprises both continuous and categorical…

机器学习 · 计算机科学 2025-07-08 Mingtao Xia , Qijing Shen

We introduce a new method for training generative adversarial networks by applying the Wasserstein-2 metric proximal on the generators. The approach is based on Wasserstein information geometry. It defines a parametrization invariant…

机器学习 · 计算机科学 2021-02-16 Alex Tong Lin , Wuchen Li , Stanley Osher , Guido Montufar

The Gaussian process (GP) is a popular statistical technique for stochastic function approximation and uncertainty quantification from data. GPs have been adopted into the realm of machine learning in the last two decades because of their…

机器学习 · 统计学 2024-10-02 Marcus M. Noack , Hengrui Luo , Mark D. Risser

Predictive states for stochastic processes are a nonparametric and interpretable construct with relevance across a multitude of modeling paradigms. Recent progress on the self-supervised reconstruction of predictive states from time-series…

统计力学 · 物理学 2022-12-21 Samuel P. Loomis , James P. Crutchfield

Deep generative models have been demonstrated as state-of-the-art density estimators. Yet, recent work has found that they often assign a higher likelihood to data from outside the training distribution. This seemingly paradoxical behavior…

机器学习 · 计算机科学 2022-01-19 Jakob D. Havtorn , Jes Frellsen , Søren Hauberg , Lars Maaløe

Clustering is an important exploratory data analysis technique to group objects based on their similarity. The widely used $K$-means clustering method relies on some notion of distance to partition data into a fewer number of groups. In the…

机器学习 · 统计学 2022-10-14 Yubo Zhuang , Xiaohui Chen , Yun Yang

In this paper, we study random subsampling of Gaussian process regression, one of the simplest approximation baselines, from a theoretical perspective. Although subsampling discards a large part of training data, we show provable guarantees…

机器学习 · 统计学 2019-01-29 Kohei Hayashi , Masaaki Imaizumi , Yuichi Yoshida

Gaussian processes offers a convenient way to perform nonparametric reconstructions of observational data assuming only a kernel which describes the covariance between neighbouring points in a data set. We approach the ambiguity in the…

宇宙学与河外天体物理 · 物理学 2021-08-17 Reginald Christian Bernardo , Jackson Levi Said

Despite the increasing importance of stochastic processes on linear networks and graphs, current literature on multivariate (vector-valued) Gaussian random fields on metric graphs is elusive. This paper challenges several aspects related to…

统计理论 · 数学 2025-01-20 Tobia Filosi , Emilio Porcu , Xavier Emery , Claudio Agostinelli , Alfredo Alegrìa

K-means clustering is a workhorse of unsupervised learning, but it is notoriously brittle to outliers, distribution shifts, and limited sample sizes. Viewing k-means as Lloyd--Max quantization of the empirical distribution, we develop a…

机器学习 · 计算机科学 2026-04-14 Vikrant Malik , Taylan Kargin , Babak Hassibi