English
Related papers

Related papers: Distribution Regression with Sliced Wasserstein Ke…

200 papers

As modern machine learning models continue to advance the computational frontier, it has become increasingly important to develop precise estimates for expected performance improvements under different model and data scaling regimes.…

Machine Learning · Computer Science 2023-06-13 Lechao Xiao , Hong Hu , Theodor Misiakiewicz , Yue M. Lu , Jeffrey Pennington

We propose a robust and scalable procedure for general optimization and inference problems on manifolds leveraging the classical idea of `median-of-means' estimation. This is motivated by ubiquitous examples and applications in modern data…

Methodology · Statistics 2020-06-16 Lizhen Lin , Drew Lazar , Bayan Sarpabayeva , David B. Dunson

Distributionally robust supervised learning (DRSL) is emerging as a key paradigm for building reliable machine learning systems for real-world applications -- reflecting the need for classifiers and predictive models that are robust to the…

Machine Learning · Computer Science 2022-01-26 Yaodong Yu , Tianyi Lin , Eric Mazumdar , Michael I. Jordan

Learning conditional densities and identifying factors that influence the entire distribution are vital tasks in data-driven applications. Conventional approaches work mostly with summary statistics, and are hence inadequate for a…

Methodology · Statistics 2022-09-13 Chengliang Tang , Nathan Lenssen , Ying Wei , Tian Zheng

In order to anticipate rare and impactful events, we propose to quantify the worst-case risk under distributional ambiguity using a recent development in kernel methods -- the kernel mean embedding. Specifically, we formulate the…

Optimization and Control · Mathematics 2020-09-08 Jia-Jie Zhu , Wittawat Jitkrittum , Moritz Diehl , Bernhard Schölkopf

Support vector machine (SVM) has been one of the most popular learning algorithms, with the central idea of maximizing the minimum margin, i.e., the smallest distance from the instances to the classification boundary. Recent theoretical…

Machine Learning · Computer Science 2020-07-07 Teng Zhang , Zhi-Hua Zhou

Distributed distribution comparison aims to measure the distance between the distributions whose data are scattered across different agents in a distributed system and cannot even be shared directly among the agents. In this study, we…

Machine Learning · Computer Science 2024-07-23 Xiangfeng Wang , Hongteng Xu , Moyi Yang

While likelihood-based inference and its variants provide a statistically efficient and widely applicable approach to parametric inference, their application to models involving intractable likelihoods poses challenges. In this work, we…

Methodology · Statistics 2019-06-17 Francois-Xavier Briol , Alessandro Barp , Andrew B. Duncan , Mark Girolami

This paper derives error bounds for regression in continuous time over subsets of certain types of Riemannian manifolds.The regression problem is typically driven by a nonlinear evolution law taking values on the manifold, and it is cast as…

Dynamical Systems · Mathematics 2022-09-09 Nathan Powell , Jia Guo , Sai Tej Parachuri , John Burns , Boone Estes , Andrew Kurdila

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

Machine Learning · Computer Science 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

Distributionally robust stochastic optimization (DRSO) is an approach to optimization under uncertainty in which, instead of assuming that there is a known true underlying probability distribution, one hedges against a chosen set of…

Optimization and Control · Mathematics 2022-05-03 Rui Gao , Anton J. Kleywegt

We address the optimization problem of simultaneously minimizing multiple objective functionals over a family of probability distributions. This type of Multi-Objective Distributional Optimization commonly arises in machine learning and…

Machine Learning · Computer Science 2025-05-27 Dai Hai Nguyen , Hiroshi Mamitsuka , Atsuyoshi Nakamura

A structure-preserving kernel ridge regression method is presented that allows the recovery of nonlinear Hamiltonian functions out of datasets made of noisy observations of Hamiltonian vector fields. The method proposes a closed-form…

Machine Learning · Statistics 2025-04-07 Jianyu Hu , Juan-Pablo Ortega , Daiying Yin

Given additional distributional information in the form of moment restrictions, kernel density and distribution function estimators with implied generalised empirical likelihood probabilities as weights achieve a reduction in variance due…

Methodology · Statistics 2019-10-08 Vitaliy Oryshchenko , Richard J. Smith

The Wasserstein distance is a distance between two probability distributions and has recently gained increasing popularity in statistics and machine learning, owing to its attractive properties. One important approach to extending this…

Methodology · Statistics 2022-02-14 Ryo Okano , Masaaki Imaizumi

In many applications in statistics and machine learning, the availability of data samples from multiple possibly heterogeneous sources has become increasingly prevalent. On the other hand, in distributionally robust optimization, we seek…

Machine Learning · Statistics 2022-05-31 Tim Tsz-Kit Lau , Han Liu

In this work, we investigate Gaussian Processes indexed by multidimensional distributions. While directly constructing radial positive definite kernels based on the Wasserstein distance has been proven to be possible in the unidimensional…

Wasserstein gradient flows of maximum mean discrepancy (MMD) functionals with non-smooth Riesz kernels show a rich structure as singular measures can become absolutely continuous ones and conversely. In this paper we contribute to the…

Machine Learning · Computer Science 2024-03-22 Fabian Altekrüger , Johannes Hertrich , Gabriele Steidl

This paper focuses on the Wasserstein distributionally robust mean-lower semi-absolute deviation (DR-MLSAD) model, where the ambiguity set is a Wasserstein ball centered on the empirical distribution of the training sample. This model can…

Optimization and Control · Mathematics 2024-03-04 Weimi Zhou , Yong-Jin Liu

In the field of modern high-energy physics research, there is a growing emphasis on utilizing deep learning techniques to optimize event simulation, thereby expanding the statistical sample size for more accurate physical analysis.…

Computational Physics · Physics 2025-06-16 Chu-Cheng Pan , Xiang Dong , Yu-Chang Sun , Ao-Yan Cheng , Ao-Bo Wang , Yu-Xuan Hu , Hao Cai
‹ Prev 1 8 9 10 Next ›