English
Related papers

Related papers: Multiple-output composite quantile regression thro…

200 papers

We propose a scalable robust learning algorithm combining kernel smoothing and robust optimization. Our method is motivated by the convex analysis perspective of distributionally robust optimization based on probability metrics, such as the…

Machine Learning · Computer Science 2022-02-22 Jia-Jie Zhu , Christina Kouridi , Yassine Nemmour , Bernhard Schölkopf

We propose a novel probabilistic approach to multilevel clustering problems based on composite transportation distance, which is a variant of transportation distance where the underlying metric is Kullback-Leibler divergence. Our method…

Machine Learning · Computer Science 2018-10-30 Nhat Ho , Viet Huynh , Dinh Phung , Michael I. Jordan

The question of optimally approximating an arbitrary probability measure in the Wasserstein distance by a discrete one with uniform weights is considered. Estimates are obtained for the optimal approximation distance, with an explicit rate…

Probability · Mathematics 2026-04-14 Benjamin Seeger

The default Gaussian latent in flow-based generative models poses challenges when learning certain distributions such as heavy-tailed ones. We introduce a general framework for learning data-adaptive latent distributions using…

Machine Learning · Statistics 2026-02-11 Jannis Chemseddine , Gregor Kornhardt , Richard Duong , Gabriele Steidl

As a natural approach to modeling system safety conditions, chance constraint (CC) seeks to satisfy a set of uncertain inequalities individually or jointly with high probability. Although a joint CC offers stronger reliability certificate,…

Optimization and Control · Mathematics 2022-04-04 Haoming Shen , Ruiwei Jiang

Given two continuity equations with density-dependent velocities, we provide a new formula for the Wasserstein distance between the solutions in terms of the difference of velocities evaluated at the same density. The formula is…

Analysis of PDEs · Mathematics 2026-03-27 José A. Carrillo , Piotr Gwiazda , Jakub Skrzeczkowski

This paper studies convergence behavior of latent mixing measures that arise in finite and infinite mixture models, using transportation distances (i.e., Wasserstein metrics). The relationship between Wasserstein distances on the space of…

Statistics Theory · Mathematics 2013-04-10 XuanLong Nguyen

This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally…

Systems and Control · Electrical Eng. & Systems 2024-03-22 Himanshu Prabhat , Raktim Bhattacharya

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

Machine Learning · Computer Science 2023-11-27 Clément Bonet

We study posterior rates of contraction in Gaussian process regression with unbounded covariate domain. Our argument relies on developing a Gaussian approximation to the posterior of the leading coefficients of a Karhunen--Lo\'{e}ve…

Statistics Theory · Mathematics 2015-10-06 Anirban Bhattacharya , Debdeep Pati

In this paper, we propose an empirical likelihood-based weighted estimator of regression parameter in quantile regression model with nonignorable missing covariates. The proposed estimator is computationally simple and achieves…

Methodology · Statistics 2017-10-10 Xiaohui Yuan , Xiaogang Dong

The main objective of this study is to propose an optimal transport based semi-supervised approach to learn from scarce labelled image data using deep convolutional networks. The principle lies in implicit graph-based transductive…

Machine Learning · Computer Science 2025-12-08 Antoine Blais , Nicolas Couëllan

The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart…

Methodology · Statistics 2023-10-16 Haeseong Moon , Wen-Xin Zhou

Using statistical learning methods to analyze stochastic simulation outputs can significantly enhance decision-making by uncovering relationships between different simulated systems and between a system's inputs and outputs. We focus on…

Methodology · Statistics 2026-05-28 Mohammadmahdi Ghasemloo , David J. Eckman

Comparing probability distributions is at the crux of many machine learning algorithms. Maximum Mean Discrepancies (MMD) and Wasserstein distances are two classes of distances between probability distributions that have attracted abundant…

Machine Learning · Statistics 2023-06-01 Titouan Vayer , Rémi Gribonval

Additive regression models have a long history in multivariate nonparametric regression. They provide a model in which each regression function depends only on a single explanatory variable allowing to obtain estimators at the optimal…

Methodology · Statistics 2015-09-16 Graciela Boente , Alejandra Martinez

Markov chain Monte Carlo (MCMC) provides asymptotically consistent estimates of intractable posterior expectations as the number of iterations tends to infinity. However, in large data applications, MCMC can be computationally expensive per…

Computation · Statistics 2023-11-03 Niloy Biswas , Lester Mackey

This paper considers the quantile regression approach for partially linear spatial autoregressive models with possibly varying coefficients. B-spline is employed for the approximation of varying coefficients. The instrumental variable…

Methodology · Statistics 2016-08-08 Xiaowen Dai , Shaoyang Li , Maozai Tian

We study the contraction in Wasserstein distance of the coordinate ascent variational inference algorithm. This is shown to hold under a transport-information inequality at the fixed points and a functional smoothness condition. The results…

Machine Learning · Statistics 2026-05-29 Rocco Caprio , Adrien Corenflos , Sam Power

Robust statistics traditionally focuses on outliers, or perturbations in total variation distance. However, a dataset could be corrupted in many other ways, such as systematic measurement errors and missing covariates. We generalize the…

Statistics Theory · Mathematics 2020-12-15 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt