中文
相关论文

相关论文: Beyond the Mean: Distribution-Aware Loss Functions…

200 篇论文

Comparing probability distributions is at the crux of many machine learning algorithms. Maximum Mean Discrepancies (MMD) and Wasserstein distances are two classes of distances between probability distributions that have attracted abundant…

机器学习 · 统计学 2023-06-01 Titouan Vayer , Rémi Gribonval

The analysis of samples of random objects that do not lie in a vector space is gaining increasing attention in statistics. An important class of such object data is univariate probability measures defined on the real line. Adopting the…

统计方法学 · 统计学 2021-07-07 Yaqing Chen , Zhenhua Lin , Hans-Georg Müller

We introduce a distributionally robust minimium mean square error estimation model with a Wasserstein ambiguity set to recover an unknown signal from a noisy observation. The proposed model can be viewed as a zero-sum game between a…

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

机器学习 · 计算机科学 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis

Binary Neural Networks (BNNs) are an extremely promising method to reduce deep neural networks' complexity and power consumption massively. Binarization techniques, however, suffer from ineligible performance degradation compared to their…

机器学习 · 计算机科学 2022-04-06 Tal Rozen , Moshe Kimhi , Brian Chmiel , Avi Mendelson , Chaim Baskin

Bayesian inference promises a framework for principled uncertainty quantification of neural network predictions. Barriers to adoption include the difficulty of fully characterizing posterior distributions on network parameters and the…

机器学习 · 统计学 2025-01-22 Katharine Fisher , Youssef Marzouk

While offering a principled framework for uncertainty quantification in deep learning, the employment of Bayesian Neural Networks (BNNs) is still constrained by their increased computational requirements and the convergence difficulties…

机器学习 · 计算机科学 2025-05-26 Moule Lin , Shuhao Guan , Weipeng Jing , Goetz Botterweck , Andrea Patane

We propose the first approach for multiple multivariate density-density regression (MDDR), making it possible to consider the regression of a multivariate density-valued response on multiple multivariate density-valued predictors. The core…

统计方法学 · 统计学 2026-01-07 Khai Nguyen , Yang Ni , Peter Mueller

Deep neural networks tend to underestimate uncertainty and produce overly confident predictions. Recently proposed solutions, such as MC Dropout and SDENet, require complex training and/or auxiliary out-of-distribution data. We propose a…

机器学习 · 计算机科学 2021-10-14 Akib Mashrur , Wei Luo , Nayyar A. Zaidi , Antonio Robles-Kelly

This paper presents a novel Wasserstein distributionally robust control and state estimation algorithm for partially observable linear stochastic systems, where the probability distributions of disturbances and measurement noises are…

系统与控制 · 电气工程与系统科学 2024-06-05 Minhyuk Jang , Astghik Hakobyan , Insoon Yang

While several methods for predicting uncertainty on deep networks have been recently proposed, they do not readily translate to large and complex datasets. In this paper we utilize a simplified form of the Mixture Density Networks (MDNs) to…

机器学习 · 计算机科学 2019-12-05 Nicholas Wilkins , Michael Johnson , Ifeoma Nwogu

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

机器学习 · 计算机科学 2023-02-15 Brian Staber , Sébastien Da Veiga

We propose a novel generative model within the Bayesian non-parametric learning (BNPL) framework to address some notable failure modes in generative adversarial networks (GANs) and variational autoencoders (VAEs)--these being overfitting in…

机器学习 · 统计学 2025-06-24 Forough Fazeli-Asl , Michael Minyi Zhang

We consider the problem of distributedly estimating Gaussian processes in multi-agent frameworks. Each agent collects few measurements and aims to collaboratively reconstruct a common estimate based on all data. Agents are assumed with…

多智能体系统 · 计算机科学 2018-05-11 Gianluigi Pillonetto , Luca Schenato , Damiano Varagnolo

This article introduces a Bayesian neural network estimation method for quantile regression assuming an asymmetric Laplace distribution (ALD) for the response variable. It is shown that the posterior distribution for feedforward neural…

统计理论 · 数学 2022-04-06 Sanket R. Jantre , Shrijita Bhattacharya , Tapabrata Maiti

Modeling observations as random distributions embedded within Wasserstein spaces is becoming increasingly popular across scientific fields, as it captures the variability and geometric structure of the data more effectively. However, the…

统计理论 · 数学 2026-04-08 François Bachoc , Alberto González-Sanz , Jean-Michel Loubes , Yisha Yao

Emotions are an essential part of human behavior that can impact thinking, decision-making, and communication skills. Thus, the ability to accurately monitor and identify emotions can be useful in many human-centered applications such as…

机器学习 · 计算机科学 2023-08-22 Nibraas Khan , Mahrukh Tauseef , Ritam Ghosh , Nilanjan Sarkar

The generative adversarial network (GAN) is a well-known model for learning high-dimensional distributions, but the mechanism for its generalization ability is not understood. In particular, GAN is vulnerable to the memorization phenomenon,…

机器学习 · 计算机科学 2026-02-18 Hongkang Yang , Weinan E

This study addresses a class of linear mixed-integer programming (MILP) problems that involve uncertainty in the objective function parameters. The parameters are assumed to form a random vector, whose probability distribution can only be…

最优化与控制 · 数学 2024-03-07 Sergey S. Ketkov

Wasserstein gradient flows of maximum mean discrepancy (MMD) functionals with non-smooth Riesz kernels show a rich structure as singular measures can become absolutely continuous ones and conversely. In this paper we contribute to the…

机器学习 · 计算机科学 2024-03-22 Fabian Altekrüger , Johannes Hertrich , Gabriele Steidl