English
Related papers

Related papers: A Novel Loss Function Utilizing Wasserstein Distan…

200 papers

This paper presents a novel feature selection method leveraging the Wasserstein distance to improve feature selection in machine learning. Unlike traditional methods based on correlation or Kullback-Leibler (KL) divergence, our approach…

Machine Learning · Computer Science 2024-11-15 Fuwei Li

Variational Autoencoders (VAEs) have gained significant popularity among researchers as a powerful tool for understanding unknown distributions based on limited samples. This popularity stems partly from their impressive performance and…

Machine Learning · Computer Science 2024-02-27 Saptarshi Chakraborty , Peter L. Bartlett

Data consisting of time-indexed distributions of cross-sectional or intraday returns have been extensively studied in finance, and provide one example in which the data atoms consist of serially dependent probability distributions.…

Methodology · Statistics 2020-06-24 Chao Zhang , Piotr Kokoszka , Alexander Petersen

Optimal Transport has sparked vivid interest in recent years, in particular thanks to the Wasserstein distance, which provides a geometrically sensible and intuitive way of comparing probability measures. For computational reasons, the…

Machine Learning · Computer Science 2024-03-19 Eloi Tanguy

Text is the major method that is used for communication now a days, each and every day lots of text are created. In this paper the text data is used for the classification of the emotions. Emotions are the way of expression of the persons…

Computation and Language · Computer Science 2019-01-11 Naveenkumar K S , Vinayakumar R , Soman KP

Gradient boosting is a sequential ensemble method that fits a new weaker learner to pseudo residuals at each iteration. We propose Wasserstein gradient boosting, a novel extension of gradient boosting that fits a new weak learner to…

Methodology · Statistics 2024-08-30 Takuo Matsubara

Disentangling polysemantic neurons is at the core of many current approaches to interpretability of large language models. Here we attempt to study how disentanglement can be used to understand performance, particularly under weight…

Machine Learning · Computer Science 2025-02-27 Shashata Sawmya , Linghao Kong , Ilia Markov , Dan Alistarh , Nir Shavit

Learning nonlinear dynamics from diffusion data is a challenging problem since the individuals observed may be different at different time points, generally following an aggregate behaviour. Existing work cannot handle the tasks well since…

Machine Learning · Computer Science 2018-07-31 Yisen Wang , Bo Dai , Lingkai Kong , Sarah Monazam Erfani , James Bailey , Hongyuan Zha

We present a novel inference approach that we call Sample Out-of-Sample (or SOS) inference. The approach can be used widely, ranging from semi-supervised learning to stress testing, and it is fundamental in the application of data-driven…

Statistics Theory · Mathematics 2021-03-22 Jose Blanchet , Yang Kang

Mutual information maximization has emerged as a powerful learning objective for unsupervised representation learning obtaining state-of-the-art performance in applications such as object recognition, speech recognition, and reinforcement…

Machine Learning · Computer Science 2019-03-29 Sherjil Ozair , Corey Lynch , Yoshua Bengio , Aaron van den Oord , Sergey Levine , Pierre Sermanet

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

Machine Learning · Computer Science 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

Humans learn from catastrophic mistakes not through numerical penalties, but through qualitative suffering that reshapes who they are. Current AI safety approaches replicate none of this. Reward shaping captures magnitude, not meaning.…

Artificial Intelligence · Computer Science 2026-03-17 Pandurang Mopgar

This paper targets the task with discrete and periodic class labels ($e.g.,$ pose/orientation estimation) in the context of deep learning. The commonly used cross-entropy or regression loss is not well matched to this problem as they ignore…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Xiaofeng Liu , Yang Zou , Tong Che , Peng Ding , Ping Jia , Jane You , Kumar B. V. K

The choice of a loss function is a critical part of machine learning. This paper evaluated two different loss functions commonly used in regression-task dimensional speech emotion recognition, an error-based and a correlation-based loss…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Bagus Tris Atmaja , Masato Akagi

We propose using the Wasserstein loss for training in inverse problems. In particular, we consider a learned primal-dual reconstruction scheme for ill-posed inverse problems using the Wasserstein distance as loss function in the learning.…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Jonas Adler , Axel Ringh , Ozan Öktem , Johan Karlsson

This paper presents a new variational data assimilation (VDA) approach for the formal treatment of bias in both model outputs and observations. This approach relies on the Wasserstein metric stemming from the theory of optimal mass…

Methodology · Statistics 2020-08-04 Sagar K. Tamang , Ardeshir Ebtehaj , Dongmian Zou , Gilad Lerman

This paper is focused on the statistical analysis of data consisting of a collection of multiple series of probability measures that are indexed by distinct time instants and supported over a bounded interval of the real line. By modeling…

Machine Learning · Statistics 2026-05-05 Yiye Jiang , Jérémie Bigot

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

Machine Learning · Computer Science 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

Collaborative learning has recently achieved very significant results. It still suffers, however, from several issues, including the type of information that needs to be exchanged, the criteria for stopping and how to choose the right…

Machine Learning · Computer Science 2021-03-29 Fatima Ezzahraa Ben Bouazza , Younès Bennani

Imitation learning models for robotic tasks typically rely on multi-modal inputs, such as RGB images, language, and proprioceptive states. While proprioception is intuitively important for decision-making and obstacle avoidance, simply…

Robotics · Computer Science 2025-07-02 Fuhang Kuang , Jiacheng You , Yingdong Hu , Tong Zhang , Chuan Wen , Yang Gao