English
Related papers

Related papers: On Model-Based Clustering With Entropic Optimal Tr…

200 papers

Optimal transport is an important tool in machine learning, allowing to capture geometric properties of the data through a linear program on transport polytopes. We present a single-loop optimization algorithm for minimizing general convex…

Machine Learning · Computer Science 2023-06-21 Marin Ballu , Quentin Berthet

The expectation--maximization (EM) algorithm combines global monotonicity, local linear convergence, and strong practical robustness, but these features are usually analyzed separately. Global descent is nonlinear, whereas local convergence…

Machine Learning · Statistics 2026-05-11 Qiao Wang

Following [21, 23], the present work investigates a new relative entropy-regularized algorithm for solving the optimal transport on a graph problem within the randomized shortest paths formalism. More precisely, a unit flow is injected into…

Machine Learning · Computer Science 2021-09-21 Sylvain Courtain , Guillaume Guex , Ilkka Kivimaki , Marco Saerens

Any clustering algorithm must synchronously learn to model the clusters and allocate data to those clusters in the absence of labels. Mixture model-based methods model clusters with pre-defined statistical distributions and allocate data to…

Machine Learning · Computer Science 2022-10-04 Dumindu Tissera , Kasun Vithanage , Rukshan Wijesinghe , Alex Xavier , Sanath Jayasena , Subha Fernando , Ranga Rodrigo

This paper considers a canonical clustering problem where one receives unlabeled samples drawn from a balanced mixture of two elliptical distributions and aims for a classifier to estimate the labels. Many popular methods including PCA and…

Machine Learning · Statistics 2021-11-30 Kaizheng Wang , Yuling Yan , Mateo Díaz

Clustering is an unsupervised learning method that constitutes a cornerstone of an intelligent data analysis process. It is used for the exploration of inter-relationships among a collection of patterns, by organizing them into homogeneous…

Machine Learning · Computer Science 2010-04-13 G. Nathiya , S. C. Punitha , M. Punithavalli

The mixture model is undoubtedly one of the greatest contributions to clustering. For continuous data, Gaussian models are often used and the Expectation-Maximization (EM) algorithm is particularly suitable for estimating parameters from…

Machine Learning · Statistics 2025-11-25 Zineddine Tighidet , Lazhar Labiod , Mohamed Nadif

Image clustering is one of the most important computer vision applications, which has been extensively studied in literature. However, current clustering methods mostly suffer from lack of efficiency and scalability when dealing with…

Machine Learning · Computer Science 2017-08-10 Kamran Ghasedi Dizaji , Amirhossein Herandi , Cheng Deng , Weidong Cai , Heng Huang

This work studies the location estimation problem for a mixture of two rotation invariant log-concave densities. We demonstrate that Least Squares EM, a variant of the EM algorithm, converges to the true location parameter from a randomly…

Machine Learning · Statistics 2019-06-21 Wei Qian , Yuqian Zhang , Yudong Chen

In this paper, we study the Entropic Martingale Optimal Transport (EMOT) problem on \mathbb{R}. The investigation of the EMOT problem arises in the calibration problem of the Stochastic Volatility Models, where martingale constraints…

Probability · Mathematics 2026-02-16 Fan Chen , Giovanni Conforti , Zhenjie Ren , Xiaozhen Wang

Persistence diagrams (PDs) are now routinely used to summarize the underlying topology of complex data. Despite several appealing properties, incorporating PDs in learning pipelines can be challenging because their natural geometry is not…

Machine Learning · Statistics 2018-11-14 Théo Lacombe , Marco Cuturi , Steve Oudot

The mismatch capacity characterizes the highest information rate of the channel under a prescribed decoding metric and serves as a critical performance indicator in numerous practical communication scenarios. Compared to the commonly used…

Information Theory · Computer Science 2025-07-29 Shitong Wu , Wenhao Ye , Xinwei Li , Lingyi Chen , Wenyi Zhang , Huihui Wu , Hao Wu

An inverse modeling technique is introduced that combines elements of coupled logistic map models and wavelet analysis for the purpose of analyzing partial synchronization states in high-dimensional systems. Using Embedded Complex Logistic…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Sandy Shaw

Recently, linear regression models incorporating an optimal transport (OT) loss have been explored for applications such as supervised unmixing of spectra, music transcription, and mass spectrometry. However, these task-specific approaches…

We investigate the convergence properties of the EM algorithm when applied to overspecified Gaussian mixture models -- that is, when the number of components in the fitted model exceeds that of the true underlying distribution. Focusing on…

Machine Learning · Statistics 2025-06-16 Zhenisbek Assylbekov , Alan Legg , Artur Pak

This paper presents a novel approach to distinguish driving styles with respect to their energy efficiency. A distinct property of our method is that it relies exclusively on Global Positioning System (GPS) logs of drivers. This setting is…

Other Computer Science · Computer Science 2016-10-11 Michael Breuß , Laurent Hoeltgen , Ali Sharifi Boroujerdi , Ashkan Mansouri Yarahmadi

Modern scientific studies often collect data sets in the forms of tensors, which call for innovative statistical analysis methods. In particular, there is a pressing need for tensor clustering methods to understand the heterogeneity in the…

Methodology · Statistics 2021-04-27 Qing Mai , Xin Zhang , Yuqing Pan , Kai Deng

Motivated by applications in social and biological network analysis, we introduce a new form of agnostic clustering termed~\emph{motif correlation clustering}, which aims to minimize the cost of clustering errors associated with both edges…

Data Structures and Algorithms · Computer Science 2018-11-07 Pan Li , Gregory J. Puleo , Olgica Milenkovic

Optimal transport aims to estimate a transportation plan that minimizes a displacement cost. This is realized by optimizing the scalar product between the sought plan and the given cost, over the space of doubly stochastic matrices. When…

In [Q. Liao et al., Commun. Math. Sci., 20(2022)], a linear-time Sinkhorn algorithm is developed based on dynamic programming, which significantly reduces the computational complexity involved in solving optimal transport problems. However,…

Optimization and Control · Mathematics 2025-03-25 Ziyuan Lyu , Zihao Wang , Hao Wu , Shuai Yang