English
Related papers

Related papers: Interpolating between Clustering and Dimensionalit…

200 papers

We introduce a novel and scalable Bayesian framework for multivariate-density-density regression (DDR), designed to model relationships between multivariate distributions. Our approach addresses the critical issue of distributions residing…

Methodology · Statistics 2025-09-24 Khai Nguyen , Yang Ni , Peter Mueller

In this paper, we study the problem of learning compact (low-dimensional) representations for sequential data that captures its implicit spatio-temporal cues. To maximize extraction of such informative cues from the data, we set the problem…

Machine Learning · Computer Science 2020-07-14 Anoop Cherian , Shuchin Aeron

Single-cell genomics has significantly advanced our understanding of cellular behavior, catalyzing innovations in treatments and precision medicine. However, single-cell sequencing technologies are inherently destructive and can only…

Machine Learning · Statistics 2024-11-08 Dominik Klein , Théo Uscidda , Fabian Theis , Marco Cuturi

In this paper, we address the problem of recovering arbitrary-shaped data clusters from datasets while facing \emph{high space constraints}, as this is for instance the case in many real-world applications when analysis algorithms are…

Machine Learning · Computer Science 2018-05-29 Anne Morvan , Krzysztof Choromanski , Cédric Gouy-Pailler , Jamal Atif

We present a framework for supervised subspace tracking, when there are two time series $x_t$ and $y_t$, one being the high-dimensional predictors and the other being the response variables and the subspace tracking needs to take into…

Machine Learning · Computer Science 2015-09-02 Yao Xie , Ruiyang Song , Hanjun Dai , Qingbin Li , Le Song

Obtaining solutions to Optimal Transportation (OT) problems is typically intractable when the marginal spaces are continuous. Recent research has focused on approximating continuous solutions with discretization methods based on i.i.d.…

Optimization and Control · Mathematics 2021-02-17 Junqi Wang , Pei Wang , Patrick Shafto

Wasserstein distances form a family of metrics on spaces of probability measures that have recently seen many applications. However, statistical analysis in these spaces is complex due to the nonlinearity of Wasserstein spaces. One…

Methodology · Statistics 2024-11-18 Michael Wilson , Tom Needham , Anuj Srivastava

The assignment problem, a cornerstone of operations research, seeks an optimal one-to-one mapping between agents and tasks to minimize total cost. This work traces its evolution from classical formulations and algorithms to modern optimal…

Optimization and Control · Mathematics 2025-09-05 Iman Seyedi , Antonio Candelieri , Enza Messina , Francesco Archetti

The Gromov-Wasserstein (GW) problem, a variant of the classical optimal transport (OT) problem, has attracted growing interest in the machine learning and data science communities due to its ability to quantify similarity between measures…

Machine Learning · Computer Science 2025-03-25 Yikun Bai , Abihith Kothapalli , Hengrong Du , Rocio Diaz Martin , Soheil Kolouri

Comparing structured objects such as graphs is a fundamental operation involved in many learning tasks. To this end, the Gromov-Wasserstein (GW) distance, based on Optimal Transport (OT), has proven to be successful in handling the specific…

Machine Learning · Computer Science 2022-03-02 Cédric Vincent-Cuaz , Rémi Flamary , Marco Corneli , Titouan Vayer , Nicolas Courty

We propose an online data compression approach for efficiently solving distributionally robust optimization (DRO) problems with streaming data while maintaining out-of-sample performance guarantees. Our method dynamically constructs…

Optimization and Control · Mathematics 2025-09-12 Irina Wang , Marta Fochesato , Bartolomeo Stellato

Dimensionality reduction is a topic of recent interest. In this paper, we present the classification constrained dimensionality reduction (CCDR) algorithm to account for label information. The algorithm can account for multiple classes as…

Machine Learning · Statistics 2009-09-29 Raviv Raich , Jose A. Costa , Steven B. Damelin , Alfred O. Hero

Gaussian mixtures are widely used for approximating density functions in various applications such as density estimation, belief propagation, and Bayesian filtering. These applications often utilize Gaussian mixtures as initial…

Machine Learning · Statistics 2023-10-18 Qiong Zhang , Archer Gong Zhang , Jiahua Chen

The recent rapid growth of the dimension of many datasets means that many approaches to dimension reduction (DR) have gained significant attention. High-performance DR algorithms are required to make data analysis feasible for big and fast…

Machine Learning · Computer Science 2021-11-09 Samudra Herath , Matthew Roughan , Gary Glonek

Creating low dimensional representations of a high dimensional data set is an important component in many machine learning applications. How to cluster data using their low dimensional embedded space is still a challenging problem in…

Machine Learning · Computer Science 2023-03-27 Zahra Moslehi , Abdolreza Mirzaei , Mehran Safayani

Dimensionality Reduction (DR) techniques can generate 2D projections and enable visual exploration of cluster structures of high-dimensional datasets. However, different DR techniques would yield various patterns, which significantly affect…

Human-Computer Interaction · Computer Science 2021-10-07 Jiazhi Xia , Yuchen Zhang , Jie Song , Yang Chen , Yunhai Wang , Shixia Liu

Computing optimal transport (OT) between measures in high dimensions is doomed by the curse of dimensionality. A popular approach to avoid this curse is to project input measures on lower-dimensional subspaces (1D lines in the case of…

Machine Learning · Computer Science 2019-10-30 Boris Muzellec , Marco Cuturi

Optimal transport (OT) is a powerful tool in mathematics and data science but faces severe computational and statistical challenges in high dimensions. We propose convex relaxation approaches based on marginal and cluster moment relaxations…

Optimization and Control · Mathematics 2025-11-25 Yuehaw Khoo , Tianyun Tang

We address the problem of communicating domain knowledge from a user to the designer of a clustering algorithm. We propose a protocol in which the user provides a clustering of a relatively small random sample of a data set. The algorithm…

Machine Learning · Statistics 2015-06-22 Hassan Ashtiani , Shai Ben-David

Matching a source to a target probability measure is often solved by instantiating a linear optimal transport (OT) problem, parameterized by a ground cost function that quantifies discrepancy between points. When these measures live in the…

Machine Learning · Computer Science 2023-11-27 Othmane Sebbouh , Marco Cuturi , Gabriel Peyré