English
Related papers

Related papers: Coreset selection for the Sinkhorn divergence and …

200 papers

Coreset of a given dataset and loss function is usually a small weighed set that approximates this loss for every query from a given set of queries. Coresets have shown to be very useful in many applications. However, coresets construction…

Machine Learning · Computer Science 2021-11-05 Alaa Maalouf , Gilad Eini , Ben Mussay , Dan Feldman , Margarita Osadchy

In 2013, Cuturi [Cut13] introduced the Sinkhorn algorithm for matrix scaling as a method to compute solutions to regularized optimal transport problems. In this paper, aiming at a better convergence rate for a high accuracy solution, we…

Data Structures and Algorithms · Computer Science 2023-04-06 Jingbang Chen , Li Chen , Yang P. Liu , Richard Peng , Arvind Ramaswami

We study the optimal transport problem for $d>2$ discrete measures. This is a linear programming problem on $d$-tensors. It gives a way to compute a "distance" between two sets of discrete measures. We introduce an entropic regularization…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Shmuel Friedland

We present a new perspective on the celebrated Sinkhorn algorithm by showing that is a special case of incremental/stochastic mirror descent. In order to see this, one should simply plug Kullback-Leibler divergence in both mirror map and…

Machine Learning · Computer Science 2019-09-17 Konstantin Mishchenko

We introduce a new class of convex-regularized Optimal Transport losses, which generalizes the classical Entropy-regularization of Optimal Transport and Sinkhorn divergences, and propose a generalized Sinkhorn algorithm. Our framework…

Optimization and Control · Mathematics 2020-07-03 Simone Di Marino , Augusto Gerolin

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

Coreset, which is a summary of the original dataset in the form of a small weighted set in the same sample space, provides a promising approach to enable machine learning over distributed data. Although viewed as a proxy of the original…

Machine Learning · Computer Science 2020-06-24 Hanlin Lu , Ming-Ju Li , Ting He , Shiqiang Wang , Vijaykrishnan Narayanan , Kevin S Chan

Modern deep learning heavily relies on large labeled datasets, which often comse with high costs in terms of both manual labeling and computational resources. To mitigate these challenges, researchers have explored the use of informative…

Machine Learning · Statistics 2023-09-07 Yong Lin , Chen Liu , Chenlu Ye , Qing Lian , Yuan Yao , Tong Zhang

We present an efficient coresets-based neural network compression algorithm that sparsifies the parameters of a trained fully-connected neural network in a manner that provably approximates the network's output. Our approach is based on an…

Machine Learning · Computer Science 2019-05-21 Cenk Baykal , Lucas Liebenwein , Igor Gilitschenski , Dan Feldman , Daniela Rus

We propose a balanced coarsening scheme for multilevel hypergraph partitioning. In addition, an initial partitioning algorithm is designed to improve the quality of k-way hypergraph partitioning. By assigning vertex weights through the LPT…

Machine Learning · Computer Science 2023-07-14 Zhicheng Guo , Jiaxuan Zhao , Licheng Jiao , Xu Liu

It is demonstrated that non-constant kernel solution, that can fit the spatial variations of the kernel can be obtained with minimum computing time. The CPU cost required with this new extension of the image subtraction method is almost the…

Astrophysics · Physics 2007-05-23 C. Alard

An optimal transport (OT) problem seeks to find the cheapest mapping between two distributions with equal total density, given the cost of transporting density from one place to another. Unbalanced OT allows for different total density in…

Optimization and Control · Mathematics 2025-07-28 Jacob J. M. Francis , Colin J. Cotter , Marion P. Mittermaier

Computational optimal transport (OT) has recently emerged as a powerful framework with applications in various fields. In this paper we focus on a relaxation of the original OT problem, the entropic OT problem, which allows to implement…

Probability · Mathematics 2025-10-06 Giacomo Greco , Maxence Noble , Giovanni Conforti , Alain Durmus

The size of large, geo-located datasets has reached scales where visualization of all data points is inefficient. Random sampling is a method to reduce the size of a dataset, yet it can introduce unwanted errors. We describe a method for…

Human-Computer Interaction · Computer Science 2017-09-14 Yan Zheng , Yi Ou , Alexander Lex , Jeff M. Phillips

We give an efficient perfect sampling algorithm for weighted, connected induced subgraphs (or graphlets) of rooted, bounded degree graphs. Our algorithm utilizes a vertex-percolation process with a carefully chosen rejection filter and…

Data Structures and Algorithms · Computer Science 2023-11-17 Antonio Blanca , Sarah Cannon , Will Perkins

Coresets are modern data-reduction tools that are widely used in data analysis to improve efficiency in terms of running time, space and communication complexity. Our main result is a fast algorithm to construct a small coreset for k-Median…

Data Structures and Algorithms · Computer Science 2020-07-16 Vladimir Braverman , Shaofeng H. -C. Jiang , Robert Krauthgamer , Xuan Wu

We present a new framework to address the non-convex robust hypothesis testing problem, wherein the goal is to seek the optimal detector that minimizes the maximum of worst-case type-I and type-II risk functions. The distributional…

Machine Learning · Statistics 2024-03-25 Jie Wang , Rui Gao , Yao Xie

Classical stochastic control assumes perfect knowledge of the uncertainty affecting the plant. In practice, however, such information is often incomplete. To address this limitation, we consider a distributionally robust control (DRC)…

Systems and Control · Electrical Eng. & Systems 2026-05-06 Riccardo Cescon , Andrea Martin , Giancarlo Ferrari-Trecate

Deep Learning models have transformed various domains, including the healthcare sector, particularly biomedical image classification by learning intricate features and enabling accurate diagnostics pertaining to complex diseases. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Imran Ashraf , Mukhtar Ullah , Muhammad Faisal Nadeem , Muhammad Nouman Noor

Sinkhorn algorithm has been used pervasively to approximate the solution to optimal transport (OT) and unbalanced optimal transport (UOT) problems. However, its practical application is limited due to the high computational complexity. To…

Machine Learning · Statistics 2026-04-07 Mengyu Li , Jun Yu , Tao Li , Cheng Meng