English
Related papers

Related papers: E-ROBOT: a dimension-free method for robust statis…

200 papers

Centipede-like robots offer an effective and robust solution to navigation over complex terrain with minimal sensing. However, when climbing over obstacles, such multi-legged robots often elevate their center-of-mass into unstable…

Robotics · Computer Science 2024-10-03 Erik Teder , Baxi Chong , Juntao He , Tianyu Wang , Massimiliano Iaschi , Daniel Soto , Daniel I Goldman

Despite the success of deep learning-based algorithms, it is widely known that neural networks may fail to be robust. A popular paradigm to enforce robustness is adversarial training (AT), however, this introduces many computational and…

Machine Learning · Computer Science 2024-01-18 Nicolas Garcia Trillos , Matt Jacobs , Jakwang Kim , Matthew Werenski

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is…

Machine Learning · Statistics 2020-07-13 François-Pierre Paty , Alexandre d'Aspremont , Marco Cuturi

This paper is focused on the study of entropic regularization in optimal transport as a smoothing method for Wasserstein estimators, through the prism of the classical tradeoff between approximation and estimation errors in statistics.…

Machine Learning · Statistics 2024-10-30 Jérémie Bigot , Paul Freulon , Boris P. Hejblum , Arthur Leclaire

This letter investigates dynamical optimal transport of underactuated linear systems over an infinite time horizon. In our previous work, we proposed to integrate model predictive control and the celebrated Sinkhorn algorithm to perform…

Optimization and Control · Mathematics 2023-08-16 Kaito Ito , Kenji Kashima

We introduce the setting of extended metric-topological measure spaces as a general "Wiener-like" framework for optimal transport problems and nonsmooth metric analysis in infinite dimension. After a brief review of optimal transport tools…

Functional Analysis · Mathematics 2015-06-22 Luigi Ambrosio , Matthias Erbar , Giuseppe Savaré

The problem of robust mean estimation in high dimensions is studied, in which a certain fraction (less than half) of the datapoints can be arbitrarily corrupted. Motivated by compressive sensing, the robust mean estimation problem is…

Applications · Statistics 2022-12-08 Aditya Deshmukh , Jing Liu , Venugopal V. Veeravalli

We propose an unsupervised approach for learning end-to-end reconstruction operators for ill-posed inverse problems. The proposed method combines the classical variational framework with iterative unrolling, which essentially seeks to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Subhadip Mukherjee , Marcello Carioni , Ozan Öktem , Carola-Bibiane Schönlieb

This paper focuses on designing edge-weighted networks, whose robustness is characterized by maximizing algebraic connectivity, or the second smallest eigenvalue of the Laplacian matrix. This problem is motivated by cooperative vehicle…

Systems and Control · Electrical Eng. & Systems 2024-03-20 Neelkamal Somisetty , Harsha Nagarajan , Swaroop Darbha

Despite many applications, dimensionality reduction in the $\ell_1$-norm is much less understood than in the Euclidean norm. We give two new oblivious dimensionality reduction techniques for the $\ell_1$-norm which improve exponentially…

Data Structures and Algorithms · Computer Science 2021-08-09 Yi Li , David P. Woodruff , Taisuke Yasuda

The JKO scheme is a time-discrete scheme of implicit Euler type that allows to construct weak solutions of evolution PDEs which have a Wasserstein gradient structure. The purpose of this work is to study the effect of replacing the…

Analysis of PDEs · Mathematics 2025-02-19 Aymeric Baradat , Anastasiia Hraivoronska , Filippo Santambrogio

Optimal transport (OT) and maximum mean discrepancies (MMD) are now routinely used in machine learning to compare probability measures. We focus in this paper on \emph{Sinkhorn divergences} (SDs), a regularized variant of OT distances which…

Statistics Theory · Mathematics 2019-10-16 Aude Genevay , Lénaic Chizat , Francis Bach , Marco Cuturi , Gabriel Peyré

Wasserstein distributionally robust optimization (DRO) has gained prominence in operations research and machine learning as a powerful method for achieving solutions with favorable out-of-sample performance. Two compelling explanations for…

Machine Learning · Computer Science 2024-12-23 Qinyu Wu , Jonathan Yu-Meng Li , Tiantian Mao

Sinkhorn algorithm is the de-facto standard approximation algorithm for optimal transport, which has been applied to a variety of applications, including image processing and natural language processing. In theory, the proof of its…

Data Structures and Algorithms · Computer Science 2025-01-14 Kazuki Watanabe , Noboru Isobe

In this paper, we propose an accelerated version for the Sinkhorn algorithm, which is the reference method for computing the solution to Entropic Optimal Transport. Its main draw-back is the exponential slow-down of convergence as the…

Numerical Analysis · Mathematics 2025-06-19 Reda Chhaibi , Serge Gratton , Samuel Vaiter

Most existing distance metric learning methods assume perfect side information that is usually given in pairwise or triplet constraints. Instead, in many real-world applications, the constraints are derived from side information, such as…

Machine Learning · Computer Science 2012-03-19 Kaizhu Huang , Rong Jin , Zenglin Xu , Cheng-Lin Liu

The power and flexibility of Optimal Transport (OT) have pervaded a wide spectrum of problems, including recent Machine Learning challenges such as unsupervised domain adaptation. Its essence of quantitatively relating two probability…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Bo Jiang , Hamid Krim , Tianfu Wu , Derya Cansever

Leveraging connections between diffusion-based sampling, optimal transport, and stochastic optimal control through their shared links to the Schr\"odinger bridge problem, we propose novel objective functions that can be used to transport…

Machine Learning · Statistics 2024-10-11 Qijia Jiang , David Nabergoj

Trajectory optimization and model predictive control are essential techniques underpinning advanced robotic applications, ranging from autonomous driving to full-body humanoid control. State-of-the-art algorithms have focused on data-driven…

Systems and Control · Electrical Eng. & Systems 2021-11-15 Hany Abdulsamad , Tim Dorau , Boris Belousov , Jia-Jie Zhu , Jan Peters

In this paper, we propose a new framework named Communication Optimal Transport (CommOT) for computing the rate distortion (RD) function. This work is motivated by observing the fact that the transition law and the relative entropy in…

Information Theory · Computer Science 2022-12-21 Shitong Wu , Wenhao Ye , Hao Wu , Huihui Wu , Wenyi Zhang , Bo Bai