English
Related papers

Related papers: Dimensionality Reduction has Quantifiable Imperfec…

200 papers

Wasserstein distributionally robust optimization (DRO) has gained prominence in operations research and machine learning as a powerful method for achieving solutions with favorable out-of-sample performance. Two compelling explanations for…

Machine Learning · Computer Science 2024-12-23 Qinyu Wu , Jonathan Yu-Meng Li , Tiantian Mao

Motivated by the Bures distance, we introduce a new family of distances, \emph{relative translation invariant Wasserstein distances}, denoted by $RW_p$, as an extension of the classical Wasserstein distances $W_p$ for $p \in [1, +\infty)$.…

Machine Learning · Computer Science 2026-05-26 Binshuai Wang , Qiwei Di , Ming Yin , Mengdi Wang , Quanquan Gu , Peng Wei

Diffusion generative models have emerged as powerful tools for producing synthetic data from an empirically observed distribution. A common approach involves simulating the time-reversal of an Ornstein-Uhlenbeck (OU) process initialized at…

Machine Learning · Statistics 2025-12-02 Valentin de Bortoli , Romuald Elie , Anna Kazeykina , Zhenjie Ren , Jiacheng Zhang

Distributionally Robust Optimization (DRO) provides a framework for decision-making under distributional uncertainty, yet its effectiveness can be compromised by outliers in the training data. This paper introduces a principled approach to…

Machine Learning · Computer Science 2025-11-04 Shuyao Li , Ilias Diakonikolas , Jelena Diakonikolas

We study the problem of approximately recovering a probability distribution given noisy measurements of its Chebyshev polynomial moments. This problem arises broadly across algorithms, statistics, and machine learning. By leveraging a…

Data Structures and Algorithms · Computer Science 2026-05-20 Cameron Musco , Christopher Musco , Lucas Rosenblatt , Apoorv Vikram Singh

We derive generalization error bounds for the training of two-layer neural networks without assuming boundedness of the loss function, using Wasserstein distance estimates on the discrepancy between a probability distribution and its…

Machine Learning · Statistics 2026-04-09 Jiang Yu Nguwi , Nicolas Privault

Consider the task of locating an unknown target point using approximate distance queries: in each round, a reconstructor selects a query point and receives a noisy version of its distance to the target. This problem arises naturally in…

Machine Learning · Computer Science 2025-11-11 Shay Moran , Elizaveta Nesterova

Wasserstein distances define a metric between probability measures on arbitrary metric spaces, including meta-measures (measures over measures). The resulting Wasserstein over Wasserstein (WoW) distance is a powerful, but computationally…

Machine Learning · Computer Science 2026-02-20 Moritz Piening , Robert Beinert

Dimensionality reduction can be applied to hyperspectral images so that the most useful data can be extracted and processed more quickly. This is critical in any situation in which data volume exceeds the capacity of the computational…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Daniela Lupu , Joseph L. Garrett , Tor Arne Johansen , Milica Orlandic , Ion Necoara

Motivated by the application of neural networks in super resolution microscopy, this paper considers super resolution as the mapping of trigonometric moments of a discrete measure on $[0,1)^d$ to its support and weights. We prove that this…

Numerical Analysis · Mathematics 2021-08-27 Mathias Hockmann , Stefan Kunis

Projection robust Wasserstein (PRW) distance, or Wasserstein projection pursuit (WPP), is a robust variant of the Wasserstein distance. Recent work suggests that this quantity is more robust than the standard Wasserstein distance, in…

Machine Learning · Computer Science 2023-01-03 Tianyi Lin , Chenyou Fan , Nhat Ho , Marco Cuturi , Michael I. Jordan

Under general assumptions on the target distribution $p^\star$, we establish a sharp Lipschitz regularity theory for flow-matching vector fields and diffusion-model scores, with optimal dependence on time and dimension. As applications, we…

Statistics Theory · Mathematics 2026-04-08 Arthur Stéphanovitch

Dimensionality reduction (DR) techniques map high-dimensional data into lower-dimensional spaces. Yet, current DR techniques are not designed to explore semantic structure that is not directly available in the form of variables or class…

Machine Learning · Computer Science 2025-06-19 Artur André Oliveira , Mateus Espadoto , Roberto Hirata , Roberto M. Cesar , Alex C. Telea

We study distributionally robust optimization (DRO) problems with uncertainty sets consisting of high-dimensional random vectors that are close in the multivariate Wasserstein distance to a reference random vector. We give conditions when…

Optimization and Control · Mathematics 2026-01-30 Brandon Tam , Silvana M. Pesenti

In the theory of lossy compression, the rate-distortion (R-D) function $R(D)$ describes how much a data source can be compressed (in bit-rate) at any given level of fidelity (distortion). Obtaining $R(D)$ for a given data source establishes…

Information Theory · Computer Science 2023-10-31 Yibo Yang , Stephan Eckstein , Marcel Nutz , Stephan Mandt

We consider the general dimensionality reduction problem of locating in a high-dimensional data cloud, a $k$-dimensional non-Gaussian subspace of interesting features. We use a projection pursuit approach -- we search for mutually…

Machine Learning · Computer Science 2023-02-27 Satyaki Mukherjee , Soumendu Sundar Mukherjee , Debarghya Ghoshdastidar

In this paper, we consider the problem of phase retrieval, which consists of recovering an $n$-dimensional real vector from the magnitude of its $m$ linear measurements. We propose a mirror descent (or Bregman gradient descent) algorithm…

Optimization and Control · Mathematics 2024-06-21 Jean-Jacques Godeme , Jalal Fadili , Xavier Buet , Myriam Zerrad , Michel Lequime , Claude Amra

Depth estimation features are helpful for 3D recognition. Commodity-grade depth cameras are able to capture depth and color image in real-time. However, glossy, transparent or distant surface cannot be scanned properly by the sensor. As a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Yu-Kai Huang , Tsung-Han Wu , Yueh-Cheng Liu , Winston H. Hsu

Common measures of neural representational (dis)similarity are designed to be insensitive to rotations and reflections of the neural activation space. Motivated by the premise that the tuning of individual units may be important, there has…

Machine Learning · Computer Science 2023-11-17 Meenakshi Khosla , Alex H. Williams

Despite superior performance in many situations, deep neural networks are often vulnerable to adversarial examples and distribution shifts, limiting model generalization ability in real-world applications. To alleviate these problems,…

Machine Learning · Computer Science 2023-02-14 Hoang Phan , Trung Le , Trung Phung , Tuan Anh Bui , Nhat Ho , Dinh Phung