English
Related papers

Related papers: Dimensionality Reduction has Quantifiable Imperfec…

200 papers

Bayesian optimization is a principled optimization strategy for a black-box objective function. It shows its effectiveness in a wide variety of real-world applications such as scientific discovery and experimental design. In general, the…

Machine Learning · Computer Science 2024-11-11 Jungtaek Kim

We propose a variational approach to approximate measures with measures uniformly distributed over a 1 dimentional set. The problem consists in minimizing a Wasserstein distance as a data term with a regularization given by the length of…

Analysis of PDEs · Mathematics 2024-10-17 Antonin Chambolle , Vincent Duval , Joao Miguel Machado

Depth perception is considered an invaluable source of information in the context of 3D mapping and various robotics applications. However, point cloud maps acquired using consumer-level light detection and ranging sensors (lidars) still…

Robotics · Computer Science 2024-05-24 Ruslan Agishev , Tomáš Pětříček , Karel Zimmermann

Sinkhorn divergence is a measure of dissimilarity between two probability measures. It is obtained through adding an entropic regularization term to Kantorovich's optimal transport problem and can hence be viewed as an entropically…

Numerical Analysis · Mathematics 2020-05-01 Mohammad Motamed

We study the problem of reconstructing the latent geometry of a $d$-dimensional Riemannian manifold from a random geometric graph. While recent works have made significant progress in manifold recovery from random geometric graphs, and more…

Machine Learning · Statistics 2026-04-02 Han Huang , Pakawut Jiradilok , Elchanan Mossel

Moment-based distributionally robust optimization (DRO) provides an optimization framework to integrate statistical information with traditional optimization approaches. Under this framework, one assumes that the underlying joint…

Optimization and Control · Mathematics 2023-11-01 Shiyi Jiang , Jianqiang Cheng , Kai Pan , Zuo-Jun Max Shen

Uniformity testing and the more general identity testing are well studied problems in distributional property testing. Most previous work focuses on testing under $L_1$-distance. However, when the support is very large or even continuous,…

Machine Learning · Computer Science 2017-10-31 Shichuan Deng , Wenzheng Li , Xuan Wu

Uniformity plays an important role in evaluating learned representations, providing insights into self-supervised learning. In our quest for effective uniformity metrics, we pinpoint four principled properties that such metrics should…

Machine Learning · Computer Science 2024-04-29 Xianghong Fang , Jian Li , Qiang Sun , Benyou Wang

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

Machine Learning · Statistics 2024-08-06 Ryan Murray , Adam Pickarski

Dimension reduction techniques typically seek an embedding of a high-dimensional point cloud into a low-dimensional Euclidean space which optimally preserves the geometry of the input data. Based on expert knowledge, one may instead wish to…

Optimization and Control · Mathematics 2025-02-28 Ranthony A. Clark , Tom Needham , Thomas Weighill

This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally…

Systems and Control · Electrical Eng. & Systems 2024-03-22 Himanshu Prabhat , Raktim Bhattacharya

This report concerns the problem of dimensionality reduction through information geometric methods on statistical manifolds. While there has been considerable work recently presented regarding dimensionality reduction for the purposes of…

Machine Learning · Statistics 2008-09-30 Kevin M. Carter , Raviv Raich , Alfred O. Hero

This paper addresses the challenge of dimension reduction (DR) in Bayesian inference of high-resolution two-or three-dimensional fields, where a priori parametrizations require a large number of terms. The underlying idea is common to…

Numerical Analysis · Mathematics 2026-04-16 Nadège Polette , Olivier Le Maître , Pierre Sochala , Alexandrine Gesret

Dimensionality reduction methods are unsupervised approaches which learn low-dimensional spaces where some properties of the initial space, typically the notion of "neighborhood", are preserved. Such methods usually require propagation on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Yannis Kalantidis , Carlos Lassance , Jon Almazan , Diane Larlus

The Wasserstein distance is a powerful metric based on the theory of optimal transport. It gives a natural measure of the distance between two distributions with a wide range of applications. In contrast to a number of the common…

Machine Learning · Computer Science 2021-02-16 Jung Hun Oh , Maryam Pouryahya , Aditi Iyer , Aditya P. Apte , Allen Tannenbaum , Joseph O. Deasy

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

Machine Learning · Computer Science 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos

Channel Charting is a dimensionality reduction technique that learns to reconstruct a low-dimensional, physically interpretable map of the radio environment by taking advantage of similarity relationships found in high-dimensional channel…

Information Theory · Computer Science 2024-12-03 Florian Euchner , Phillip Stephan , Stephan ten Brink

We consider the problem of sufficient dimensionality reduction (SDR), where the high-dimensional observation is transformed to a low-dimensional sub-space in which the information of the observations regarding the label variable is…

Machine Learning · Computer Science 2018-12-20 Ershad Banijamali , Amir-Hossein Karimi , Ali Ghodsi

The Euclidean distance geometry problem arises in a wide variety of applications, from determining molecular conformations in computational chemistry to localization in sensor networks. When the distance information is incomplete, the…

Information Theory · Computer Science 2018-10-30 Abiy Tasissa , Rongjie Lai

Depth maps captured with commodity sensors are often of low quality and resolution; these maps need to be enhanced to be used in many applications. State-of-the-art data-driven methods of depth map super-resolution rely on registered pairs…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Aleksandr Safin , Maxim Kan , Nikita Drobyshev , Oleg Voynov , Alexey Artemov , Alexander Filippov , Denis Zorin , Evgeny Burnaev