English
Related papers

Related papers: Median Consensus Embedding for Dimensionality Redu…

200 papers

Sparse random projection (RP) is a popular tool for dimensionality reduction that shows promising performance with low computational complexity. However, in the existing sparse RP matrices, the positions of non-zero entries are usually…

Machine Learning · Computer Science 2020-02-10 Li Chen , Shuizheng Zhou , Jiajun Ma

We present the marginal unbiased score expansion (MUSE) method, an algorithm for generic high-dimensional hierarchical Bayesian inference. MUSE performs approximate marginalization over arbitrary non-Gaussian latent parameter spaces,…

Cosmology and Nongalactic Astrophysics · Physics 2022-06-01 Marius Millea , Uros Seljak

Random embeddings project high-dimensional spaces to low-dimensional ones; they are careful constructions which allow the approximate preservation of key properties, such as the pair-wise distances between points. Often in the field of…

Optimization and Control · Mathematics 2022-06-08 Zhen Shao

The Wasserstein distance received a lot of attention recently in the community of machine learning, especially for its principled way of comparing distributions. It has found numerous applications in several hard problems, such as domain…

Machine Learning · Statistics 2017-10-23 Nicolas Courty , Rémi Flamary , Mélanie Ducoffe

The isometric embedding of surfaces in three-dimensional space is fundamental to various physical systems, from elastic sheets to programmable materials. While continuous surfaces typically admit unique solutions under suitable boundary…

Disordered Systems and Neural Networks · Physics 2025-05-13 Kyungeun Kim , Christian D. Santangelo

Multidimensional scaling (MDS) is a family of methods that embed a given set of points into a simple, usually flat, domain. The points are assumed to be sampled from some metric space, and the mapping attempts to preserve the distances…

Computational Geometry · Computer Science 2014-03-05 Yonathan Aflalo , Anastasia Dubrovina , Ron Kimmel

During the last decades, learning a low-dimensional space with discriminative information for dimension reduction (DR) has gained a surge of interest. However, it's not accessible for these DR methods to achieve satisfactory performance…

Machine Learning · Computer Science 2019-11-19 Xiangzhu Meng , Huibing Wang , Lin Feng

Multidimensional scaling (MDS) is a popular dimensionality reduction techniques that has been widely used for network visualization and cooperative localization. However, the traditional stress minimization formulation of MDS necessitates…

Optimization and Control · Mathematics 2016-12-22 Ketan Rajawat , Sandeep Kumar

We consider the problem of distributed mean estimation (DME), in which $n$ machines are each given a local $d$-dimensional vector $x_v \in \mathbb{R}^d$, and must cooperate to estimate the mean of their inputs $\mu = \frac 1n\sum_{v = 1}^n…

Machine Learning · Computer Science 2021-04-08 Peter Davies , Vijaykrishna Gurunathan , Niusha Moshrefi , Saleh Ashkboos , Dan Alistarh

The identification of parameters in mathematical models using noisy observations is a common task in uncertainty quantification. We employ the framework of Bayesian inversion: we combine monitoring and observational data with prior…

Computation · Statistics 2018-05-11 Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

Partial Differential Equations (PDEs) are fundamental for modeling physical systems, yet solving them in a generic and efficient manner using machine learning-based approaches remains challenging due to limited multi-input and multi-scale…

Machine Learning · Computer Science 2025-08-12 Yichen Luo , Jia Wang , Dapeng Lan , Yu Liu , Zhibo Pang

Unsupervised embeddings are fundamental to numerous machine learning applications, yet their evaluation remains a challenging task. Traditional assessment methods often rely on extrinsic variables, such as performance in downstream tasks,…

Machine Learning · Computer Science 2024-08-01 Steven N. Hart , Thomas E. Tavolara

In this note we discuss a common misconception, namely that embeddings are always used to reduce the dimensionality of the item space. We show that when we measure dimensionality in terms of information entropy then the embedding of sparse…

Machine Learning · Computer Science 2019-01-09 Maxim Naumov

Embedding a web-scale information network into a low-dimensional vector space facilitates tasks such as link prediction, classification, and visualization. Past research has addressed the problem of extracting such embeddings by adopting…

Social and Information Networks · Computer Science 2018-03-14 Anton Tsitsulin , Davide Mottin , Panagiotis Karras , Emmanuel Müller

We develop a formal statistical framework for classical multidimensional scaling (CMDS) applied to noisy dissimilarity data. We establish distributional convergence results for the embeddings produced by CMDS for various noise models, which…

Statistics Theory · Mathematics 2025-10-28 Siddharth Vishwanath , Ery Arias-Castro

Metric embedding has become a common technique in the design of algorithms. Its applicability is often dependent on how high the embedding's distortion is. For example, embedding finite metric space into trees may require linear distortion…

Data Structures and Algorithms · Computer Science 2007-05-23 Yair Bartal , Manor Mendel

To address the dual challenges of the curse of dimensionality and the difficulty in separating intra-cluster and inter-cluster structures in high-dimensional manifold embedding, we proposes an Adaptive Multi-Scale Manifold Embedding (AMSME)…

Machine Learning · Computer Science 2025-03-20 Tianhao Ni , Bingjie Li , Zhigang Yao

This paper proposes a consensus-based distributed nonlinear filter with kernel mean embedding (KME). This fills with gap of posterior density approximation with KME for distributed nonlinear dynamic systems. To approximate the posterior…

Systems and Control · Electrical Eng. & Systems 2023-12-05 Liping Guo , Jimin Wang , Yanlong Zhao , Ji-Feng Zhang

Loss functions play a crucial role in deep metric learning thus a variety of them have been proposed. Some supervise the learning process by pairwise or tripletwise similarity constraints while others take advantage of structured similarity…

Machine Learning · Computer Science 2019-11-25 Xinshao Wang , Elyor Kodirov , Yang Hua , Neil Robertson

Previous work has established that neural network-based node embeddings return different outcomes when trained with identical parameters on the same dataset, just from using different training seeds. Yet, it has not been thoroughly analyzed…

Machine Learning · Computer Science 2026-04-10 Tobias Schumacher , Simon Reichelt , Markus Strohmaier