English
Related papers

Related papers: Adaptive Neighboring Selection Algorithm Based on …

200 papers

Matching datasets of multiple modalities has become an important task in data analysis. Existing methods often rely on the embedding and transformation of each single modality without utilizing any correspondence information, which often…

Machine Learning · Statistics 2024-06-27 Cencheng Shen , Joshua T. Vogelstein , Carey E. Priebe

We explore and expand the $\textit{Soft Nearest Neighbor Loss}$ to measure the $\textit{entanglement}$ of class manifolds in representation space: i.e., how close pairs of points from the same class are relative to pairs of points from…

Machine Learning · Statistics 2019-02-07 Nicholas Frosst , Nicolas Papernot , Geoffrey Hinton

Manifold learning techniques have become increasingly valuable as data continues to grow in size. By discovering a lower-dimensional representation (embedding) of the structure of a dataset, manifold learning algorithms can substantially…

Neural and Evolutionary Computing · Computer Science 2020-01-31 Andrew Lensen , Mengjie Zhang , Bing Xue

We formulate the manifold learning problem as the problem of finding an operator that maps any point to a close neighbor that lies on a ``hidden'' $k$-dimensional manifold. We call this operator the correcting function. Under this…

Machine Learning · Computer Science 2023-06-27 Rustem Takhanov , Y. Sultan Abylkairov , Maxat Tezekbayev

This paper presents a new scalable algorithm for cross-modal similarity preserving retrieval in a learnt manifold space. Unlike existing approaches that compromise between preserving global and local geometries, the proposed technique…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Sailesh Conjeti , Anees Kazi , Nassir Navab , Amin Katouzian

Uniform Manifold Approximation and Projection (UMAP) is a widely used manifold learning technique for dimensionality reduction. This paper studies UMAP, supervised UMAP, and several competing dimensionality reduction methods, including…

Machine Learning · Computer Science 2026-05-04 Guanzhe Zhang , Shanshan Ding , Zhezhen Jin

Local Linear embedding (LLE) is a popular dimension reduction method. In this paper, we first show LLE with nonnegative constraint is equivalent to the widely used Laplacian embedding. We further propose to iterate the two steps in LLE…

Machine Learning · Computer Science 2012-07-03 Deguang Kong , Chris H. Q. Ding , Heng Huang , Feiping Nie

This paper considers the problem of finding a meaningful template function that represents the common pattern of a sample of curves. To address this issue, a novel algorithm based on a robust version of the isometric featuring mapping…

Statistics Theory · Mathematics 2013-06-17 Chloé Dimeglio , Santiago Gallón , Jean-Michel Loubes , Elie Maza

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

Interpolation methodologies have been widely used within the domain of indoor positioning systems. However, existing indoor positioning interpolation algorithms exhibit several inherent limitations, including reliance on complex…

Machine Learning · Computer Science 2023-11-28 Suorong Yang , Geng Zhang , Jian Zhao , Furao Shen

In this paper, we propose an ensemble learning algorithm called \textit{under-bagging $k$-nearest neighbors} (\textit{under-bagging $k$-NN}) for imbalanced classification problems. On the theoretical side, by developing a new learning…

Machine Learning · Statistics 2021-09-03 Hanyuan Hang , Yuchao Cai , Hanfang Yang , Zhouchen Lin

We introduce ORC-ManL, a new algorithm to prune spurious edges from nearest neighbor graphs using a criterion based on Ollivier-Ricci curvature and estimated metric distortion. Our motivation comes from manifold learning: we show that when…

Machine Learning · Computer Science 2025-07-30 Tristan Luca Saidi , Abigail Hickok , Andrew J. Blumberg

A novel method, named Curvature-Augmented Manifold Embedding and Learning (CAMEL), is proposed for high dimensional data classification, dimension reduction, and visualization. CAMEL utilizes a topology metric defined on the Riemannian…

Machine Learning · Computer Science 2024-01-17 Nan Xu , Yongming Liu

Explicitly or implicitly, most of dimensionality reduction methods need to determine which samples are neighbors and the similarity between the neighbors in the original highdimensional space. The projection matrix is then learned on the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Yanwei Pang , Bo Zhou , Feiping Nie

The adaptive cubic regularization algorithm employing the inexact gradient and Hessian is proposed on general Riemannian manifolds, together with the iteration complexity to get an approximate second-order optimality under certain…

Optimization and Control · Mathematics 2024-05-07 Z. Y. Li , X. M. Wang

The traditional k nearest neighbor (kNN) approach uses a distance formula within a spherical region to determine the k closest training observations to a test sample point. However, this approach may not work well when test point is located…

Machine Learning · Statistics 2024-02-19 Amjad Ali , Zardad Khan , Dost Muhammad Khan , Saeed Aldahmani

CLIP retrieval is typically framed as a pointwise similarity problem in a shared embedding space. While CLIP achieves strong global cross-modal alignment, many retrieval failures arise from local geometric inconsistencies: nearby items are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Nirmalendu Prakash , Narmeen Fatimah Oozeer , Xin Su , Phillip Howard , Shaan Shah , Zoe Wanying He , Shuang Wu , Shivam Raval , Roy Ka-Wei Lee , Meenakshi Khosla , Amir Abdullah

The popular neighbor-joining (NJ) algorithm used in phylogenetics is a greedy algorithm for finding the balanced minimum evolution (BME) tree associated to a dissimilarity map. From this point of view, NJ is ``optimal'' when the algorithm…

Quantitative Methods · Quantitative Biology 2007-10-29 Kord Eickmeyer , Peter Huggins , Lior Pachter , Ruriko Yoshida

Stochastic neighbor embedding (SNE) and related nonlinear manifold learning algorithms achieve high-quality low-dimensional representations of similarity data, but are notoriously slow to train. We propose a generic formulation of embedding…

Machine Learning · Computer Science 2012-06-22 Max Vladymyrov , Miguel Carreira-Perpinan

Non-linear dimensionality reduction can be performed by \textit{manifold learning} approaches, such as Stochastic Neighbour Embedding (SNE), Locally Linear Embedding (LLE) and Isometric Feature Mapping (ISOMAP). These methods aim to produce…

Machine Learning · Statistics 2021-12-09 Theodoulos Rodosthenous , Vahid Shahrezaei , Marina Evangelou