English
Related papers

Related papers: Dimensionality Reduction using Similarity-induced …

200 papers

Matching information across image and text modalities is a fundamental challenge for many applications that involve both vision and natural language processing. The objective is to find efficient similarity metrics to compare the similarity…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Li Ren , Kai Li , LiQiang Wang , Kien Hua

Dimensionality reduction (DR) is one of the key tools for the visual exploration of high-dimensional data and uncovering its cluster structure in two- or three-dimensional spaces. The vast majority of DR methods in the literature do not…

Machine Learning · Computer Science 2026-04-28 Stavros Gerolymatos , Xenophon Evangelopoulos , Vladimir Gusev , John Y. Goulermas

Due to the intrinsic complexity of high-dimensional (HD) data, dimensionality reduction (DR) techniques cannot preserve all the structural characteristics of the original data. Therefore, DR techniques focus on preserving either local…

Machine Learning · Computer Science 2025-11-18 Hyeon Jeon , Kwon Ko , Soohyun Lee , Jake Hyun , Taehyun Yang , Gyehun Go , Jaemin Jo , Jinwook Seo

Eye image segmentation is a critical step in eye tracking that has great influence over the final gaze estimate. Segmentation models trained using supervised machine learning can excel at this task, their effectiveness is determined by the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Viet Dung Nguyen , Reynold Bailey , Gabriel J. Diaz , Chengyi Ma , Alexander Fix , Alexander Ororbia

Unsupervised learning aims to capture the underlying structure of potentially large and high-dimensional datasets. Traditionally, this involves using dimensionality reduction (DR) methods to project data onto lower-dimensional spaces or…

Machine Learning · Computer Science 2025-06-30 Hugues Van Assel , Cédric Vincent-Cuaz , Nicolas Courty , Rémi Flamary , Pascal Frossard , Titouan Vayer

This report concerns the problem of dimensionality reduction through information geometric methods on statistical manifolds. While there has been considerable work recently presented regarding dimensionality reduction for the purposes of…

Machine Learning · Statistics 2008-09-30 Kevin M. Carter , Raviv Raich , Alfred O. Hero

While traditional Deep Learning (DL) optimization methods treat all training samples equally, Distributionally Robust Optimization (DRO) adaptively assigns importance weights to different samples. However, a significant gap exists between…

Image retrieval methods rely on metric learning to train backbone feature extraction models that can extract discriminant queries and reference (gallery) feature representations for similarity matching. Although state-of-the-art accuracy…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Madhu Kiran , Kartikey Vishnu , Rafael M. O. Cruz , Eric Granger

This paper discusses the critical decision process of extracting or selecting the features in a supervised learning context. It is often confusing to find a suitable method to reduce dimensionality. There are pros and cons to deciding…

Machine Learning · Computer Science 2022-06-22 Jean-Sébastien Dessureault , Daniel Massicotte

The quest for simplification in physics drives the exploration of concise mathematical representations for complex systems. This Dissertation focuses on the concept of dimensionality reduction as a means to obtain low-dimensional…

Machine Learning · Computer Science 2024-10-31 Eslam Abdelaleem

Dimensionality reduction (DR) techniques map high-dimensional data into lower-dimensional spaces. Yet, current DR techniques are not designed to explore semantic structure that is not directly available in the form of variables or class…

Machine Learning · Computer Science 2025-06-19 Artur André Oliveira , Mateus Espadoto , Roberto Hirata , Roberto M. Cesar , Alex C. Telea

Objective functions that optimize deep neural networks play a vital role in creating an enhanced feature representation of the input data. Although cross-entropy-based loss formulations have been extensively used in a variety of supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Deen Dayal Mohan , Bhavin Jawade , Srirangaraj Setlur , Venu Govindaraj

Deep Metric Learning (DML) is arguably one of the most influential lines of research for learning visual similarities with many proposed approaches every year. Although the field benefits from the rapid progress, the divergence in training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Karsten Roth , Timo Milbich , Samarth Sinha , Prateek Gupta , Björn Ommer , Joseph Paul Cohen

Dimensionality reduction (DR) on the manifold includes effective methods which project the data from an implicit relational space onto a vectorial space. Regardless of the achievements in this area, these algorithms suffer from the lack of…

Machine Learning · Computer Science 2019-09-23 Babak Hosseini , Barbara Hammer

Dimension reduction (DR) is commonly utilized to capture the intrinsic structure and transform high-dimensional data into low-dimensional space while retaining meaningful properties of the original data. It is used in various applications,…

Machine Learning · Computer Science 2022-11-29 Zelin Zang , Shenghui Cheng , Linyan Lu , Hanchen Xia , Liangyu Li , Yaoting Sun , Yongjie Xu , Lei Shang , Baigui Sun , Stan Z. Li

Dimension reduction is often the first step in statistical modeling or prediction of multivariate spatial data. However, most existing dimension reduction techniques do not account for the spatial correlation between observations and do not…

Methodology · Statistics 2025-05-27 Si Cheng , Magali N. Blanco , Timothy V. Larson , Lianne Sheppard , Adam Szpiro , Ali Shojaie

Many dimension reduction techniques have been developed for independent data, and most have also been extended to time series. However, these methods often fail to account for the dynamic dependencies both within and across series. In this…

Methodology · Statistics 2025-09-25 Daniel Peña , Victor J. Yohai

Real-world data usually have high dimensionality and it is important to mitigate the curse of dimensionality. High-dimensional data are usually in a coherent structure and make the data in relatively small true degrees of freedom. There are…

Machine Learning · Computer Science 2021-03-12 Xiang Wang , Xiaoyong Li , Junxing Zhu , Zichen Xu , Kaijun Ren , Weiming Zhang , Xinwang Liu , Kui Yu

Different unsupervised models for dimensionality reduction like PCA, LLE, Shannon's mapping, tSNE, UMAP, etc. work on different principles, hence, they are difficult to compare on the same ground. Although they are usually good for…

Methodology · Statistics 2024-05-10 Subhrajyoty Roy

There has been a lot of interest in sufficient dimension reduction (SDR) methodologies as well as nonlinear extensions in the statistics literature. In this note, we use classical results regarding metric spaces and positive definite…

Methodology · Statistics 2020-10-29 Youngjoo Cho , Debashis Ghosh