English
Related papers

Related papers: Revisiting Dimensionality Reduction Techniques for…

200 papers

Traditional clustering methods often perform clustering with low-level indiscriminative representations and ignore relationships between patterns, resulting in slight achievements in the era of deep learning. To handle this problem, we…

Machine Learning · Computer Science 2019-05-07 Jianlong Chang , Yiwen Guo , Lingfeng Wang , Gaofeng Meng , Shiming Xiang , Chunhong Pan

In this paper, we present a Mirroring Neural Network architecture to perform non-linear dimensionality reduction and Object Recognition using a reduced lowdimensional characteristic vector. In addition to dimensionality reduction, the…

Computer Vision and Pattern Recognition · Computer Science 2008-12-13 Dasika Ratna Deepthi , Sujeet Kuchibhotla , K. Eswaran

In this work, we study distance metric learning (DML) for high dimensional data. A typical approach for DML with high dimensional data is to perform the dimensionality reduction first before learning the distance metric. The main…

Machine Learning · Computer Science 2015-09-16 Qi Qian , Rong Jin , Lijun Zhang , Shenghuo Zhu

Neighbor Embedding (NE) aims to preserve pairwise similarities between data items and has been shown to yield an effective principle for data visualization. However, even the best existing NE methods such as Stochastic Neighbor Embedding…

Machine Learning · Computer Science 2021-09-15 Zhirong Yang , Yuwei Chen , Denis Sedov , Samuel Kaski , Jukka Corander

Density Based Clustering are a type of Clustering methods using in data mining for extracting previously unknown patterns from data sets. There are a number of density based clustering methods such as DBSCAN, OPTICS, DENCLUE, VDBSCAN,…

Machine Learning · Computer Science 2023-07-25 Rupanka Bhuyan , Samarjeet Borah

Most popular dimension reduction (DR) methods like t-SNE and UMAP are based on minimizing a cost between input and latent pairwise similarities. Though widely used, these approaches lack clear probabilistic foundations to enable a full…

Probability · Mathematics 2023-10-06 Hugues Van Assel , Thibault Espinasse , Julien Chiquet , Franck Picard

It has become standard to use gradient-based dimensionality reduction (DR) methods like tSNE and UMAP when explaining what AI models have learned. This makes sense: these methods are fast, robust, and have an uncanny ability to find…

Machine Learning · Computer Science 2024-06-17 Andrew Draganov , Simon Dohn

Spatiotemporal (ST) image data are increasingly common and often high-dimensional (high-D). Modeling ST data can be a challenge due to the plethora of independent and interacting processes which may or may not contribute to the…

Machine Learning · Computer Science 2021-08-24 Daniel Sousa , Christopher Small

Recently, a variety of approaches has been enriching the field of Remote Sensing (RS) image processing and analysis. Unfortunately, existing methods remain limited faced to the rich spatio-spectral content of today's large datasets. It…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Amina Ben Hamida , A Benoit , Patrick Lambert , Chokri Ben Amar

Deep neural networks (DNNs) provide useful models of visual representational transformations. We present a method that enables a DNN (student) to learn from the internal representational spaces of a reference model (teacher), which could be…

Neural and Evolutionary Computing · Computer Science 2019-09-19 Patrick McClure , Nikolaus Kriegeskorte

Subspace clustering methods have been widely studied recently. When the inputs are 2-dimensional (2D) data, existing subspace clustering methods usually convert them into vectors, which severely damages inherent structures and relationships…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Chong Peng , Qian Zhang , Zhao Kang , Chenglizhao Chen , Qiang Cheng

Random dimensionality reduction is a versatile tool for speeding up algorithms for high-dimensional problems. We study its application to two clustering problems: the facility location problem, and the single-linkage hierarchical clustering…

Data Structures and Algorithms · Computer Science 2021-07-06 Shyam Narayanan , Sandeep Silwal , Piotr Indyk , Or Zamir

We compare the efficiency with which 2D and 3D weak lensing mass mapping techniques are able to detect clusters of galaxies using two state-of-the-art mass reconstruction techniques: MRLens in 2D and GLIMPSE in 3D. We simulate…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-23 Adrienne Leonard , Francois Lanusse , Jean-Luc Starck

Contemporary deep clustering approaches often rely on either contrastive or non-contrastive techniques to acquire effective representations for clustering tasks. Contrastive methods leverage negative pairs to achieve homogenous…

Machine Learning · Computer Science 2023-11-03 Abhishek Kumar , Dong-Gyu Lee

With the recent surge in big data analytics for hyper-dimensional data there is a renewed interest in dimensionality reduction techniques for machine learning applications. In order for these methods to improve performance gains and…

Machine Learning · Computer Science 2023-01-20 J. Derek Tucker , Matthew T. Martinez , Jose M. Laborde

Deep clustering, a method for partitioning complex, high-dimensional data using deep neural networks, presents unique evaluation challenges. Traditional clustering validation measures, designed for low-dimensional spaces, are problematic…

Machine Learning · Statistics 2024-03-25 Zeya Wang , Chenglong Ye

When it comes to clustering nonconvex shapes, two paradigms are used to find the most suitable clustering: minimum cut and maximum density. The most popular algorithms incorporating these paradigms are Spectral Clustering and DBSCAN. Both…

Machine Learning · Computer Science 2019-07-02 Sibylle Hess , Wouter Duivesteijn , Philipp Honysz , Katharina Morik

High-dimensional datasets often contain multiple meaningful clusterings in different subspaces. For example, objects can be clustered either by color, weight, or size, revealing different interpretations of the given dataset. A variety of…

Machine Learning · Computer Science 2025-04-08 Collin Leiber , Dominik Mautz , Claudia Plant , Christian Böhm

We present a new nonlinear dimensionality reduction method, MAPLE, that enhances UMAP by improving manifold modeling. MAPLE employs a self-supervised learning approach to more efficiently encode low-dimensional manifold geometry. Central to…

Machine Learning · Computer Science 2026-05-15 Zeyang Huang , Takanori Fujiwara , Angelos Chatzimparmpas , Wandrille Duchemin , Andreas Kerren

This paper presents an extensive empirical study on the integration of dimensionality reduction techniques with advanced unsupervised time series anomaly detection models, focusing on the MUTANT and Anomaly-Transformer models. The study…

Machine Learning · Computer Science 2024-03-08 Mahsun Altin , Altan Cakir