English
Related papers

Related papers: Order-Preserving Dimension Reduction for Multimoda…

200 papers

Multidimensional Scaling (MDS) is one of the most popular methods for dimensionality reduction and visualization of high dimensional data. Apart from these tasks, it also found applications in the field of geometry processing for the…

Computational Geometry · Computer Science 2017-09-12 Amit Boyarski , Alex M. Bronstein , Michael M. Bronstein

Embedding models have become essential tools in both natural language processing and computer vision, enabling efficient semantic search, recommendation, clustering, and more. However, the high memory and computational demands of…

Computation and Language · Computer Science 2024-11-26 Jiayi Chen , Chen Wu , Shaoqun Zhang , Nan Li , Liangjie Zhang , Qi Zhang

Word embeddings have become the basic building blocks for several natural language processing and information retrieval tasks. Pre-trained word embeddings are used in several downstream applications as well as for constructing…

Computation and Language · Computer Science 2017-11-22 Vikas Raunak

Vector search systems, pivotal in AI applications, often rely on the Hierarchical Navigable Small Worlds (HNSW) algorithm. However, the behaviour of HNSW under real-world scenarios using vectors generated with deep learning models remains…

Information Retrieval · Computer Science 2025-06-10 Owen Pendrigh Elliott , Jesse Clark

Dense retrieval, which encodes queries and documents into a single dense vector, has become the dominant neural retrieval approach due to its simplicity and compatibility with fast approximate nearest neighbor algorithms. As the tasks dense…

Information Retrieval · Computer Science 2026-02-06 Julian Killingback , Mahta Rafiee , Madine Manas , Hamed Zamani

Dimensionality reduction techniques are widely used for visualizing high-dimensional data in two dimensions. Existing methods are typically designed to preserve either local (e.g., $t$-SNE, UMAP) or global (e.g., MDS, PCA) structure of the…

Machine Learning · Computer Science 2026-02-02 Noël Kury , Dmitry Kobak , Sebastian Damrich

TSNE and UMAP are two of the most popular dimensionality reduction algorithms due to their speed and interpretable low-dimensional embeddings. However, while attempts have been made to improve on TSNE's computational complexity, no existing…

Dimension reduction (DR) aims to learn low-dimensional representations of high-dimensional data with the preservation of essential information. In the context of manifold learning, we define that the representation after…

Machine Learning · Computer Science 2021-07-01 Siyuan Li , Haitao Lin , Zelin Zang , Lirong Wu , Jun Xia , Stan Z. Li

In this paper, we revisit the problem of indexing multi-dimensional data in memory for the efficient support of multi-dimensional range queries and nearest neighbor queries. This is a classic problem in main-memory databases, where there is…

Databases · Computer Science 2026-05-06 Achilleas Michalopoulos , Dimitrios Tsitsigkos , Nikos Mamoulis

The statistical problem of estimating the effective dimension-reduction (EDR) subspace in the multi-index regression model with deterministic design and additive noise is considered. A new procedure for recovering the directions of the EDR…

Statistics Theory · Mathematics 2007-06-13 Arnak Dalalyan , Anatoly Juditsky , Vladimir Spokoiny

In real-world, many problems can be formulated as the alignment between two geometric patterns. Previously, a great amount of research focus on the alignment of 2D or 3D patterns, especially in the field of computer vision. Recently, the…

Machine Learning · Computer Science 2018-11-20 Hu Ding , Mingquan Ye

Particle storage rings are a rich application domain for online optimization algorithms. The Cornell Electron Storage Ring (CESR) has hundreds of independently powered magnets, making it a high-dimensional test-problem for algorithmic…

Existing research into online multi-label classification, such as online sequential multi-label extreme learning machine (OSML-ELM) and stochastic gradient descent (SGD), has achieved promising performance. However, these works do not take…

Machine Learning · Computer Science 2020-06-15 Xiuwen Gong , Jiahui Yang , Dong Yuan , Wei Bao

We propose a nonlinear reduced basis method for the efficient approximation of parametrized partial differential equations (PDEs), exploiting kernel proper orthogonal decomposition (KPOD) for the generation of a reduced-order space and…

Numerical Analysis · Mathematics 2021-04-01 Matteo Salvador , Luca Dede' , Andrea Manzoni

Interactive exploration of large, multidimensional datasets plays a very important role in various scientific fields. It makes it possible not only to identify important structural features and forms, such as clusters of vertices and their…

Machine Learning · Computer Science 2023-03-10 Bartosz Minch

Deep Metric Learning algorithms aim to learn an efficient embedding space to preserve the similarity relationships among the input data. Whilst these algorithms have achieved significant performance gains across a wide plethora of tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Soumava Kumar Roy , Yan Han , Mehrtash Harandi , Lars Petersson

The problem of finding K-nearest neighbors in the given dataset for a given query point has been worked upon since several years. In very high dimensional spaces the K-nearest neighbor search (KNNS) suffers in terms of complexity in…

Machine Learning · Computer Science 2021-02-15 Pramod Vadiraja , Christoph Peter Balada

We study the problem of processing continuous k nearest neighbor (CkNN) queries over moving objects on road networks, which is an essential operation in a variety of applications. We are particularly concerned with scenarios where the…

Databases · Computer Science 2026-01-01 Ziqiang Yu , Xiaohui Yu , Tao Zhou , Yueting Chen , Yang Liu , Bohan Li

Learning representation from relative similarity comparisons, often called ordinal embedding, gains rising attention in recent years. Most of the existing methods are based on semi-definite programming (\textit{SDP}), which is generally…

Machine Learning · Computer Science 2019-12-03 Ke Ma , Jinshan Zeng , Qianqian Xu , Xiaochun Cao , Wei Liu , Yuan Yao

In this paper, we study ordered representations of data in which different dimensions have different degrees of importance. To learn these representations we introduce nested dropout, a procedure for stochastically removing coherent nested…

Machine Learning · Statistics 2014-02-06 Oren Rippel , Michael A. Gelbart , Ryan P. Adams