English
Related papers

Related papers: Dimension Reduction for Efficient Dense Retrieval …

200 papers

In this work, we explore dimensionality reduction techniques for univariate and multivariate time series data. We especially conduct a comparison between wavelet decomposition and convolutional variational autoencoders for dimension…

Machine Learning · Computer Science 2022-04-26 William Todo , Beatrice Laurent , Jean-Michel Loubes , Merwann Selmani

Real-time data collection and analysis in large experimental facilities present a great challenge across multiple domains, including high energy physics, nuclear physics, and cosmology. To address this, machine learning (ML)-based methods…

Machine Learning · Computer Science 2021-11-11 Yi Huang , Yihui Ren , Shinjae Yoo , Jin Huang

High dimensional data is often assumed to be concentrated on or near a low-dimensional manifold. Autoencoders (AE) is a popular technique to learn representations of such data by pushing it through a neural network with a low dimension…

Machine Learning · Computer Science 2020-10-06 Amos Gropp , Matan Atzmon , Yaron Lipman

Neural sentence embedding models for dense retrieval typically rely on binary relevance labels, treating query-document pairs as either relevant or irrelevant. However, real-world relevance often exists on a continuum, and recent advances…

Information Retrieval · Computer Science 2025-08-12 Christos Tsirigotis , Vaibhav Adlakha , Joao Monteiro , Aaron Courville , Perouz Taslakian

Dense retrieval compresses texts into single embeddings ranked by cosine similarity. While efficient for recall, this interface is brittle for identity-level matching: minimal compositional edits (negation, role swaps) flip meaning yet…

Information Retrieval · Computer Science 2026-04-21 Radoslav Ralev , Aditeya Baral , Iliya Zhechev , Jen Agarwal , Srijith Rajamohan

Disentangled learning representations have promising utility in many applications, but they currently suffer from serious reliability issues. We present Gaussian Channel Autoencoder (GCAE), a method which achieves reliable disentanglement…

Machine Learning · Computer Science 2023-02-10 Eric Yeats , Frank Liu , Hai Li

The dual-encoder has become the de facto architecture for dense retrieval. Typically, it computes the latent representations of the query and document independently, thus failing to fully capture the interactions between the query and…

Computation and Language · Computer Science 2023-10-31 Xingwei He , Yeyun Gong , A-Long Jin , Hang Zhang , Anlei Dong , Jian Jiao , Siu Ming Yiu , Nan Duan

Recently, convolutional auto-encoders (CAE) were introduced for image coding. They achieved performance improvements over the state-of-the-art JPEG2000 method. However, these performances were obtained using massive CAEs featuring a large…

Image and Video Processing · Electrical Eng. & Systems 2022-09-13 Cyprien Gille , Frédéric Guyard , Marc Antonini , Michel Barlaud

In dense retrieval, embedding long texts into dense vectors can result in information loss, leading to inaccurate query-text matching. Additionally, low-quality texts with excessive noise or sparse key information are unlikely to align well…

Computation and Language · Computer Science 2025-03-04 Hongming Tan , Shaoxiong Zhan , Hai Lin , Hai-Tao Zheng , Wai Kin Chan

Dense retrieval has achieved impressive advances in first-stage retrieval from a large-scale document collection, which is built on bi-encoder architecture to produce single vector representation of query and document. However, a document…

Computation and Language · Computer Science 2022-03-17 Shunyu Zhang , Yaobo Liang , Ming Gong , Daxin Jiang , Nan Duan

Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection. As a result,…

Information Retrieval · Computer Science 2024-04-16 Dahlia Shehata

Auto-encoder is a special kind of neural network based on reconstruction. De-noising auto-encoder (DAE) is an improved auto-encoder which is robust to the input by corrupting the original data first and then reconstructing the original…

Machine Learning · Computer Science 2014-04-24 Fu-qiang Chen , Yan Wu , Guo-dong Zhao , Jun-ming Zhang , Ming Zhu , Jing Bai

This paper presents a framework for efficiently learning feature selection policies which use less features to reach a high classification precision on large unstructured data. It uses a Deep Convolutional Autoencoder (DCAE) for learning…

Machine Learning · Computer Science 2019-12-23 Johan S. Obando-Ceron , Victor Romero Cano , Walter Mayor Toro

Dense document embeddings are central to neural retrieval. The dominant paradigm is to train and construct embeddings by running encoders directly on individual documents. In this work, we argue that these embeddings, while effective, are…

Computation and Language · Computer Science 2024-11-11 John X. Morris , Alexander M. Rush

In the era of dense retrieval, document indexing and retrieval is largely based on encoding models that transform text documents into embeddings. The efficiency of retrieval is directly proportional to the number of documents and the size…

Information Retrieval · Computer Science 2024-12-16 Federico Siciliano , Francesca Pezzuti , Nicola Tonellotto , Fabrizio Silvestri

Inspired by the success of deep learning techniques in the physical and chemical sciences, we apply a modification of an autoencoder type deep neural network to the task of dimension reduction of molecular dynamics data. We can show that…

Machine Learning · Statistics 2018-04-04 Christoph Wehmeyer , Frank Noé

Despite their strong performance, Dense Passage Retrieval (DPR) models suffer from a lack of interpretability. In this work, we propose a novel interpretability framework that leverages Sparse Autoencoders (SAEs) to decompose previously…

Information Retrieval · Computer Science 2025-08-28 Seongwan Park , Taeklim Kim , Youngjoong Ko

A rapidly growing area of research is the use of machine learning approaches such as autoencoders for dimensionality reduction of data and models in scientific applications. We show that the canonical formulation of autoencoders suffers…

Machine Learning · Computer Science 2022-07-28 Andrey A. Popov , Arash Sarshar , Austin Chennault , Adrian Sandu

We demonstrate a new deep learning autoencoder network, trained by a nonnegativity constraint algorithm (NCAE), that learns features which show part-based representation of data. The learning algorithm is based on constraining negative…

Machine Learning · Computer Science 2016-01-13 Ehsan Hosseini-Asl , Jacek M. Zurada , Olfa Nasraoui

Multimodal representations that enable cross-modal retrieval are widely used. However, these often lack interpretability making it difficult to explain the retrieved results. Solutions such as learning sparse disentangled representations…

Information Retrieval · Computer Science 2025-06-25 Prachi J , Sumit Bhatia , Srikanta Bedathur
‹ Prev 1 3 4 5 6 7 10 Next ›