English
Related papers

Related papers: Contextualized Sparse Representations for Real-Tim…

200 papers

The task of incomplete utterance rewriting has recently gotten much attention. Previous models struggled to extract information from the dialogue context, as evidenced by the low restoration scores. To address this issue, we propose a novel…

Machine Learning · Computer Science 2023-07-14 Yunshan Chen

High Recall Retrieval (HRR), such as eDiscovery and medical systematic review, is a search problem that optimizes the cost of retrieving most relevant documents in a given collection. Iterative approaches, such as iterative relevance…

Information Retrieval · Computer Science 2024-05-08 Eugene Yang

Sequence representations supporting not only direct access to their symbols, but also rank/select operations, are a fundamental building block in many compressed data structures. Several recent applications need to represent highly…

Data Structures and Algorithms · Computer Science 2019-11-25 Alberto Ordóñez , Gonzalo Navarro , Nieves R. Brisaboa

Chunk-based inference stands out as a popular approach in developing real-time streaming speech recognition, valued for its simplicity and efficiency. However, because it restricts the model's focus to only the history and current chunk…

Sound · Computer Science 2025-02-24 Khanh Le , Duc Chau

Deep neural networks suffer from the major limitation of catastrophic forgetting old tasks when learning new ones. In this paper we focus on class incremental continual learning in semantic segmentation, where new categories are made…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Umberto Michieli , Pietro Zanuttigh

Automatic Speech Recognition (ASR) has witnessed a profound research interest. Recent breakthroughs have given ASR systems different prospects such as faithfully transcribing spoken language, which is a pivotal advancement in building…

Computation and Language · Computer Science 2024-03-05 Ankitha Sudarshan , Vinay Samuel , Parth Patwa , Ibtihel Amara , Aman Chadha

Despite considerable progress in neural relevance ranking techniques, search engines still struggle to process complex queries effectively - both in terms of precision and recall. Sparse and dense Pseudo-Relevance Feedback (PRF) approaches…

Information Retrieval · Computer Science 2023-12-06 Iain Mackie , Shubham Chatterjee , Sean MacAvaney , Jeffrey Dalton

Finding the sparse representation of a signal in an overcomplete dictionary has attracted a lot of attention over the past years. This paper studies ProSparse, a new polynomial complexity algorithm that solves the sparse representation…

Information Theory · Computer Science 2017-07-11 Yue M. Lu , Jon Oñativia , Pier Luigi Dragotti

Compressed sensing aims to undersample certain high-dimensional signals, yet accurately reconstruct them by exploiting signal characteristics. Accurate reconstruction is possible when the object to be recovered is sufficiently sparse in a…

Information Theory · Computer Science 2015-05-13 David L. Donoho , Arian Maleki , Andrea Montanari

Variational Autoencoders (VAEs) are powerful generative models for learning latent representations. Standard VAEs generate dispersed and unstructured latent spaces by utilizing all dimensions, which limits their interpretability, especially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Farshad Sangari Abiz , Reshad Hosseini , Babak N. Araabi

Task-oriented semantic parsing models have achieved strong results in recent years, but unfortunately do not strike an appealing balance between model size, runtime latency, and cross-domain generalizability. We tackle this problem by…

Computation and Language · Computer Science 2022-02-03 Akshat Shrivastava , Shrey Desai , Anchit Gupta , Ali Elkahky , Aleksandr Livshits , Alexander Zotov , Ahmed Aly

Automatic Term Recognition is used to extract domain-specific terms that belong to a given domain. In order to be accurate, these corpus and language-dependent methods require large volumes of textual data that need to be processed to…

Computation and Language · Computer Science 2023-05-29 Ciprian-Octavian Truică , Neculai-Ovidiu Istrate , Elena-Simona Apostol

The success of deep networks is crucially attributed to their ability to capture latent features within a representation space. In this work, we investigate whether the underlying learned features of a model can be efficiently retrieved…

Machine Learning · Computer Science 2025-12-30 Akash Kumar

Large transformer models, such as BERT, achieve state-of-the-art results in machine reading comprehension (MRC) for open-domain question answering (QA). However, transformers have a high computational cost for inference which makes them…

Computation and Language · Computer Science 2021-08-06 Haytham ElFadeel , Stan Peshterliev

Sparse representation with respect to an overcomplete dictionary is often used when regularizing inverse problems in signal and image processing. In recent years, the Convolutional Sparse Coding (CSC) model, in which the dictionary consists…

Image and Video Processing · Electrical Eng. & Systems 2019-09-13 Dror Simon , Michael Elad

Recent advances in retrieval models based on learned sparse representations generated by transformers have led us to, once again, consider score-at-a-time query evaluation techniques for the top-k retrieval problem. Previous studies…

Information Retrieval · Computer Science 2021-10-29 Joel Mackenzie , Andrew Trotman , Jimmy Lin

Phrase-level dense retrieval has shown many appealing characteristics in downstream NLP tasks by leveraging the fine-grained information that phrases offer. In our work, we propose a new task formulation of dense retrieval, cross-lingual…

Computation and Language · Computer Science 2024-10-07 Huayang Li , Deng Cai , Zhi Qu , Qu Cui , Hidetaka Kamigaito , Lemao Liu , Taro Watanabe

This report presents our participation to the WSDM Cup 2026 shared task on multilingual document retrieval from English queries. The task provides a challenging benchmark for cross-lingual generalization. It also provides a natural testbed…

Information Retrieval · Computer Science 2026-02-25 Thibault Formal , Maxime Louis , Hervé Déjean , Stéphane Clinchant

Word embeddings are a powerful natural language processing technique, but they are extremely difficult to interpret. To enable interpretable NLP models, we create vectors where each dimension is inherently interpretable. By inherently…

Computation and Language · Computer Science 2021-09-29 Adly Templeton

To extract answers from a large corpus, open-domain question answering (QA) systems usually rely on information retrieval (IR) techniques to narrow the search space. Standard inverted index methods such as TF-IDF are commonly used as thanks…

Computation and Language · Computer Science 2021-02-22 Wenhan Xiong , Hong Wang , William Yang Wang