English
Related papers

Related papers: Improving Neural Ranking Models with Traditional I…

200 papers

Deep learning models have become state of the art for natural language processing (NLP) tasks, however deploying these models in production system poses significant memory constraints. Existing compression methods are either lossy or…

Machine Learning · Computer Science 2018-11-05 Anish Acharya , Rahul Goel , Angeliki Metallinou , Inderjit Dhillon

Most existing word embedding methods can be categorized into Neural Embedding Models and Matrix Factorization (MF)-based methods. However some models are opaque to probabilistic interpretation, and MF-based methods, typically solved using…

Computation and Language · Computer Science 2015-08-18 Shaohua Li , Jun Zhu , Chunyan Miao

This paper considers Pseudo-Relevance Feedback (PRF) methods for dense retrievers in a resource constrained environment such as that of cheap cloud instances or embedded systems (e.g., smartphones and smartwatches), where memory and CPU are…

Information Retrieval · Computer Science 2024-12-09 Hang Li , Chuting Yu , Ahmed Mourad , Bevan Koopman , Guido Zuccon

Distributed representations of words have shown to be useful to improve the effectiveness of IR systems in many sub-tasks like query expansion, retrieval and ranking. Algorithms like word2vec, GloVe and others are also key factors in many…

Information Retrieval · Computer Science 2019-09-05 Tommaso Teofili , Niyati Chhaya

Reranking, the process of refining the output from a first-stage retriever, is often considered computationally expensive, especially when using Large Language Models (LLMs). A common approach to mitigate this cost involves utilizing…

Information Retrieval · Computer Science 2026-04-30 Hervé Déjean , Stéphane Clinchant

Information retrieval plays a crucial role in resource localization. Current dense retrievers retrieve the relevant documents within a corpus via embedding similarities, which compute similarities between dense vectors mainly depending on…

Information Retrieval · Computer Science 2025-05-30 Ganlin Xu , Zhoujia Zhang , Wangyi Mei , Jiaqing Liang , Weijia Lu , Xiaodong Zhang , Zhifei Yang , Xiaofeng Ma , Yanghua Xiao , Deqing Yang

In-Context Learning (ICL) enables Large Language Models (LLMs) to perform new tasks by conditioning on prompts with relevant information. Retrieval-Augmented Generation (RAG) enhances ICL by incorporating retrieved documents into the LLM's…

Machine Learning · Computer Science 2024-12-02 Marie Al Ghossein , Emile Contal , Alexandre Robicquet

Text classification is one of the most frequent tasks for processing textual data, facilitating among others research from large-scale datasets. Embeddings of different kinds have recently become the de facto standard as features used for…

Computation and Language · Computer Science 2020-09-03 Arkaitz Zubiaga

Traditional multimodal retrieval systems rely primarily on bi-encoder architectures, where performance is closely tied to embedding dimensionality. Recent work, Think-Then-Embed (TTE), shows that incorporating multimodal reasoning to elicit…

We consider the problem of retrieving and ranking items in an eCommerce catalog, often called SKUs, in order of relevance to a user-issued query. The input data for the ranking are the texts of the queries and textual fields of the SKUs…

Information Retrieval · Computer Science 2018-06-20 Eliot Brenner , Jun Zhao , Aliasgar Kutiyanawala , Zheng Yan

The rapid expansion of Large Language Models (LLMs) has posed significant challenges regarding the computational resources required for fine-tuning and deployment. Recent advancements in low-rank adapters have demonstrated their efficacy in…

Machine Learning · Computer Science 2025-01-29 J. Pablo Muñoz , Jinjie Yuan , Nilesh Jain

Our work aimed at experimentally assessing the benefits of model ensembling within the context of neural methods for passage reranking. Starting from relatively standard neural models, we use a previous technique named Fast Geometric…

Information Retrieval · Computer Science 2021-01-22 Luís Borges , Bruno Martins , Jamie Callan

The Hidden Web is the vast repository of informational databases available only through search form interfaces, accessible by therein typing a set of keywords in the search forms. Typically, a Hidden Web crawler is employed to autonomously…

Information Retrieval · Computer Science 2013-11-05 Sonali Gupta , Komal Kumar Bhatia

The Transformer-Kernel (TK) model has demonstrated strong reranking performance on the TREC Deep Learning benchmark -- and can be considered to be an efficient (but slightly less effective) alternative to other Transformer-based…

Information Retrieval · Computer Science 2021-04-20 Bhaskar Mitra , Sebastian Hofstatter , Hamed Zamani , Nick Craswell

Reranking, the process of refining the output of a first-stage retriever, is often considered computationally expensive, especially with Large Language Models. Borrowing from recent advances in document compression for RAG, we reduce the…

Information Retrieval · Computer Science 2025-05-22 Hervé Déjean , Stéphane Clinchant

Text classification is one of the fundamental tasks in natural language processing to label an open-ended text and is useful for various applications such as sentiment analysis. In this paper, we discuss various classification approaches…

Computation and Language · Computer Science 2021-12-14 Rina Buoy , Nguonly Taing , Sovisal Chenda

Information retrieval (IR) is essential in search engines and dialogue systems as well as natural language processing tasks such as open-domain question answering. IR serve an important function in the biomedical domain, where content and…

Information Retrieval · Computer Science 2022-01-20 Man Luo , Arindam Mitra , Tejas Gokhale , Chitta Baral

Pairing a lexical retriever with a neural re-ranking model has set state-of-the-art performance on large-scale information retrieval datasets. This pipeline covers scenarios like question answering or navigational queries, however, for…

Information Retrieval · Computer Science 2022-10-20 Tim Baumgärtner , Leonardo F. R. Ribeiro , Nils Reimers , Iryna Gurevych

Our objective is language-based search of large-scale image and video datasets. For this task, the approach that consists of independently mapping text and vision to a joint embedding space, a.k.a. dual encoders, is attractive as retrieval…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Antoine Miech , Jean-Baptiste Alayrac , Ivan Laptev , Josef Sivic , Andrew Zisserman

In enterprise settings, efficiently retrieving relevant information from large and complex knowledge bases is essential for operational productivity and informed decision-making. This research presents a systematic empirical framework for…