English
Related papers

Related papers: Evaluating Dense Passage Retrieval using Transform…

200 papers

The goal of screening prioritisation in systematic reviews is to identify relevant documents with high recall and rank them in early positions for review. This saves reviewing effort if paired with a stopping criterion, and speeds up review…

Information Retrieval · Computer Science 2024-07-18 Xinyu Mao , Shengyao Zhuang , Bevan Koopman , Guido Zuccon

Information retrieval systems have traditionally relied on exact term match methods such as BM25 for first-stage retrieval. However, recent advancements in neural network-based techniques have introduced a new method called dense retrieval.…

Information Retrieval · Computer Science 2025-03-25 Ahmed H. Salamah , Pierre McWhannel , Nicole Yan

Accurate click-through rate (CTR) prediction is vital for online advertising and recommendation systems. Recent deep learning advancements have improved the ability to capture feature interactions and understand user interests. However,…

Information Retrieval · Computer Science 2025-02-24 Kefan Wang , Hao Wang , Kenan Song , Wei Guo , Kai Cheng , Zhi Li , Yong Liu , Defu Lian , Enhong Chen

Recently embedding-based retrieval or dense retrieval have shown state of the art results, compared with traditional sparse or bag-of-words based approaches. This paper introduces a model-agnostic doc-level embedding framework through large…

Information Retrieval · Computer Science 2024-04-10 Mingrui Wu , Sheng Cao

The advent of contextualised language models has brought gains in search effectiveness, not just when applied for re-ranking the output of classical weighting models such as BM25, but also when used directly for passage indexing and…

Information Retrieval · Computer Science 2021-08-20 Craig Macdonald , Nicola Tonellotto , Iadh Ounis

Rerankers, typically cross-encoders, are computationally intensive but are frequently used because they are widely assumed to outperform cheaper initial IR systems. We challenge this assumption by measuring reranker performance for full…

Information Retrieval · Computer Science 2025-07-14 Mathew Jacob , Erik Lindgren , Matei Zaharia , Michael Carbin , Omar Khattab , Andrew Drozdov

Vector-based retrieval systems have become a common staple for academic and industrial search applications because they provide a simple and scalable way of extending the search to leverage contextual representations for documents and…

Information Retrieval · Computer Science 2023-04-04 Daniel Campos , ChengXiang Zhai

The proliferation of misinformation necessitates robust yet computationally efficient fact verification systems. While current state-of-the-art approaches leverage Large Language Models (LLMs) for generating explanatory rationales, these…

Computation and Language · Computer Science 2025-11-10 Alamgir Munir Qazi , John P. McCrae , Jamal Abdul Nasir

Representation learning is a fundamental building block for analyzing entities in a database. While the existing embedding learning methods are effective in various data mining problems, their applicability is often limited because these…

Machine Learning · Computer Science 2020-09-24 Chin-Chia Michael Yeh , Dhruv Gelda , Zhongfang Zhuang , Yan Zheng , Liang Gou , Wei Zhang

Recent dense retrievers increasingly leverage the robust text understanding capabilities of Large Language Models (LLMs), encoding queries and documents into a shared embedding space for effective retrieval. However, most existing methods…

Information Retrieval · Computer Science 2025-10-07 Yifan Ji , Zhipeng Xu , Zhenghao Liu , Yukun Yan , Shi Yu , Yishan Li , Zhiyuan Liu , Yu Gu , Ge Yu , Maosong Sun

Although much of the success of Deep Learning builds on learning good representations, a rigorous method to evaluate their quality is lacking. In this paper, we treat the evaluation of representations as a model selection problem and…

Machine Learning · Computer Science 2024-11-19 Yazhe Li , Jorg Bornschein , Marcus Hutter

Neural retrieval models (NRMs) have been shown to outperform their statistical counterparts owing to their ability to capture semantic meaning via dense document representations. These models, however, suffer from poor interpretability as…

Information Retrieval · Computer Science 2023-04-26 Michael Llordes , Debasis Ganguly , Sumit Bhatia , Chirag Agarwal

Transformers have been widely applied in text classification. Unfortunately, real-world data contain anomalies and noisy labels that cause challenges for state-of-art Transformers. This paper proposes Protoformer, a novel self-learning…

Computation and Language · Computer Science 2022-06-28 Ashkan Farhangi , Ning Sui , Nan Hua , Haiyan Bai , Arthur Huang , Zhishan Guo

Current state-of-the-art approaches to cross-modal retrieval process text and visual input jointly, relying on Transformer-based architectures with cross-attention mechanisms that attend over all words and objects in an image. While…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Gregor Geigle , Jonas Pfeiffer , Nils Reimers , Ivan Vulić , Iryna Gurevych

Passage retrieval and ranking is a key task in open-domain question answering and information retrieval. Current effective approaches mostly rely on pre-trained deep language model-based retrievers and rankers. These methods have been shown…

Information Retrieval · Computer Science 2021-09-14 Shengyao Zhuang , Guido Zuccon

As more and more search traffic comes from mobile phones, intelligent assistants, and smart-home devices, new challenges (e.g., limited presentation space) and opportunities come up in information retrieval. Previously, an effective…

Information Retrieval · Computer Science 2019-06-11 Keping Bi , Qingyao Ai , W. Bruce Croft

Dense encoders and LLM-based rerankers struggle with long documents: single-vector representations dilute fine-grained relevance, while cross-encoders are often too expensive for practical reranking. We present an efficient long-document…

Information Retrieval · Computer Science 2026-02-06 Minghan Li , Eric Gaussier , Guodong Zhou

Commonly, AI or machine learning (ML) models are evaluated on benchmark datasets. This practice supports innovative methodological research, but benchmark performance can be poorly correlated with performance in real-world applications -- a…

Machine Learning · Computer Science 2024-06-18 Olivier Binette , Jerome P. Reiter

Over the last few years, contextualized pre-trained transformer models such as BERT have provided substantial improvements on information retrieval tasks. Recent approaches based on pre-trained transformer models such as BERT, fine-tune…

Information Retrieval · Computer Science 2021-09-23 Negar Arabzadeh , Xinyi Yan , Charles L. A. Clarke

Existing techniques for text detection can be broadly classified into two primary groups: segmentation-based and regression-based methods. Segmentation models offer enhanced robustness to font variations but require intricate…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Qingwen Bu , Sungrae Park , Minsoo Khang , Yichuan Cheng