English
Related papers

Related papers: Deep Learning Based Dense Retrieval: A Comparative…

200 papers

A wireless communications system usually consists of a transmitter which transmits the information and a receiver which recovers the original information from the received distorted signal. Deep learning (DL) has been used to improve the…

Cryptography and Security · Computer Science 2023-10-02 Jinyin Chen , Jie Ge , Shilian Zheng , Linhui Ye , Haibin Zheng , Weiguo Shen , Keqiang Yue , Xiaoniu Yang

Retrieval-Augmented Generation (RAG) improves the reliability of large language model applications by grounding generation in retrieved evidence, but it also introduces a new attack surface: corpus poisoning. In this setting, an adversary…

Artificial Intelligence · Computer Science 2026-03-31 Xiangyu Yin , Yi Qi , Chih-Hong Cheng

Dense retrieval (DR) has shown promising results in information retrieval. In essence, DR requires high-quality text representations to support effective search in the representation space. Recent studies have shown that pre-trained…

Information Retrieval · Computer Science 2022-08-23 Xinyu Ma , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng

We propose the new problem of choosing which dense retrieval model to use when searching on a new collection for which no labels are available, i.e. in a zero-shot setting. Many dense retrieval models are readily available. Each model…

Information Retrieval · Computer Science 2023-09-19 Ekaterina Khramtsova , Shengyao Zhuang , Mahsa Baktashmotlagh , Xi Wang , Guido Zuccon

Deep neural networks (DNNs) have achieved remarkable success in computer vision tasks such as image classification, segmentation, and object detection. However, they are vulnerable to adversarial attacks, which can cause incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Suklav Ghosh , Sonal Kumar , Arijit Sur

Pre-trained deep language models~(LM) have advanced the state-of-the-art of text retrieval. Rerankers fine-tuned from deep LM estimates candidate relevance based on rich contextualized matching signals. Meanwhile, deep LMs can also be…

Information Retrieval · Computer Science 2021-01-22 Luyu Gao , Zhuyun Dai , Jamie Callan

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

Recently, several dense retrieval (DR) models have demonstrated competitive performance to term-based retrieval that are ubiquitous in search systems. In contrast to term-based matching, DR projects queries and documents into a dense vector…

Information Retrieval · Computer Science 2022-06-28 Sebastian Hofstätter , Nick Craswell , Bhaskar Mitra , Hamed Zamani , Allan Hanbury

Deep neural networks (DNNs) have played a key role in a wide range of machine learning applications. However, DNN classifiers are vulnerable to human-imperceptible adversarial perturbations, which can cause them to misclassify inputs with…

Machine Learning · Computer Science 2020-05-20 Jeffrey Z. Pan , Nicholas Zufelt

Pseudo-relevance feedback (PRF) can enhance average retrieval effectiveness over a sufficiently large number of queries. However, PRF often introduces a drift into the original information need, thus hurting the retrieval effectiveness of…

Information Retrieval · Computer Science 2024-01-23 Suchana Datta , Debasis Ganguly , Sean MacAvaney , Derek Greene

Retrieval models based on dense representations in semantic space have become an indispensable branch for first-stage retrieval. These retrievers benefit from surging advances in representation learning towards compressive global…

Computation and Language · Computer Science 2023-03-06 Kai Zhang , Chongyang Tao , Tao Shen , Can Xu , Xiubo Geng , Binxing Jiao , Daxin Jiang

Dense Retrieval (DR) has achieved state-of-the-art first-stage ranking effectiveness. However, the efficiency of most existing DR models is limited by the large memory cost of storing dense vectors and the time-consuming nearest neighbor…

Information Retrieval · Computer Science 2021-10-13 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Jiafeng Guo , Min Zhang , Shaoping Ma

Ranking has always been one of the top concerns in information retrieval researches. For decades, the lexical matching signal has dominated the ad-hoc retrieval process, but solely using this signal in retrieval may cause the vocabulary…

Information Retrieval · Computer Science 2021-04-19 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Jiafeng Guo , Min Zhang , Shaoping Ma

The \textit{de facto} paradigm for applying dense retrieval (DR) to new tasks involves fine-tuning a pre-trained model for a specific task. However, this paradigm has two significant limitations: (1) It is difficult adapt the DR to a new…

Information Retrieval · Computer Science 2026-02-27 Zhan Su , Fengran Mo , Jinghan Zhang , Yuchen Hui , Jia Ao Sun , Bingbing Wen , Jian-Yun Nie

Dense retrieval is a basic building block of information retrieval applications. One of the main challenges of dense retrieval in real-world settings is the handling of queries containing misspelled words. A popular approach for handling…

Recent work has identified that classification models implemented as neural networks are vulnerable to data-poisoning and Trojan attacks at training time. In this work, we show that these training-time vulnerabilities extend to deep…

Cryptography and Security · Computer Science 2019-03-18 Panagiota Kiourti , Kacper Wardega , Susmit Jha , Wenchao Li

As these attacks become more and more difficult to see, the need for the great hi-tech models that detect them is undeniable. This paper examines and compares various machine learning as well as deep learning models to choose the most…

Cryptography and Security · Computer Science 2024-07-09 Momen Hesham , Mohamed Essam , Mohamed Bahaa , Ahmed Mohamed , Mohamed Gomaa , Mena Hany , Wael Elsersy

Availability poisons exploit supervised learning (SL) algorithms by introducing class-related shortcut features in images such that models trained on poisoned data are useless for real-world datasets. Self-supervised learning (SSL), which…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Jeremy Styborski , Mingzhi Lyu , Yi Huang , Adams Kong

Machine learning models -- deep neural networks in particular -- have performed remarkably well on benchmark datasets across a wide variety of domains. However, the ease of finding adversarial counter-examples remains a persistent problem…

Machine Learning · Computer Science 2024-09-13 Charles Meyers , Mohammad Reza Saleh Sedghpour , Tommy Löfstedt , Erik Elmroth

Deep neural networks (DNNs) are known to be prone to adversarial attacks, for which many remedies are proposed. While adversarial training (AT) is regarded as the most robust defense, it suffers from poor performance both on clean examples…

Machine Learning · Computer Science 2020-11-30 Yilun Jin , Lixin Fan , Kam Woh Ng , Ce Ju , Qiang Yang