English
Related papers

Related papers: GASLITEing the Retrieval: Exploring Vulnerabilitie…

200 papers

Recent progress in deep learning has continuously improved the accuracy of dialogue response selection. In particular, sophisticated neural network architectures are leveraged to capture the rich interactions between dialogue context and…

Computation and Language · Computer Science 2022-04-26 Tian Lan , Deng Cai , Yan Wang , Yixuan Su , Heyan Huang , Xian-Ling Mao

Dense retrieval compresses texts into single embeddings ranked by cosine similarity. While efficient for recall, this interface is brittle for identity-level matching: minimal compositional edits (negation, role swaps) flip meaning yet…

Information Retrieval · Computer Science 2026-04-21 Radoslav Ralev , Aditeya Baral , Iliya Zhechev , Jen Agarwal , Srijith Rajamohan

Generative retrieval (GR) ranks documents by autoregressively generating document identifiers. Because many GR methods rely on trie-constrained beam search, they are vulnerable to early pruning of relevant prefixes under finite-beam…

Information Retrieval · Computer Science 2026-05-26 Kidist Amde Mekonnen , Yongkang Li , Yubao Tang , Simon Lupart , Maarten de Rijke

Retrieval Augmented Generation (RAG) is a highly effective paradigm for keeping LLM-based responses up-to-date and reducing the likelihood of hallucinations. Yet, RAG was recently shown to be quite vulnerable to corpus knowledge poisoning:…

Information Retrieval · Computer Science 2026-02-06 Sagie Dekel , Moshe Tennenholtz , Oren Kurland

The reliance on deep learning algorithms has grown significantly in recent years. Yet, these models are highly vulnerable to adversarial attacks, which introduce visually imperceptible perturbations into testing data to induce…

Machine Learning · Computer Science 2019-06-14 Rajeev Sahay , Rehana Mahfuz , Aly El Gamal

Large language models (LLMs) are now routinely used to autonomously execute complex tasks, from natural language processing to dynamic workflows like web searches. The usage of tool-calling and Retrieval Augmented Generation (RAG) allows…

Cryptography and Security · Computer Science 2026-04-13 Dennis Rall , Bernhard Bauer , Mohit Mittal , Thomas Fraunholz

Retrieval-augmented generation (RAG) enhances factual grounding by integrating retrieval mechanisms with generative models but introduces new attack surfaces, particularly through backdoor attacks. While prior research has largely focused…

Information Retrieval · Computer Science 2025-09-29 Gaurav Bagwe , Saket S. Chaturvedi , Xiaolong Ma , Xiaoyong Yuan , Kuang-Ching Wang , Lan Zhang

Retrieval-augmented generation (RAG) is a widely adopted paradigm for enhancing LLMs in medical applications by incorporating expert multimodal knowledge during generation. However, the underlying retrieval databases may naturally contain,…

Cryptography and Security · Computer Science 2026-05-12 Peiru Yang , Haoran Zheng , Tong Ju , Shiting Wang , Wanchun Ni , Jiajun Liu , Shangguang Wang , Yongfeng Huang , Tao Qi

With the rapid development of large-scale language models, Retrieval-Augmented Generation (RAG) has been widely adopted. However, existing RAG paradigms are inevitably influenced by erroneous retrieval information, thereby reducing the…

Information Retrieval · Computer Science 2024-05-30 Ridong Wu , Shuhong Chen , Xiangbiao Su , Yuankai Zhu , Yifei Liao , Jianming Wu

Dense retrieval, which describes the use of contextualised language models such as BERT to identify documents from a collection by leveraging approximate nearest neighbour (ANN) techniques, has been increasing in popularity. Two families of…

Information Retrieval · Computer Science 2021-08-27 Craig Macdonald , Nicola Tonellotto

Generative retrieval generates identifiers of relevant documents in an end-to-end manner using a sequence-to-sequence architecture for a given query. The relation between generative retrieval and other retrieval methods, especially those…

Information Retrieval · Computer Science 2024-04-02 Shiguang Wu , Wenda Wei , Mengqi Zhang , Zhumin Chen , Jun Ma , Zhaochun Ren , Maarten de Rijke , Pengjie Ren

Deep Neural Network classifiers are vulnerable to adversarial attack, where an imperceptible perturbation could result in misclassification. However, the vulnerability of DNN-based image ranking systems remains under-explored. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Mo Zhou , Le Wang , Zhenxing Niu , Qilin Zhang , Nanning Zheng , Gang Hua

Retrieval-Augmented Generation (RAG) systems depend on the geometric properties of vector representations to retrieve contextually appropriate evidence. When source documents interleave multiple topics within contiguous text, standard…

Artificial Intelligence · Computer Science 2026-04-21 Nick Loghmani

As Speech Large Language Models (Speech LLMs) become increasingly integrated into voice-based applications, ensuring their robustness against manipulative or adversarial input becomes critical. Although prior work has studied adversarial…

Computation and Language · Computer Science 2026-05-25 Jinyang Wu , Bin Zhu , Xiandong Zou , Qiquan Zhang , Xu Fang , Pan Zhou

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by incorporating external knowledge, but its openness introduces vulnerabilities that can be exploited by poisoning attacks. Existing poisoning methods for RAG…

Cryptography and Security · Computer Science 2025-05-27 Chunyang Li , Junwei Zhang , Anda Cheng , Zhuo Ma , Xinghua Li , Jianfeng Ma

Deploying dense retrieval models efficiently is becoming increasingly important across various industries. This is especially true for enterprise search services, where customizing search engines to meet the time demands of different…

Information Retrieval · Computer Science 2024-01-24 Chen Huang , Duanyu Feng , Wenqiang Lei , Jiancheng Lv

In book search, relevant book information should be returned in response to a query. Books contain complex, multi-faceted information such as metadata, outlines, and main text, where the outline provides hierarchical information between…

Information Retrieval · Computer Science 2025-01-22 Yubao Tang , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Shihao Liu , Shuaiqing Wang , Dawei Yin , Xueqi Cheng

Retrieval Augmented Generation (RAG) has proven to be highly effective in boosting the generative performance of language model in knowledge-intensive tasks. However, existing RAG framework either indiscriminately perform retrieval or rely…

Artificial Intelligence · Computer Science 2025-01-03 Xiaqiang Tang , Qiang Gao , Jian Li , Nan Du , Qi Li , Sihong Xie

We present a systematic study of provider-side data poisoning in retrieval-augmented recommender systems (RAG-based). By modifying only a small fraction of tokens within item descriptions -- for instance, adding emotional keywords or…

Information Retrieval · Computer Science 2025-05-09 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia , Eugenio Di Sciascio

Dense passage retrieval (DPR) is the first step in the retrieval augmented generation (RAG) paradigm for improving the performance of large language models (LLM). DPR fine-tunes pre-trained networks to enhance the alignment of the…

Computation and Language · Computer Science 2024-10-07 Benjamin Reichman , Larry Heck