中文
相关论文

相关论文: Exploiting Positional Bias for Query-Agnostic Gene…

200 篇论文

When answering user queries, LLMs often retrieve knowledge from external sources stored in retrieval-augmented generation (RAG) databases. These are often populated from unvetted sources, e.g. the open web, and can contain maliciously…

密码学与安全 · 计算机科学 2026-03-27 Hao Wu , Prateek Saxena

Adversarial text attacks remain a persistent threat to transformer models, yet existing defenses are typically attack-specific or require costly model retraining, leaving a gap for attack-agnostic detection. We introduce Guided Perturbation…

机器学习 · 计算机科学 2026-01-30 Bryan E. Tuck , Rakesh M. Verma

Embedding models are crucial for tasks in Information Retrieval (IR) and semantic similarity measurement, yet their handling of longer texts and associated positional biases remains underexplored. In this study, we investigate the impact of…

计算与语言 · 计算机科学 2026-01-01 Reagan J. Lee , Samarth Goel , Kannan Ramchandran

Retrieval-Augmented Generation (RAG) has become a widely adopted approach to enhance Large Language Models (LLMs) by incorporating external knowledge and reducing hallucinations. However, noisy or irrelevant documents are often introduced…

计算与语言 · 计算机科学 2026-01-07 Jingyu Liu , Jiaen Lin , Yong Liu

There has been recently a growing interest in studying adversarial examples on natural language models in the black-box setting. These methods attack natural language classifiers by perturbing certain important words until the classifier…

机器学习 · 计算机科学 2021-05-04 Mahmoud Hossam , Trung Le , He Zhao , Viet Huynh , Dinh Phung

Large Language Models (LLMs) are increasingly used in applications where the model selects from competing third-party content, such as in LLM-powered search engines or chatbot plugins. In this paper, we introduce Preference Manipulation…

密码学与安全 · 计算机科学 2024-07-03 Fredrik Nestaas , Edoardo Debenedetti , Florian Tramèr

Neural ranking models (NRMs) have been shown to be highly effective in terms of retrieval performance. Unfortunately, they have also displayed a higher degree of sensitivity to attacks than previous generation models. To help expose and…

信息检索 · 计算机科学 2024-12-30 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Position bias has proven to be a prevalent issue of modern language models (LMs), where the models prioritize content based on its position within the given context. This bias often leads to unexpected model failures and hurts performance,…

计算与语言 · 计算机科学 2025-04-02 Ziqi Wang , Hanlin Zhang , Xiner Li , Kuan-Hao Huang , Chi Han , Shuiwang Ji , Sham M. Kakade , Hao Peng , Heng Ji

It is known that neural networks are subject to attacks through adversarial perturbations, i.e., inputs which are maliciously crafted through perturbations to induce wrong predictions. Furthermore, such attacks are impossible to eliminate,…

计算与语言 · 计算机科学 2022-01-10 Guoliang Dong , Jingyi Wang , Jun Sun , Sudipta Chattopadhyay , Xinyu Wang , Ting Dai , Jie Shi , Jin Song Dong

Recently, the emergence of large language models (LLMs) has revolutionized the paradigm of information retrieval (IR) applications, especially in web search, by generating vast amounts of human-like texts on the Internet. As a result, IR…

信息检索 · 计算机科学 2024-08-01 Sunhao Dai , Yuqi Zhou , Liang Pang , Weihao Liu , Xiaolin Hu , Yong Liu , Xiao Zhang , Gang Wang , Jun Xu

Argument mining is a core technology for automating argument search in large document collections. Despite its usefulness for this task, most current approaches to argument mining are designed for use only with specific text types and fall…

计算与语言 · 计算机科学 2018-02-19 Christian Stab , Tristan Miller , Iryna Gurevych

Recent studies have highlighted the significant potential of Large Language Models (LLMs) as zero-shot relevance rankers. These methods predominantly utilize prompt learning to assess the relevance between queries and documents by…

信息检索 · 计算机科学 2024-11-08 Dezhi Ye , Junwei Hu , Jiabin Fan , Bowen Tian , Jie Liu , Haijin Liang , Jin Ma

With the advancement of generation models, AI-generated content (AIGC) is becoming more realistic, flooding the Internet. A recent study suggests that this phenomenon causes source bias in text retrieval for web search. Specifically, neural…

信息检索 · 计算机科学 2024-05-28 Shicheng Xu , Danyang Hou , Liang Pang , Jingcheng Deng , Jun Xu , Huawei Shen , Xueqi Cheng

Recent advances in unbiased learning to rank (LTR) count on Inverse Propensity Scoring (IPS) to eliminate bias in implicit feedback. Though theoretically sound in correcting the bias introduced by treating clicked documents as relevant, IPS…

信息检索 · 计算机科学 2021-11-16 Nan Wang , Zhen Qin , Xuanhui Wang , Hongning Wang

The increasing integration of Large Language Model (LLM) based search engines has transformed the landscape of information retrieval. However, these systems are vulnerable to adversarial attacks, especially ranking manipulation attacks,…

计算与语言 · 计算机科学 2025-05-19 Xiyang Hu

Recent advances in large reasoning models (LRMs) have enabled remarkable performance on complex tasks such as mathematics and coding by generating long Chain-of-Thought (CoT) traces. In this paper, we identify and systematically analyze a…

人工智能 · 计算机科学 2025-10-21 Zhehao Zhang , Weijie Xu , Shixian Cui , Chandan K. Reddy

Neural ranking models (NRMs) have shown great success in information retrieval (IR). But their predictions can easily be manipulated using adversarial examples, which are crafted by adding imperceptible perturbations to legitimate…

信息检索 · 计算机科学 2023-12-19 Yu-An Liu , Ruqing Zhang , Mingkun Zhang , Wei Chen , Maarten de Rijke , Jiafeng Guo , Xueqi Cheng

We propose the Neural Vector Space Model (NVSM), a method that learns representations of documents in an unsupervised manner for news article retrieval. In the NVSM paradigm, we learn low-dimensional representations of words and documents…

信息检索 · 计算机科学 2018-08-21 Christophe Van Gysel , Maarten de Rijke , Evangelos Kanoulas

Natural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks -- malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. However,…

计算与语言 · 计算机科学 2023-05-26 Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy

In web search and recommendation systems, user clicks are widely used to train ranking models. However, click data is heavily biased, i.e., users tend to click higher-ranked items (position bias), choose only what was shown to them…

人工智能 · 计算机科学 2026-01-12 Haoming Gong , Qingyao Ai , Zhihao Tao , Yongfeng Zhang