English

Retrieval Collapses When AI Pollutes the Web

Information Retrieval 2026-02-19 v1 Artificial Intelligence

Abstract

The rapid proliferation of AI-generated content on the Web presents a structural risk to information retrieval, as search engines and Retrieval-Augmented Generation (RAG) systems increasingly consume evidence produced by the Large Language Models (LLMs). We characterize this ecosystem-level failure mode as Retrieval Collapse, a two-stage process where (1) AI-generated content dominates search results, eroding source diversity, and (2) low-quality or adversarial content infiltrates the retrieval pipeline. We analyzed this dynamic through controlled experiments involving both high-quality SEO-style content and adversarially crafted content. In the SEO scenario, a 67\% pool contamination led to over 80\% exposure contamination, creating a homogenized yet deceptively healthy state where answer accuracy remains stable despite the reliance on synthetic sources. Conversely, under adversarial contamination, baselines like BM25 exposed \sim19\% of harmful content, whereas LLM-based rankers demonstrated stronger suppression capabilities. These findings highlight the risk of retrieval pipelines quietly shifting toward synthetic evidence and the need for retrieval-aware strategies to prevent a self-reinforcing cycle of quality decline in Web-grounded systems.

Keywords

Cite

@article{arxiv.2602.16136,
  title  = {Retrieval Collapses When AI Pollutes the Web},
  author = {Hongyeon Yu and Dongchan Kim and Young-Bum Kim},
  journal= {arXiv preprint arXiv:2602.16136},
  year   = {2026}
}

Comments

4 pages, Proceedings of The Web Conference 2026 (WWW '26)

R2 v1 2026-07-01T10:40:46.964Z