中文
相关论文

相关论文: RAID: A Shared Benchmark for Robust Evaluation of …

200 篇论文

Detecting content generated by large language models (LLMs) is crucial for preventing misuse and building trustworthy AI systems. Although existing detection methods perform well, their robustness in out-of-distribution (OOD) scenarios is…

计算与语言 · 计算机科学 2025-08-19 Xin Chen , Junchao Wu , Shu Yang , Runzhe Zhan , Zeyu Wu , Ziyang Luo , Di Wang , Min Yang , Lidia S. Chao , Derek F. Wong

The growing adoption of Retrieval-Augmented Generation (RAG) has led to a rise in adversarial attacks. Existing defenses, relying on semantic analysis or voting, face a trade-off between high computational cost and limited robustness under…

密码学与安全 · 计算机科学 2026-05-20 Chengcai Gao , Zhihong Sun , Xiaochuan Shi , Qiufeng Wang , Chao Liang

Retrieval-augmented generation (RAG) enhances Large Language Models (LLMs) by mitigating hallucinations and outdated information issues, yet simultaneously facilitates unauthorized data appropriation at scale. This paper addresses this…

信息检索 · 计算机科学 2025-10-10 Peiyang Liu , Ziqiang Cui , Di Liang , Wei Ye

Large language models are increasingly used for many applications. To prevent illicit use, it is desirable to be able to detect AI-generated text. Training and evaluation of such detectors critically depend on suitable benchmark datasets.…

机器学习 · 计算机科学 2025-11-13 Philipp Dingfelder , Christian Riess

The tremendous recent advances in generative artificial intelligence techniques have led to significant successes and promise in a wide range of different applications ranging from conversational agents and textual content generation to…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Hossein Aboutalebi , Dayou Mao , Rongqi Fan , Carol Xu , Chris He , Alexander Wong

Most state-of-the-art machine learning (ML) classification systems are vulnerable to adversarial perturbations. As a consequence, adversarial robustness poses a significant challenge for the deployment of ML-based systems in safety- and…

Detecting AI-generated text is a difficult problem to begin with; detecting AI-generated text on social media is made even more difficult due to the short text length and informal, idiosyncratic language of the internet. It is nonetheless…

计算与语言 · 计算机科学 2025-06-17 Hillary Dawkins , Kathleen C. Fraser , Svetlana Kiritchenko

Word-level adversarial attacks have shown success in NLP models, drastically decreasing the performance of transformer-based models in recent years. As a countermeasure, adversarial defense has been explored, but relatively few efforts have…

计算与语言 · 计算机科学 2022-03-04 KiYoon Yoo , Jangho Kim , Jiho Jang , Nojun Kwak

The rapid advancement of Generative Artificial Intelligence (GenAI) capabilities is accompanied by a concerning rise in its misuse. In particular the generation of credible misinformation in the form of images poses a significant threat to…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Sina Mavali , Jonas Ricker , David Pape , Asja Fischer , Lea Schönherr

This systematic review of the research literature on retrieval-augmented generation (RAG) provides a focused analysis of the most highly cited studies published between 2020 and May 2025. A total of 128 articles met our inclusion criteria.…

数字图书馆 · 计算机科学 2025-09-10 Andrew Brown , Muhammad Roman , Barry Devereux

Frequent cyber-attacks have elevated WebShell exploitation and defense to a critical research focus within network security. However, there remains a significant shortage of publicly available, well-categorized malicious-code datasets…

密码学与安全 · 计算机科学 2025-06-02 Yizhong Ding

Since many real-world documents combine textual and tabular data, robust Retrieval Augmented Generation (RAG) systems are essential for effectively accessing and analyzing such content to support complex reasoning tasks. Therefore, this…

信息检索 · 计算机科学 2026-01-19 Jan Strich , Enes Kutay Isgorur , Maximilian Trescher , Chris Biemann , Martin Semmann

The rapid proliferation of large language models (LLMs) has increased the volume of machine-generated texts (MGTs) and blurred text authorship in various domains. However, most existing MGT benchmarks include single-author texts…

Recent advancements in natural language processing have highlighted the vulnerability of deep learning models to adversarial attacks. While various defence mechanisms have been proposed, there is a lack of comprehensive benchmarks that…

计算与语言 · 计算机科学 2025-01-23 Yang Wang , Chenghua Lin

Existing methods for the zero-shot detection of machine-generated text are dominated by three statistical quantities: log-likelihood, log-rank, and entropy. As language models mimic the distribution of human text ever closer, this will…

计算与语言 · 计算机科学 2025-03-27 Tom Kempton , Stuart Burrell , Connor Cheverall

Retrieval-Augmented Generation (RAG) has gained prominence as an effective method for enhancing the generative capabilities of Large Language Models (LLMs) through the incorporation of external knowledge. However, the evaluation of RAG…

计算与语言 · 计算机科学 2025-04-25 Chanhee Park , Hyeonseok Moon , Chanjun Park , Heuiseok Lim

The meteoric rise in text generation capability has been accompanied by parallel growth in interest in machine-generated text detection: the capability to identify whether a given text was generated using a model or written by a person.…

计算与语言 · 计算机科学 2026-04-24 Kevin Stowe , Svetlana Afanaseva , Rodolfo Raimundo , Yitao Sun , Kailash Patil

Retrieval-Augmented Generation (RAG) improves large language models (LLMs) by retrieving relevant information from external sources and has been widely adopted for text-based tasks. For structured data, such as knowledge graphs, Graph…

信息检索 · 计算机科学 2026-03-05 Haoyu Han , Li Ma , Yu Wang , Harry Shomer , Yongjia Lei , Zhisheng Qi , Kai Guo , Zhigang Hua , Bo Long , Hui Liu , Charu C. Aggarwal , Jiliang Tang

The rapid progress of large language models has enabled the generation of text that closely resembles human writing, creating challenges for authenticity verification in education, publishing, and digital security. Detecting AI-generated…

计算与语言 · 计算机科学 2026-01-29 Michał Gromadzki , Anna Wróblewska , Agnieszka Kaliska

In response to adversarial text attacks, attack detection models have been proposed and shown to successfully identify text modified by adversaries. Attack detection models can be leveraged to provide an additional check for NLP models and…

计算与语言 · 计算机科学 2025-09-26 Jonathan Rusert