English
Related papers

Related papers: RAID: A Shared Benchmark for Robust Evaluation of …

200 papers

Retrieval Augmented Generation (RAG) has advanced software engineering tasks but remains underexplored in unit test generation. To bridge this gap, we investigate the efficacy of RAG-based unit test generation for machine learning (ML/DL)…

Software Engineering · Computer Science 2025-10-20 Jiho Shin , Nima Shiri Harzevili , Reem Aleithan , Hadi Hemmati , Song Wang

The rapid advances in generative AI models have empowered the creation of highly realistic images with arbitrary content, raising concerns about potential misuse and harm, such as Deepfakes. Current research focuses on training detectors…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Zhiyuan He , Pin-Yu Chen , Tsung-Yi Ho

We address the problem of data scarcity in harmful text classification for guardrailing applications and introduce GRAID (Geometric and Reflective AI-Driven Data Augmentation), a novel pipeline that leverages Large Language Models (LLMs)…

Computation and Language · Computer Science 2025-08-26 Melissa Kazemi Rad , Alberto Purpura , Himanshu Kumar , Emily Chen , Mohammad Shahed Sorower

Deepfake or synthetic images produced using deep generative models pose serious risks to online platforms. This has triggered several research efforts to accurately detect deepfake images, achieving excellent performance on publicly…

Cryptography and Security · Computer Science 2024-04-26 Sifat Muhammad Abdullah , Aravind Cheruvu , Shravya Kanchi , Taejoong Chung , Peng Gao , Murtuza Jadliwala , Bimal Viswanath

Retrieval-Augmented Generation (RAG) has been empirically shown to enhance the performance of large language models (LLMs) in knowledge-intensive domains such as healthcare, finance, and legal contexts. Given a query, RAG retrieves relevant…

Cryptography and Security · Computer Science 2025-06-02 Xun Xian , Ganghua Wang , Xuan Bi , Jayanth Srinivasa , Ashish Kundu , Charles Fleming , Mingyi Hong , Jie Ding

The recent large-scale emergence of LLMs has left an open space for dealing with their consequences, such as plagiarism or the spread of false information on the Internet. Coupling this with the rise of AI detector bypassing tools, reliable…

Machine Learning · Computer Science 2026-05-15 Andrii Shportko , Inessa Verbitsky

We present a new benchmark for evaluating Deep Search--a realistic and complex form of retrieval-augmented generation (RAG) that requires source-aware, multi-hop reasoning over diverse, sparsed, but related sources. These include documents,…

Computation and Language · Computer Science 2025-07-01 Prafulla Kumar Choubey , Xiangyu Peng , Shilpa Bhagavath , Kung-Hsiang Huang , Caiming Xiong , Chien-Sheng Wu

The rapid advancements of generative AI have fueled the potential of generative text image editing, meanwhile escalating the threat of misinformation spreading. However, existing forensics methods struggle to detect unseen forgery types…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chenfan Qu , Yiwu Zhong , Fengjun Guo , Lianwen Jin

Large Language Models (LLMs) have demonstrated remarkable capabilities across various cybersecurity tasks, including vulnerability classification, detection, and patching. However, their potential in automated vulnerability report…

Recent improvements in the quality of the generations by large language models have spurred research into identifying machine-generated text. Such work often presents high-performing detectors. However, humans and machines can produce text…

Computation and Language · Computer Science 2024-12-13 Jad Doughman , Osama Mohammed Afzal , Hawau Olamide Toyin , Shady Shehata , Preslav Nakov , Zeerak Talat

Retrieval-Augmented Generation (RAG) has proven effective in mitigating hallucinations in large language models by incorporating external knowledge during inference. However, this integration introduces new security vulnerabilities,…

Cryptography and Security · Computer Science 2025-05-27 Baolei Zhang , Haoran Xin , Jiatong Li , Dongzhe Zhang , Minghong Fang , Zhuqing Liu , Lihai Nie , Zheli Liu

Large Language Models (LLMs) are increasingly used in software development to generate functions, such as attack detectors, that implement security requirements. A key challenge is ensuring the LLMs have enough knowledge to address specific…

Software Engineering · Computer Science 2025-09-18 Samuele Pasini , Jinhan Kim , Tommaso Aiello , Rocio Cabrera Lozoya , Antonino Sabetta , Paolo Tonella

Large language models (LLMs) have demonstrated remarkable capability to generate fluent responses to a wide variety of user queries. However, this has also raised concerns about the potential misuse of such texts in journalism, education,…

As AI-generated images proliferate across digital platforms, reliable detection methods have become critical for combating misinformation and maintaining content authenticity. While numerous deepfake detection methods have been proposed,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Simiao Ren , Yuchen Zhou , Xingyu Shen , Kidus Zewde , Tommy Duong , George Huang , Hatsanai , Tiangratanakul , Tsang , Ng , En Wei , Jiayu Xue

Recent advances in large language models (LLMs) and the intensifying popularity of ChatGPT-like applications have blurred the boundary of high-quality text generation between humans and machines. However, in addition to the anticipated…

Computation and Language · Computer Science 2023-10-25 Xiaomeng Hu , Pin-Yu Chen , Tsung-Yi Ho

In the era of large language models generating high quality texts, it is a necessity to develop methods for detection of machine-generated text to avoid harmful use or simply due to annotation purposes. It is, however, also important to…

Computation and Language · Computer Science 2024-12-18 Michal Spiegel , Dominik Macko

The generation of highly fluent text by Large Language Models (LLMs) poses a significant challenge to information integrity and academic research. In this paper, we introduce the Multi-Domain Detection of AI-Generated Text (M-DAIGT) shared…

Retrieval-augmented generation (RAG) systems have become widely used for enhancing large language model capabilities, but they introduce significant security vulnerabilities through prompt injection attacks. We present a comprehensive…

Cryptography and Security · Computer Science 2025-11-21 Badrinath Ramakrishnan , Akshaya Balaji

Nowadays, powerful large language models (LLMs) such as ChatGPT have demonstrated revolutionary power in a variety of tasks. Consequently, the detection of machine-generated texts (MGTs) is becoming increasingly crucial as LLMs become more…

Cryptography and Security · Computer Science 2024-01-17 Xinlei He , Xinyue Shen , Zeyuan Chen , Michael Backes , Yang Zhang

The rapid development of autoregressive Large Language Models (LLMs) has significantly improved the quality of generated texts, necessitating reliable machine-generated text detectors. A huge number of detectors and collections with AI…

Computation and Language · Computer Science 2025-03-10 German Gritsai , Anastasia Voznyuk , Andrey Grabovoy , Yury Chekhovich