中文
相关论文

相关论文: The Impact of Prompts on Zero-Shot Detection of AI…

200 篇论文

Zero-shot keyphrase extraction aims to build a keyphrase extractor without training by human-annotated data, which is challenging due to the limited human intervention involved. Challenging but worthwhile, zero-shot setting efficiently…

计算与语言 · 计算机科学 2024-01-11 Mingyang Song , Xuelian Geng , Songfang Yao , Shilong Lu , Yi Feng , Liping Jing

Large language models (LLMs) are widely used as zero-shot and few-shot classifiers, where task behaviour is largely controlled through prompting. A growing number of works have observed that LLMs are sensitive to prompt variations, with…

计算与语言 · 计算机科学 2026-02-05 Branislav Pecher , Michal Spiegel , Robert Belanec , Jan Cegin

The rampant proliferation of large language models, fluent enough to generate text indistinguishable from human-written language, gives unprecedented importance to the detection of machine-generated text. This work is motivated by an…

计算与语言 · 计算机科学 2023-10-10 Xiao Pu , Jingyu Zhang , Xiaochuang Han , Yulia Tsvetkov , Tianxing He

In this paper, we study the problem of detecting machine-generated text when the large language model (LLM) it is possibly derived from is unknown. We do so by apply ensembling methods to the outputs from DetectGPT classifiers (Mitchell et…

计算与语言 · 计算机科学 2024-06-19 Ivan Ong , Boon King Quek

As texts generated by Large Language Models (LLMs) are ever more common and often indistinguishable from human-written content, research on automatic text detection has attracted growing attention. Many recent detectors report near-perfect…

计算与语言 · 计算机科学 2025-10-16 Matthieu Dubois , François Yvon , Pablo Piantanida

Millions of users prompt large language models (LLMs) for various tasks, but how good are people at prompt engineering? Do users actually get closer to their desired outcome over multiple iterations of their prompts? These questions are…

人机交互 · 计算机科学 2025-09-03 Zeyu He , Saniya Naphade , Ting-Hao 'Kenneth' Huang

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks and exhibited impressive reasoning abilities by applying zero-shot Chain-of-Thought (CoT) prompting. However, due to the evolving nature of sentence…

计算与语言 · 计算机科学 2024-02-09 Feihu Jin , Yifan Liu , Ying Tan

The growing use of large language models (LLMs) for text generation has led to widespread concerns about AI-generated content detection. However, an overlooked challenge is AI-polished text, where human-written content undergoes subtle…

计算与语言 · 计算机科学 2025-05-06 Shoumik Saha , Soheil Feizi

In this paper, we propose a novel prompting approach aimed at enhancing the ability of Large Language Models (LLMs) to generate accurate Python code. Specifically, we introduce a prompt template designed to improve the quality and…

Large language models (LLMs) have been widely adopted in applications such as automated content generation and even critical decision-making systems. However, the risk of prompt injection allows for potential manipulation of LLM outputs.…

计算与语言 · 计算机科学 2024-11-25 Jiashuo Liang , Guancheng Li , Yang Yu

AI Generated Text (AIGT) detectors are developed with texts from humans and LLMs of common tasks. Despite the diversity of plausible prompt choices, these datasets are generally constructed with a limited number of prompts. The lack of…

计算与语言 · 计算机科学 2024-06-25 Choonghyun Park , Hyuhng Joon Kim , Junyeob Kim , Youna Kim , Taeuk Kim , Hyunsoo Cho , Hwiyeol Jo , Sang-goo Lee , Kang Min Yoo

The increasing fluency and widespread usage of large language models (LLMs) highlight the desirability of corresponding tools aiding detection of LLM-generated text. In this paper, we identify a property of the structure of an LLM's…

计算与语言 · 计算机科学 2023-07-25 Eric Mitchell , Yoonho Lee , Alexander Khazatsky , Christopher D. Manning , Chelsea Finn

Large language models (LLMs) have become indispensable for automated code generation, yet the quality and security of their outputs remain a critical concern. Existing studies predominantly concentrate on adversarial attacks or inherent…

密码学与安全 · 计算机科学 2026-05-11 Bin Wang , YiLu Zhong , MiDi Wan , WenJie Yu , YuanBing Ouyang , Yenan Huang , Hui Li

The use of Large Language Models (LLMs) for program code generation has gained substantial attention, but their biases and limitations with non-English prompts challenge global inclusivity. This paper investigates the complexities of…

计算与语言 · 计算机科学 2025-05-13 Mingda Li , Abhijit Mishra , Utkarsh Mujumdar

Current methods for prompt learning in zeroshot scenarios widely rely on a development set with sufficient human-annotated data to select the best-performing prompt template a posteriori. This is not ideal because in a realworld zero-shot…

计算与语言 · 计算机科学 2023-05-17 Jinghui Lu , Dongsheng Zhu , Weidong Han , Rui Zhao , Brian Mac Namee , Fei Tan

This paper presents null-shot prompting. Null-shot prompting exploits hallucination in large language models (LLMs) by instructing LLMs to utilize information from the "Examples" section that never exists within the provided context to…

计算与语言 · 计算机科学 2024-11-19 Pittawat Taveekitworachai , Febri Abdullah , Ruck Thawonmas

Instruction-tuned Language Models (ILMs) have become essential components of modern AI systems, demonstrating exceptional versatility across natural language and reasoning tasks. Among their most impactful applications is code generation,…

软件工程 · 计算机科学 2026-02-18 Zaiyu Cheng , Antonio Mastropaolo

Detecting Large Language Model (LLM)-generated code is a growing challenge with implications for security, intellectual property, and academic integrity. We investigate the role of conditional probability distributions in improving…

计算与语言 · 计算机科学 2025-06-09 Maor Ashkenazi , Ofir Brenner , Tal Furman Shohet , Eran Treister

The rapid development of autoregressive Large Language Models (LLMs) has significantly improved the quality of generated texts, necessitating reliable machine-generated text detectors. A huge number of detectors and collections with AI…

计算与语言 · 计算机科学 2025-03-10 German Gritsai , Anastasia Voznyuk , Andrey Grabovoy , Yury Chekhovich

Large Language Models (LLMs), exemplified by ChatGPT, have significantly reshaped text generation, particularly in the realm of writing assistance. While ethical considerations underscore the importance of transparently acknowledging LLM…

信息检索 · 计算机科学 2025-09-03 Teddy Lazebnik , Ariel Rosenfeld