English
Related papers

Related papers: Beyond Easy Wins: A Text Hardness-Aware Benchmark …

200 papers

The rapid progress of large language models has enabled the generation of text that closely resembles human writing, creating challenges for authenticity verification in education, publishing, and digital security. Detecting AI-generated…

Computation and Language · Computer Science 2026-01-29 Michał Gromadzki , Anna Wróblewska , Agnieszka Kaliska

Social media platforms are plagued by harmful content such as hate speech, misinformation, and extremist rhetoric. Machine learning (ML) models are widely adopted to detect such content; however, they remain highly vulnerable to adversarial…

Machine Learning · Computer Science 2025-12-30 Yidong Chai , Yi Liu , Mohammadreza Ebrahimi , Weifeng Li , Balaji Padmanabhan

Evaluation of models on benchmarks is unreliable without knowing the degree of sample hardness; this subsequently overestimates the capability of AI systems and limits their adoption in real world applications. We propose a Data Scoring…

Computation and Language · Computer Science 2022-10-17 Swaroop Mishra , Anjana Arunkumar , Chris Bryan , Chitta Baral

The rising popularity of large language models (LLMs) has raised concerns about machine-generated text (MGT), particularly in academic settings, where issues like plagiarism and misinformation are prevalent. As a result, developing a highly…

Artificial Intelligence · Computer Science 2025-08-05 Yule Liu , Zhiyuan Zhong , Yifan Liao , Zhen Sun , Jingyi Zheng , Jiaheng Wei , Qingyuan Gong , Fenghua Tong , Yang Chen , Yang Zhang , Xinlei He

While historical considerations surrounding text authenticity revolved primarily around plagiarism, the advent of large language models (LLMs) has introduced a new challenge: distinguishing human-authored from AI-generated text. This shift…

The rapid adoption of large language models (LLMs) in scientific writing raises serious concerns regarding authorship integrity and the reliability of scholarly publications. Existing detection approaches mainly rely on document-level…

Computation and Language · Computer Science 2025-10-02 Zhen Yin , Shenghua Wang

The rapid advancement of Large Language Models (LLMs) has revolutionized text generation but also raised concerns about potential misuse, making detecting LLM-generated text (AI text) increasingly essential. While prior work has focused on…

Computation and Language · Computer Science 2025-09-30 Nafis Irtiza Tripto , Saranya Venkatraman , Mahjabin Nahar , Dongwon Lee

Detecting LLM-generated text in specialized and high-stakes domains like medicine and law is crucial for combating misinformation and ensuring authenticity. However, current zero-shot detectors, while effective on general text, often fail…

Computation and Language · Computer Science 2025-06-10 Zhihui Chen , Kai He , Yucheng Huang , Yunxiao Zhu , Mengling Feng

Ransomware's escalating sophistication necessitates tamper-resistant, off-host detection solutions that capture deep disk activity beyond the reach of a compromised operating system. Existing detection systems use host/kernel signals or…

Cryptography and Security · Computer Science 2026-03-13 Md Raz , Venkata Sai Charan Putrevu , Prashanth Krishnamurthy , Farshad Khorrami , Ramesh Karri

In the present-day scenario, Large Language Models (LLMs) are establishing their presence as powerful instruments permeating various sectors of society. While their utility offers valuable support to individuals, there are multiple concerns…

Computation and Language · Computer Science 2025-07-01 Badr Youbi Idrissi , Monica Millunzi , Amelia Sorrenti , Lorenzo Baraldi , Daryna Dementieva

Large Language Models (LLMs) have revolutionized text generation, making detecting machine-generated text increasingly challenging. Although past methods have achieved good performance on detecting pure machine-generated text, those…

Computation and Language · Computer Science 2024-12-24 Jiaqi Chen , Xiaoye Zhu , Tianyang Liu , Ying Chen , Xinhui Chen , Yiwen Yuan , Chak Tou Leong , Zuchao Li , Tang Long , Lei Zhang , Chenyu Yan , Guanghao Mei , Jie Zhang , Lefei Zhang

The effective detection and governance of Large Language Model (LLM) generated content has become increasingly critical due to the growing risk of misuse. Despite the impressive performance of existing detectors, their reliability and…

Computation and Language · Computer Science 2026-05-20 Junchao Wu , Yefeng Liu , Chenyu Zhu , Hao Zhang , Zeyu Wu , Tianqi Shi , Yichao Du , Longyue Wang , Weihua Luo , Jinsong Su , Derek F. Wong

How can we distinguish whether a peer review was written by a human or generated by an AI model? We argue that, in this setting, authorship should not be attributed solely from the textual features of a review, but also from the ideas,…

Computation and Language · Computer Science 2026-05-22 André V. Duarte , Brian Tufts , Aditya Oke , Fei Fang , Arlindo L. Oliveira , Lei Li

Detecting AI-generated text is an important but challenging problem. Existing likelihood-based detection methods are often sensitive to content complexity and may exhibit unstable performance. In this paper, our key insight is that modern…

Artificial Intelligence · Computer Science 2026-04-21 Junxi Wu , Kailin Huang , Dongjian Hu , Bin Chen , Hao Wu , Shu-Tao Xia , Changliang Zou

Despite considerable progress in the development of machine-text detectors, it has been suggested that the problem is inherently hard, and therefore, that stakeholders should proceed under the assumption that machine-generated text cannot…

Computation and Language · Computer Science 2025-09-30 Rafael Rivera Soto , Barry Chen , Nicholas Andrews

Standard benchmarks of bias and fairness in large language models (LLMs) measure the association between the user attributes stated or implied by a prompt and the LLM's short text response, but human-AI interaction increasingly requires…

Computation and Language · Computer Science 2025-06-06 Kristian Lum , Jacy Reese Anthis , Kevin Robinson , Chirag Nagpal , Alexander D'Amour

The widespread adoption of ChatGPT has raised concerns about its misuse, highlighting the need for robust detection of AI-generated text. Current word-level detectors are vulnerable to paraphrasing or simple prompts (PSP), suffer from…

Computation and Language · Computer Science 2025-09-24 Mo Mu , Dianqiao Lei , Chang Li

End-to-end text spotting aims to jointly optimize text detection and recognition within a unified framework. Despite significant progress, designing an accurate and efficient end-to-end text spotter for arbitrary-shaped text remains…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yuchen Su , Zhineng Chen , Yongkun Du , Zuxuan Wu , Hongtao Xie , Yu-Gang Jiang

Human and model-generated texts can be distinguished by examining the magnitude of likelihood in language. However, it is becoming increasingly difficult as language model's capabilities of generating human-like texts keep evolving. This…

Computation and Language · Computer Science 2024-10-10 Yang Xu , Yu Wang , Hao An , Zhichen Liu , Yongyuan Li

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

Computation and Language · Computer Science 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan