English
Related papers

Related papers: WETBench: A Benchmark for Detecting Task-Specific …

200 papers

Conducting literature reviews for scientific papers is essential for understanding research, its limitations, and building on existing work. It is a tedious task which makes an automatic literature review generator appealing. Unfortunately,…

Machine Translation (MT) plays a pivotal role in cross-lingual information access, public policy communication, and equitable knowledge dissemination. However, critical meaning errors, such as factual distortions, intent reversals, or…

Computation and Language · Computer Science 2026-02-13 Muskaan Chopra , Lorenz Sparrenberg , Rafet Sifa

Web agents, which couple language models with browsing and tool-use capabilities, show promise as open web assistants. Yet progress is increasingly limited by the lack of scalable, process-level supervision. Existing benchmarks are largely…

Artificial Intelligence · Computer Science 2026-05-29 Tenghao Huang , Kung-Hsiang Huang , Prafulla Kumar Choubey , Yilun Zhou , Muhao Chen , Jonathan May , Chien-Sheng Wu

Lack of encyclopedic text contributors, especially on Wikipedia, makes automated text generation for low resource (LR) languages a critical problem. Existing work on Wikipedia text generation has focused on English only where English…

Computation and Language · Computer Science 2023-05-17 Dhaval Taunk , Shivprasad Sagare , Anupam Patil , Shivansh Subramanian , Manish Gupta , Vasudeva Varma

This document contains the details of the authors' submission to the proceedings of SemEval 2024's Task 8: Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection Subtask A (monolingual) and B. Detection of…

Computation and Language · Computer Science 2024-04-10 Ayan Datta , Aryan Chandramania , Radhika Mamidi

Generating natural and informative texts has been a long-standing problem in NLP. Much effort has been dedicated into incorporating pre-trained language models (PLMs) with various open-world knowledge, such as knowledge graphs or wiki…

Computation and Language · Computer Science 2022-03-17 Chao-Hong Tan , Jia-Chen Gu , Chongyang Tao , Zhen-Hua Ling , Can Xu , Huang Hu , Xiubo Geng , Daxin Jiang

In the present-day scenario, Large Language Models (LLMs) are establishing their presence as powerful instruments permeating various sectors of society. While their utility offers valuable support to individuals, there are multiple concerns…

Computation and Language · Computer Science 2025-07-01 Badr Youbi Idrissi , Monica Millunzi , Amelia Sorrenti , Lorenzo Baraldi , Daryna Dementieva

The rapid adoption of large language models (LLMs) in customer service introduces new risks, as malicious actors can exploit them to conduct large-scale user impersonation through machine-generated text (MGT). Current MGT detection methods…

Computation and Language · Computer Science 2025-08-27 Angela Yifei Yuan , Haoyi Li , Soyeon Caren Han , Christopher Leckie

The task of discerning between generated and natural texts is increasingly challenging. In this context, watermarking emerges as a promising technique for ascribing generated text to a specific model. It alters the sampling generation…

Computation and Language · Computer Science 2023-11-09 Pierre Fernandez , Antoine Chaffin , Karim Tit , Vivien Chappelier , Teddy Furon

Large language models (LLMs) have advanced to a point that even humans have difficulty discerning whether a text was generated by another human, or by a computer. However, knowing whether a text was produced by human or artificial…

Computation and Language · Computer Science 2025-04-15 Kathleen C. Fraser , Hillary Dawkins , Svetlana Kiritchenko

The impressive ability of large language models to generate natural text across various tasks has led to critical challenges in authorship authentication. Although numerous detection methods have been developed to differentiate between…

Computation and Language · Computer Science 2025-05-20 Xu Zheng , Zhuomin Chen , Esteban Schafir , Sipeng Chen , Hojat Allah Salehi , Haifeng Chen , Farhad Shirani , Wei Cheng , Dongsheng Luo

The generative plagiarism detection task at PAN 2025 aims at identifying automatically generated textual plagiarism in scientific articles and aligning them with their respective sources. We created a novel large-scale dataset of…

Computation and Language · Computer Science 2025-10-09 André Greiner-Petter , Maik Fröbe , Jan Philip Wahle , Terry Ruas , Bela Gipp , Akiko Aizawa , Martin Potthast

Widely applied large language models (LLMs) can generate human-like content, raising concerns about the abuse of LLMs. Therefore, it is important to build strong AI-generated text (AIGT) detectors. Current works only consider document-level…

Computation and Language · Computer Science 2023-12-18 Pengyu Wang , Linyang Li , Ke Ren , Botian Jiang , Dong Zhang , Xipeng Qiu

In recent years, the remarkable progress of large language models (LLMs) has sparked interest in task automation, which involves decomposing complex tasks described by user instructions into sub-tasks and invoking external tools to execute…

Computation and Language · Computer Science 2024-11-04 Yongliang Shen , Kaitao Song , Xu Tan , Wenqi Zhang , Kan Ren , Siyu Yuan , Weiming Lu , Dongsheng Li , Yueting Zhuang

Wikipedia, a paradigmatic example of online knowledge space is organized in a collaborative, bottom-up way with voluntary contributions, yet it maintains a level of reliability comparable to that of traditional encyclopedias. The lack of…

Physics and Society · Physics 2021-05-24 Fumiko Ogushi , János Kertész , Kimmo Kaski , Takashi Shimada

The widespread adoption of Large Language Models (LLMs) has made the detection of AI-Generated text a pressing and complex challenge. Although many detection systems report high benchmark accuracy, their reliability in real-world settings…

Computation and Language · Computer Science 2026-04-23 Shushanta Pudasaini , Luis Miralles-Pechuán , David Lillis , Marisa Llorens Salvador

Recent advancements in Large Language Models (LLMs) and their increased accessibility have made it easier than ever for students to automatically generate texts, posing new challenges for educational institutions. To enforce norms of…

Computation and Language · Computer Science 2025-08-12 Lukas Gehring , Benjamin Paaßen

Recent studies have raised concerns about the potential threats large language models (LLMs) pose to academic integrity and copyright protection. Yet, their investigation is predominantly focused on literal copies of original texts. Also,…

Computation and Language · Computer Science 2025-02-18 Jooyoung Lee , Toshini Agrawal , Adaku Uchendu , Thai Le , Jinghui Chen , Dongwon Lee

Detecting text generated by modern large language models is thought to be hard, as both LLMs and humans can exhibit a wide range of complex behaviors. However, we find that a score based on contrasting two closely related language models is…

Computation and Language · Computer Science 2024-10-15 Abhimanyu Hans , Avi Schwarzschild , Valeriia Cherepanova , Hamid Kazemi , Aniruddha Saha , Micah Goldblum , Jonas Geiping , Tom Goldstein

Auditing the machine learning (ML) models used on Wikipedia is important for ensuring that vandalism-detection processes remain fair and effective. However, conducting audits is challenging because stakeholders have diverse priorities and…

Human-Computer Interaction · Computer Science 2024-06-13 Zachary Levonian , Lauren Hagen , Lu Li , Jada Lilleboe , Solvejg Wastvedt , Aaron Halfaker , Loren Terveen