English
Related papers

Related papers: MGTEVAL: An Interactive Platform for Systemtic Eva…

200 papers

The rapid advancement of large language models (LLMs) has made machine-generated text increasingly difficult to distinguish from human-written text. While recent studies explore leveraging internal representations of language models to…

Applications · Statistics 2026-05-14 Luxu Liang , Xiang Li

Recent advancements in table-based reasoning have expanded beyond factoid-level QA to address insight-level tasks, where systems should synthesize implicit knowledge in the table to provide explainable analyses. Although effective, existing…

Computation and Language · Computer Science 2025-06-03 Kwangwook Seo , Donguk Kwon , Dongha Lee

Large language models (LLMs) such as ChatGPT are increasingly being used for various use cases, including text content generation at scale. Although detection methods for such AI-generated text exist already, we investigate ChatGPT's…

Computation and Language · Computer Science 2023-08-21 Amrita Bhattacharjee , Huan Liu

Large language models (LLMs) have grown more powerful in language generation, producing fluent text and even imitating personal style. Yet, this ability also heightens the risk of identity impersonation. To the best of our knowledge, no…

Computation and Language · Computer Science 2026-05-01 Lang Gao , Xuhui Li , Chenxi Wang , Mingzhe Li , Wei Liu , Zirui Song , Jinghui Zhang , Rui Yan , Preslav Nakov , Xiuying Chen

The detection of computer-generated text is an area of rapidly increasing significance as nascent generative models allow for efficient creation of compelling human-like text, which may be abused for the purposes of spam, disinformation,…

Computation and Language · Computer Science 2022-10-05 Evan Crothers , Nathalie Japkowicz , Herna Viktor , Paula Branco

Our research focuses on the crucial challenge of discerning text produced by Large Language Models (LLMs) from human-generated text, which holds significance for various applications. With ongoing discussions about attaining a model with…

Computation and Language · Computer Science 2023-11-28 Raghav Gaggar , Ashish Bhagchandani , Harsh Oza

Generating multi-vehicle trajectories from existing limited data can provide rich resources for autonomous vehicle development and testing. This paper introduces a multi-vehicle trajectory generator (MTG) that can encode multi-vehicle…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Wenhao Ding , Wenshuo Wang , Ding Zhao

Recent releases of Large Language Models (LLMs), e.g. ChatGPT, are astonishing at generating human-like texts, but they may impact the authenticity of texts. Previous works proposed methods to detect these AI-generated texts, including…

Computation and Language · Computer Science 2024-03-06 Yuchuan Tian , Hanting Chen , Xutao Wang , Zheyuan Bai , Qinghua Zhang , Ruifeng Li , Chao Xu , Yunhe Wang

Multi-step reasoning remains a key challenge for Large Language Models (LLMs), particularly in complex domains such as mathematics and creative writing. While recent approaches including ReAct, Reflexion, and Self-Refine improve reasoning…

Artificial Intelligence · Computer Science 2026-01-07 Abhishek HS , Pavan C Shekar , Arpit Jain , Ashwanth Krishnan

The rapid development of large language model (LLM) evaluation methodologies and datasets has led to a profound challenge: integrating state-of-the-art evaluation techniques cost-effectively while ensuring reliability, reproducibility, and…

Computation and Language · Computer Science 2024-04-10 Zhuohao Yu , Chang Gao , Wenjin Yao , Yidong Wang , Zhengran Zeng , Wei Ye , Jindong Wang , Yue Zhang , Shikun Zhang

The emergence of large language models (LLMs), such as Generative Pre-trained Transformer 4 (GPT-4) used by ChatGPT, has profoundly impacted the academic and broader community. While these models offer numerous advantages in terms of…

Computation and Language · Computer Science 2024-01-17 Zhicheng Dou , Yuchen Guo , Ching-Chun Chang , Huy H. Nguyen , Isao Echizen

Recent advances in large language models (LLMs) have made it increasingly difficult to distinguish human-written text from AI-generated content. Many existing detectors train supervised neural classifiers that achieve strong in-distribution…

Computation and Language · Computer Science 2026-05-27 Pingfan Su , Kai Ye , Shijin Gong , Erhan Xu , Jin Zhu , Giulia Livieri , Chengchun Shi

In developing machine learning (ML) models for text classification, one common challenge is that the collected data is often not ideally distributed, especially when new classes are introduced in response to changes of data and tasks. In…

Machine Learning · Computer Science 2025-03-28 Yuanzhe Jin , Adrian Carrasco-Revilla , Min Chen

As Large Language Models (LLMs) become increasingly prevalent in text simplification, systematically evaluating their outputs across diverse prompting strategies and architectures remains a critical methodological challenge in both NLP…

Computation and Language · Computer Science 2026-04-13 Rares-Alexandru Roscan , Gabriel Petre1 , Adrian-Marius Dumitran , Angela-Liliana Dumitran

Large language models (LLMs) are used globally across many languages, but their English-centric pretraining raises concerns about cross-lingual disparities for cultural awareness, often resulting in biased outputs. However, comprehensive…

Computation and Language · Computer Science 2025-09-23 Raoyuan Zhao , Beiduo Chen , Barbara Plank , Michael A. Hedderich

This paper proposes the synthetic long-video meta-evaluation (SLVMEval), a benchmark for meta-evaluating text-to-video (T2V) evaluation systems. The proposed SLVMEval benchmark focuses on assessing these systems on videos of up to 10,486 s…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Ryosuke Matsuda , Keito Kudo , Haruto Yoshida , Nobuyuki Shimizu , Jun Suzuki

Web agents, which couple language models with browsing and tool-use capabilities, show promise as open web assistants. Yet progress is increasingly limited by the lack of scalable, process-level supervision. Existing benchmarks are largely…

Artificial Intelligence · Computer Science 2026-05-29 Tenghao Huang , Kung-Hsiang Huang , Prafulla Kumar Choubey , Yilun Zhou , Muhao Chen , Jonathan May , Chien-Sheng Wu

Large language models are now embedded in everyday writing workflows, making reliable AI-generated text detection important for academic integrity, content moderation, and provenance tracking. In practice, however, a detector must do more…

Computation and Language · Computer Science 2026-05-11 Chenjun Li , Cheng Wan , Johannes C. Paetzold

This document contains the details of the authors' submission to the proceedings of SemEval 2024's Task 8: Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection Subtask A (monolingual) and B. Detection of…

Computation and Language · Computer Science 2024-04-10 Ayan Datta , Aryan Chandramania , Radhika Mamidi

We introduce TextSeal, a state-of-the-art watermark for large language models. Building on Gumbel-max sampling, TextSeal introduces dual-key generation to restore output diversity, along with entropy-weighted scoring and multi-region…