English
Related papers

Related papers: M4GT-Bench: Evaluation Benchmark for Black-Box Mac…

200 papers

Multimodal Large Language Models (MLLMs) have advanced in integrating diverse modalities but frequently suffer from hallucination. A promising solution to mitigate this issue is to generate text with citations, providing a transparent chain…

Computation and Language · Computer Science 2025-05-21 Caiyu Hu , Yikai Zhang , Tinghui Zhu , Yiwei Ye , Yanghua Xiao

Natural language processing evaluation has made significant progress, largely driven by the proliferation of powerful large language mod-els (LLMs). New evaluation benchmarks are of increasing priority as the reasoning capabilities of LLMs…

Computation and Language · Computer Science 2025-06-19 Joseph J. Peper , Wenzhao Qiu , Ali Payani , Lu Wang

Large language models (large LMs) are susceptible to producing text that contains hallucinated content. An important instance of this problem is self-contradiction, where the LM generates two contradictory sentences within the same context.…

Computation and Language · Computer Science 2024-03-19 Niels Mündler , Jingxuan He , Slobodan Jenko , Martin Vechev

Inaccuracies in existing or generated clinical text may lead to serious adverse consequences, especially if it is a misdiagnosis or incorrect treatment suggestion. With Large Language Models (LLMs) increasingly being used across diverse…

Computation and Language · Computer Science 2026-02-06 Congbo Ma , Yichun Zhang , Yousef Al-Jazzazi , Ahamed Foisal , Laasya Sharma , Yousra Sadqi , Khaled Saleh , Jihad Mallat , Farah E. Shamout

This paper describes our system developed for SemEval-2024 Task 8, ``Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection'' Machine-generated texts have been one of the main concerns due to the use of…

Computation and Language · Computer Science 2024-03-29 Shubhashis Roy Dipta , Sadat Shahriar

Large Language Models (LLMs) have raised increasing concerns about their misuse in generating hate speech. Among all the efforts to address this issue, hate speech detectors play a crucial role. However, the effectiveness of different…

Cryptography and Security · Computer Science 2025-01-29 Xinyue Shen , Yixin Wu , Yiting Qu , Michael Backes , Savvas Zannettou , Yang Zhang

We introduce ALHD, the first large-scale comprehensive Arabic dataset explicitly designed to distinguish between human- and LLM-generated texts. ALHD spans three genres (news, social media, reviews), covering both MSA and dialectal Arabic,…

Computation and Language · Computer Science 2025-10-23 Ali Khairallah , Arkaitz Zubiaga

With the rapid development of Large Language Models (LLMs), a large number of machine learning models have been developed to assist programming tasks including the generation of program code from natural language input. However, how to…

Artificial Intelligence · Computer Science 2024-06-19 Debalina Ghosh Paul , Hong Zhu , Ian Bayley

The dissemination of Large Language Models (LLMs), trained at scale, and endowed with powerful text-generating abilities, has made it easier for all to produce harmful, toxic, faked or forged content. In response, various proposals have…

Computation and Language · Computer Science 2025-06-12 Matthieu Dubois , François Yvon , Pablo Piantanida

Given the remarkable performance of Large Language Models (LLMs), an important question arises: Can LLMs conduct human-like scientific research and discover new knowledge, and act as an AI scientist? Scientific discovery is an iterative…

Machine Learning · Computer Science 2025-02-24 Tingting Chen , Srinivas Anumasa , Beibei Lin , Vedant Shah , Anirudh Goyal , Dianbo Liu

Large Language Model (LLMs) can be used to write or modify documents, presenting a challenge for understanding the intent behind their use. For example, benign uses may involve using LLM on a human-written document to improve its grammar or…

Computation and Language · Computer Science 2025-09-22 Yitong Wang , Zhongping Zhang , Margherita Piana , Zheng Zhou , Peter Gerstoft , Bryan A. Plummer

Large language models (LLMs) are increasingly deployed as conversational assistants in open-domain, multi-turn settings, where users often provide incomplete or ambiguous information. However, existing LLM-focused clarification benchmarks…

Computation and Language · Computer Science 2025-12-25 Sichun Luo , Yi Huang , Mukai Li , Shichang Meng , Fengyuan Liu , Zefa Hu , Junlan Feng , Qi Liu

The rise of large language models (LLMs) has created an urgent need to distinguish between human-written and LLM-generated text to ensure authenticity and societal trust. Existing detectors typically provide a binary classification for an…

Computation and Language · Computer Science 2026-05-06 Mengchu Li , Jin Zhu , Jinglai Li , Chengchun Shi

The code generation capabilities of large language models(LLMs) have emerged as a critical dimension in evaluating their overall performance. However, prior research has largely overlooked the security risks inherent in the generated code.…

Cryptography and Security · Computer Science 2025-06-23 Xinghang Li , Jingzhe Ding , Chao Peng , Bing Zhao , Xiang Gao , Hongwan Gao , Xinchen Gu

Text Generation Models (TGMs) succeed in creating text that matches human language style reasonably well. Detectors that can distinguish between TGM-generated text and human-written ones play an important role in preventing abuse of TGM. In…

Computation and Language · Computer Science 2023-04-25 Narek Maloyan , Bulat Nutfullin , Eugene Ilyushin

The rampant spread of fake news has adversely affected society, resulting in extensive research on curbing its spread. As a notable milestone in large language models (LLMs), ChatGPT has gained significant attention due to its exceptional…

Computation and Language · Computer Science 2024-04-09 Yue Huang , Lichao Sun

Large language models (LLMs) can produce text that closely resembles human writing. This capability raises concerns about misuse, including disinformation and content manipulation. Detecting AI-generated text is essential to maintain…

Computation and Language · Computer Science 2025-12-29 Md. Rakibul Islam , Most. Sharmin Sultana Samu , Md. Zahid Hossain , Farhad Uz Zaman , Md. Kamrozzaman Bhuiyan

Large Language Models (LLMs) have revolutionized the field of Natural Language Generation (NLG) by demonstrating an impressive ability to generate human-like text. However, their widespread usage introduces challenges that necessitate…

Computation and Language · Computer Science 2024-06-28 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He

Machine translation benchmarks sourced from the real world are quickly obsoleted, due to most examples being easy for state-of-the-art translation models. This limits the benchmark's ability to distinguish which model is better or to reveal…

Computation and Language · Computer Science 2025-10-03 Vilém Zouhar , Wenda Xu , Parker Riley , Juraj Juraska , Mara Finkelstein , Markus Freitag , Daniel Deutsch

As large language models (LLMs) generate more human-like texts, concerns about the side effects of AI-generated texts (AIGT) have grown. So, researchers have developed methods for detecting AIGT. However, two challenges remain. First, the…

Computation and Language · Computer Science 2025-02-05 Hyeonchu Park , Byungjun Kim , Bugeun Kim