English
Related papers

Related papers: SemEval-2024 Task 8: Multidomain, Multimodel and M…

200 papers

The paper describes a system designed by Advacheck team to recognise machine-generated and human-written texts in the monolingual subtask of GenAI Detection Task 1 competition. Our developed system is a multi-task architecture with shared…

Computation and Language · Computer Science 2024-11-19 German Gritsai , Anastasia Voznyuk , Ildar Khabutdinov , Andrey Grabovoy

The rapid spread of online disinformation presents a global challenge, and machine learning has been widely explored as a potential solution. However, multilingual settings and low-resource languages are often neglected in this field. To…

Recent LLMs are able to generate high-quality multilingual texts, indistinguishable for humans from authentic human-written ones. Research in machine-generated text detection is however mostly focused on the English language and longer…

Computation and Language · Computer Science 2025-07-28 Dominik Macko , Jakub Kopal , Robert Moro , Ivan Srba

The growing capability of large language models to produce fluent, contextually coherent text has created mounting pressure on the systems and institutions responsible for ensuring the authenticity of digital content. Advanced generative…

This paper describes the approach of the UniBuc - NLP team in tackling the SemEval 2024 Task 8: Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection. We explored transformer-based and hybrid deep learning…

Computation and Language · Computer Science 2024-05-29 Teodor-George Marchitan , Claudiu Creanga , Liviu P. Dinu

With the rapid advancement of global digitalization, users from different countries increasingly rely on social media for information exchange. In this context, multilingual multi-label emotion detection has emerged as a critical research…

Computation and Language · Computer Science 2025-05-20 Jieying Xue , Phuong Minh Nguyen , Minh Le Nguyen , Xin Liu

SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval is approached as a Learning-to-Rank task using a bi-encoder model fine-tuned from a pre-trained transformer optimized for sentence similarity. Training used…

Computation and Language · Computer Science 2025-08-06 Pranshu Rastogi

With the rise of generative language models, machine-generated text detection has become a critical challenge. A wide variety of models is available, but inconsistent datasets, evaluation metrics, and assessment strategies obscure…

Computation and Language · Computer Science 2026-04-23 Kevin Stowe , Kailash Patil

This paper describes our system developed for the SemEval-2024 Task 1: Semantic Textual Relatedness. The challenge is focused on automatically detecting the degree of relatedness between pairs of sentences for 14 languages including both…

Computation and Language · Computer Science 2024-04-09 Udvas Basak , Rajarshi Dutta , Shivam Pandey , Ashutosh Modi

Large language models (LLMs) have demonstrated remarkable capability to generate fluent responses to a wide variety of user queries. However, this has also raised concerns about the potential misuse of such texts in journalism, education,…

Text Generation Models (TGMs) succeed in creating text that matches human language style reasonably well. Detectors that can distinguish between TGM-generated text and human-written ones play an important role in preventing abuse of TGM. In…

Computation and Language · Computer Science 2023-04-25 Narek Maloyan , Bulat Nutfullin , Eugene Ilyushin

This paper presents the participation of team QUST in Task 8 SemEval 2024. We first performed data augmentation and cleaning on the dataset to enhance model training efficiency and accuracy. In the monolingual task, we evaluated traditional…

Computation and Language · Computer Science 2024-02-20 Xiaoman Xu , Xiangrun Li , Taihang Wang , Jianxiang Tian , Ye Jiang

As LLMs rapidly advance, increasing concerns arise regarding risks about actual authorship of texts we see online and in real world. The task of distinguishing LLM-authored texts is complicated by the nuanced and overlapping behaviors of…

Computation and Language · Computer Science 2025-06-25 Jiazhou Ji , Ruizhe Li , Shujun Li , Jie Guo , Weidong Qiu , Zheng Huang , Chiyu Chen , Xiaoyu Jiang , Xinru Lu

SemEval-2026 Task 13 investigates machine-generated code detection across multiple programming languages and application scenarios, asking participating systems to generalize to unseen languages and domains. This paper describes our…

Computation and Language · Computer Science 2026-05-07 Elitsa Yotkova , Violeta Kastreva , Dimitar Dimitrov , Ivan Koychev , Preslav Nakov

This paper describes AIpom, a system designed to detect a boundary between human-written and machine-generated text (SemEval-2024 Task 8, Subtask C: Human-Machine Mixed Text Detection). We propose a two-stage pipeline combining predictions…

Computation and Language · Computer Science 2024-03-29 Alexander Shirnin , Nikita Andreev , Vladislav Mikhailov , Ekaterina Artemova

This paper presents the overview of the AuTexTification shared task as part of the IberLEF 2023 Workshop in Iberian Languages Evaluation Forum, within the framework of the SEPLN 2023 conference. AuTexTification consists of two subtasks: for…

Computation and Language · Computer Science 2024-01-10 Areg Mikael Sarvazyan , José Ángel González , Marc Franco-Salvador , Francisco Rangel , Berta Chulvi , Paolo Rosso

As Large Language Models (LLMs) have reached human-like fluency and coherence, distinguishing machine-generated text (MGT) from human-written content becomes increasingly difficult. While early efforts in MGT detection have focused on…

Computation and Language · Computer Science 2025-08-05 Lucio La Cava , Dominik Macko , Róbert Móro , Ivan Srba , Andrea Tagarelli

This paper presents a comprehensive overview of the first edition of the Academic Essay Authenticity Challenge, organized as part of the GenAI Content Detection shared tasks collocated with COLING 2025. This challenge focuses on detecting…

Computation and Language · Computer Science 2024-12-25 Shammur Absar Chowdhury , Hind Almerekhi , Mucahid Kutlu , Kaan Efe Keles , Fatema Ahmad , Tasnim Mohiuddin , George Mikros , Firoj Alam

An ideal detection system for machine generated content is supposed to work well on any generator as many more advanced LLMs come into existence day by day. Existing systems often struggle with accurately identifying AI-generated content…

We present our shared task on text-based emotion detection, covering more than 30 languages from seven distinct language families. These languages are predominantly low-resource and are spoken across various continents. The data instances…