English
Related papers

Related papers: Counts@IITK at SemEval-2021 Task 8: SciBERT Based …

200 papers

We present the results and the main findings of SemEval-2024 Task 8: Multigenerator, Multidomain, and Multilingual Machine-Generated Text Detection. The task featured three subtasks. Subtask A is a binary classification task determining…

This paper describes the system designed by ERNIE Team which achieved the first place in SemEval-2020 Task 10: Emphasis Selection For Written Text in Visual Media. Given a sentence, we are asked to find out the most important words as the…

Computation and Language · Computer Science 2020-09-09 Zhengjie Huang , Shikun Feng , Weiyue Su , Xuyi Chen , Shuohuan Wang , Jiaxiang Liu , Xuan Ouyang , Yu Sun

In this paper, we describe the 2015 iteration of the SemEval shared task on Sentiment Analysis in Twitter. This was the most popular sentiment analysis shared task to date with more than 40 teams participating in each of the last three…

Computation and Language · Computer Science 2019-12-09 Sara Rosenthal , Saif M Mohammad , Preslav Nakov , Alan Ritter , Svetlana Kiritchenko , Veselin Stoyanov

Training learnable metrics using modern language models has recently emerged as a promising method for the automatic evaluation of machine translation. However, existing human evaluation datasets for text simplification have limited…

Computation and Language · Computer Science 2023-07-11 Mounica Maddela , Yao Dou , David Heineman , Wei Xu

The present study describes our submission to SemEval 2018 Task 1: Affect in Tweets. Our Spanish-only approach aimed to demonstrate that it is beneficial to automatically generate additional training data by (i) translating training data…

Computation and Language · Computer Science 2018-05-29 Marloes Kuijper , Mike van Lenthe , Rik van Noord

Research on definition extraction has been conducted for well over a decade, largely with significant constraints on the type of definitions considered. In this work, we present DeftEval, a SemEval shared task in which participants must…

Computation and Language · Computer Science 2020-09-01 Sasha Spala , Nicholas A Miller , Franck Dernoncourt , Carl Dockhorn

We present our submitted systems for Semantic Textual Similarity (STS) Track 4 at SemEval-2017. Given a pair of Spanish-English sentences, each system must estimate their semantic similarity by a score between 0 and 5. In our submission, we…

Computation and Language · Computer Science 2017-04-06 Jeremy Ferrero , Frederic Agnes , Laurent Besacier , Didier Schwab

In this paper, we present our submission to SemEval-2025 Task 8: Question Answering over Tabular Data. This task, evaluated on the DataBench dataset, assesses Large Language Models' (LLMs) ability to answer natural language questions over…

Computation and Language · Computer Science 2025-08-04 Andreas Evangelatos , Giorgos Filandrianos , Maria Lymperaiou , Athanasios Voulodimos , Giorgos Stamou

We present our system submission for SemEval 2025 Task 5, which focuses on cross-lingual subject classification in the English and German academic domains. Our approach leverages bilingual data during training, employing negative sampling…

Computation and Language · Computer Science 2025-05-07 Baharul Islam , Nasim Ahmad , Ferdous Ahmed Barbhuiya , Kuntal Dey

Indian court legal texts and processes are essential towards the integrity of the judicial system and towards maintaining the social and political order of the nation. Due to the increase in number of pending court cases, there is an urgent…

Computation and Language · Computer Science 2023-06-06 Vinay N Ramesh , Rohan Eswara

In this paper, we describe our system for Task 4 of SemEval 2020, which involves differentiating between natural language statements that confirm to common sense and those that do not. The organizers propose three subtasks - first,…

Computation and Language · Computer Science 2020-07-23 Soumya Ranjan Dash , Sandeep Routray , Prateek Varshney , Ashutosh Modi

This paper presents the shared task on Multilingual Idiomaticity Detection and Sentence Embedding, which consists of two subtasks: (a) a binary classification task aimed at identifying whether a sentence contains an idiomatic expression,…

Computation and Language · Computer Science 2022-05-31 Harish Tayyar Madabushi , Edward Gow-Smith , Marcos Garcia , Carolina Scarton , Marco Idiart , Aline Villavicencio

This paper presents our strategy to address the SemEval-2022 Task 3 PreTENS: Presupposed Taxonomies Evaluating Neural Network Semantics. The goal of the task is to identify if a sentence is deemed acceptable or not, depending on the…

Computation and Language · Computer Science 2022-10-10 Injy Sarhan , Pablo Mosteiro , Marco Spruit

In this paper, we propose a methodology for task 10 of SemEval23, focusing on detecting and classifying online sexism in social media posts. The task is tackling a serious issue, as detecting harmful content on social media platforms is…

Computation and Language · Computer Science 2023-04-26 Sana Sabah Al-Azzawi , György Kovács , Filip Nilsson , Tosin Adewumi , Marcus Liwicki

We present the MULTISEM systems submitted to SemEval 2020 Task 3: Graded Word Similarity in Context (GWSC). We experiment with injecting semantic knowledge into pre-trained BERT models through fine-tuning on lexical semantic tasks related…

Computation and Language · Computer Science 2020-07-27 Aina Garí Soler , Marianna Apidianaki

In this paper, we present our submission to the SemEval-2024 Task 8 "Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection", focusing on the detection of machine-generated texts (MGTs) in English.…

Computation and Language · Computer Science 2024-04-09 Kseniia Petukhova , Roman Kazakov , Ekaterina Kochmar

This paper presents our system for SemEval-2025 Task 8: DataBench, Question-Answering over Tabular Data. The primary objective of this task is to perform question answering on given tabular datasets from diverse domains under two subtasks:…

Computation and Language · Computer Science 2025-08-04 Atakan Site , Emre Hakan Erdemir , Gülşen Eryiğit

The article describes our submission to SemEval 2019 Task 8 on Fact-Checking in Community Forums. The systems under discussion participated in Subtask A: decide whether a question asks for factual information, opinion/advice or is just…

Computation and Language · Computer Science 2019-06-05 Piotr Niewinski , Aleksander Wawer , Maria Pszona , Maria Janicka

This paper describes the participation of QUST_NLP in the SemEval-2025 Task 7. We propose a three-stage retrieval framework specifically designed for fact-checked claim retrieval. Initially, we evaluate the performance of several retrieval…

Information Retrieval · Computer Science 2025-06-24 Youzheng Liu , Jiyan Liu , Xiaoman Xu , Taihang Wang , Yimin Wang , Ye Jiang

This paper presents the Duluth approach to SemEval-2026 Task 6 on CLARITY: Unmasking Political Question Evasions. We address Task 1 (clarity-level classification) and Task 2 (evasion-level classification), both of which involve classifying…

Computation and Language · Computer Science 2026-04-23 Shujauddin Syed , Ted Pedersen