English
Related papers

Related papers: SemEval-2017 Task 3: Community Question Answering

200 papers

We present an overview of the second edition of the CheckThat! Lab at CLEF 2019. The lab featured two tasks in two different languages: English and Arabic. Task 1 (English) challenged the participating systems to predict which claims in a…

Computation and Language · Computer Science 2021-10-01 Tamer Elsayed , Preslav Nakov , Alberto Barrón-Cedeño , Maram Hasanain , Reem Suwaileh , Giovanni Da San Martino , Pepa Atanasova

This is the proposal for RumourEval-2019, which will run in early 2019 as part of that year's SemEval event. Since the first RumourEval shared task in 2017, interest in automated claim validation has greatly increased, as the dangers of…

Computation and Language · Computer Science 2018-09-19 Genevieve Gorrell , Kalina Bontcheva , Leon Derczynski , Elena Kochkina , Maria Liakata , Arkaitz Zubiaga

This paper describes our contribution to SemEval 2021 Task 1: Lexical Complexity Prediction. In our approach, we leverage the ELECTRA model and attempt to mirror the data annotation scheme. Although the task is a regression task, we show…

Computation and Language · Computer Science 2021-04-05 Neil Rajiv Shirude , Sagnik Mukherjee , Tushar Shandhilya , Ananta Mukherjee , Ashutosh Modi

This work presents our contribution in the context of the 6th task of SemEval-2020: Extracting Definitions from Free Text in Textbooks (DeftEval). This competition consists of three subtasks with different levels of granularity: (1)…

Computation and Language · Computer Science 2020-09-18 Andrei-Marius Avram , Dumitru-Clementin Cercel , Costin-Gabriel Chiru

We describe the third edition of the CheckThat! Lab, which is part of the 2020 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes four complementary tasks and a related task from previous lab editions, offered in English, Arabic,…

Computation and Language · Computer Science 2020-01-24 Alberto Barron-Cedeno , Tamer Elsayed , Preslav Nakov , Giovanni Da San Martino , Maram Hasanain , Reem Suwaileh , Fatima Haouari

This paper presents the models submitted by Ghmerti team for subtasks A and B of the OffensEval shared task at SemEval 2019. OffensEval addresses the problem of identifying and categorizing offensive language in social media in three…

Computation and Language · Computer Science 2020-09-24 Ehsan Doostmohammadi , Hossein Sameti , Ali Saffar

We present the results of the first Fact Extraction and VERification (FEVER) Shared Task. The task challenged participants to classify whether human-written factoid claims could be Supported or Refuted using evidence retrieved from…

Computation and Language · Computer Science 2018-12-03 James Thorne , Andreas Vlachos , Oana Cocarascu , Christos Christodoulopoulos , Arpit Mittal

This paper presents a robust solution to the Memotion 3.0 Shared Task. The goal of this task is to classify the emotion and the corresponding intensity expressed by memes, which are usually in the form of images with short captions on…

Computation and Language · Computer Science 2023-02-15 Yu-Chien Tang , Kuang-Da Wang , Ting-Yun Ou , Wen-Chih Peng

This paper describes our system that has been submitted to SemEval-2018 Task 1: Affect in Tweets (AIT) to solve five subtasks. We focus on modeling both sentence and word level representations of emotion inside texts through large distantly…

Computation and Language · Computer Science 2018-04-24 Ji Ho Park , Peng Xu , Pascale Fung

This paper describes our participation in the SemEval-2020 task Detection of Propaganda Techniques in News Articles. We participate in both subtasks: Span Identification (SI) and Technique Classification (TC). We use a bi-LSTM architecture…

Computation and Language · Computer Science 2020-08-25 Verena Blaschke , Maxim Korniyenko , Sam Tureski

While vertical thinking relies on logical and commonsense reasoning, lateral thinking requires systems to defy commonsense associations and overwrite them through unconventional thinking. Lateral thinking has been shown to be challenging…

Artificial Intelligence · Computer Science 2024-04-26 Yifan Jiang , Filip Ilievski , Kaixin Ma

This paper describes our system developed for the SemEval-2024 Task 1: Semantic Textual Relatedness. The challenge is focused on automatically detecting the degree of relatedness between pairs of sentences for 14 languages including both…

Computation and Language · Computer Science 2024-04-09 Udvas Basak , Rajarshi Dutta , Shivam Pandey , Ashutosh Modi

ISCAS participated in two subtasks of SemEval 2020 Task 5: detecting counterfactual statements and detecting antecedent and consequence. This paper describes our system which is based on pre-trained transformers. For the first subtask, we…

Computation and Language · Computer Science 2020-09-18 Yaojie Lu , Annan Li , Hongyu Lin , Xianpei Han , Le Sun

The CoNLL-SIGMORPHON 2017 shared task on supervised morphological generation required systems to be trained and tested in each of 52 typologically diverse languages. In sub-task 1, submitted systems were asked to predict a specific…

In this paper, we present neural model architecture submitted to the SemEval-2019 Task 9 competition: "Suggestion Mining from Online Reviews and Forums". We participated in both subtasks for domain specific and also cross-domain suggestion…

Computation and Language · Computer Science 2019-04-08 Samuel Pecar , Marian Simko , Maria Bielikova

Analyzing memes on the internet has emerged as a crucial endeavor due to the impact this multi-modal form of content wields in shaping online discourse. Memes have become a powerful tool for expressing emotions and sentiments, possibly even…

In this paper, we present our system for SemEval-2026 Task 6 (CLARITY) on response clarity and evasion detection in question-answer pairs from U.S. presidential interviews, comparing fine-tuned encoders with prompt-based LLMs. Our LLM…

Computation and Language · Computer Science 2026-05-05 Nawar Turk , Lucas Miquet-Westphal , Leila Kosseim

SemEval-2024 Task 8 provides a challenge to detect human-written and machine-generated text. There are 3 subtasks for different detection scenarios. This paper proposes a system that mainly deals with Subtask B. It aims to detect if given…

Computation and Language · Computer Science 2024-04-02 Renhua Gu , Xiangfeng Meng

This paper describes our submission to Task 10 at SemEval 2023-Explainable Detection of Online Sexism (EDOS), divided into three subtasks. The recent rise in social media platforms has seen an increase in disproportionate levels of sexism…

Computation and Language · Computer Science 2023-04-25 Sriya Rallabandi , Sanchit Singhal , Pratinav Seth

Reliably detecting relevant relations between entities in unstructured text is a valuable resource for knowledge extraction, which is why it has awaken significant interest in the field of Natural Language Processing. In this paper, we…

Computation and Language · Computer Science 2018-06-18 Jonathan Rotsztejn , Nora Hollenstein , Ce Zhang