English
Related papers

Related papers: SemEval-2016 Task 3: Community Question Answering

200 papers

We present a counterfactual recognition (CR) task, the shared Task 5 of SemEval-2020. Counterfactuals describe potential outcomes (consequents) produced by actions or circumstances that did not happen or cannot happen and are counter to the…

Computation and Language · Computer Science 2020-08-04 Xiaoyu Yang , Stephen Obadinma , Huasha Zhao , Qiong Zhang , Stan Matwin , Xiaodan Zhu

We describe our system for SemEval-2026 Task 8 (MTRAGEval), participating in Task A (Retrieval) across four English-language domains. Our approach employs a three-stage pipeline: (1) query rewriting via a LoRA-fine-tuned Qwen 2.5 7B model…

Computation and Language · Computer Science 2026-05-13 David-Maximilian Caraman , Gheorghe Cosmin Silaghi

In this paper, we describe our system for Task 4 of SemEval 2020, which involves differentiating between natural language statements that confirm to common sense and those that do not. The organizers propose three subtasks - first,…

Computation and Language · Computer Science 2020-07-23 Soumya Ranjan Dash , Sandeep Routray , Prateek Varshney , Ashutosh Modi

In this paper, we investigate a commonsense inference task that unifies natural language understanding and commonsense reasoning. We describe our attempt at SemEval-2020 Task 4 competition: Commonsense Validation and Explanation (ComVE)…

Computation and Language · Computer Science 2020-07-21 Sirwe Saeedi , Aliakbar Panahi , Seyran Saeedi , Alvis C Fong

This paper describes our system for SemEval-2023 Task 3 Subtask 2 on Framing Detection. We used a multi-label contrastive loss for fine-tuning large pre-trained language models in a multi-lingual setting, achieving very competitive results:…

Computation and Language · Computer Science 2023-04-28 Qisheng Liao , Meiting Lai , Preslav Nakov

We announce a shared task on UCCA parsing in English, German and French, and call for participants to submit their systems. UCCA is a cross-linguistically applicable framework for semantic representation, which builds on extensive…

Computation and Language · Computer Science 2021-02-04 Daniel Hershcovich , Leshem Choshen , Elior Sulem , Zohar Aizenbud , Ari Rappoport , Omri Abend

We present the SemEval 2019 shared task on UCCA parsing in English, German and French, and discuss the participating systems and results. UCCA is a cross-linguistically applicable framework for semantic representation, which builds on…

Computation and Language · Computer Science 2020-06-12 Daniel Hershcovich , Zohar Aizenbud , Leshem Choshen , Elior Sulem , Ari Rappoport , Omri Abend

Analyzing memes on the internet has emerged as a crucial endeavor due to the impact this multi-modal form of content wields in shaping online discourse. Memes have become a powerful tool for expressing emotions and sentiments, possibly even…

This paper presents the team BRUMS submission to SemEval-2020 Task 3: Graded Word Similarity in Context. The system utilises state-of-the-art contextualised word embeddings, which have some task-specific adaptations, including stacked…

Computation and Language · Computer Science 2021-05-21 Hansi Hettiarachchi , Tharindu Ranasinghe

This paper describes the system submitted by team \textbf{Archaeology} to SemEval-2026 Task~13 on AI-generated code detection. The shared task consists of three subtasks; we participate in Subtask-A (binary classification: human-written…

Computation and Language · Computer Science 2026-05-05 Jany-Gabriel Ispas , Sergiu Nisioi

SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval is approached as a Learning-to-Rank task using a bi-encoder model fine-tuned from a pre-trained transformer optimized for sentence similarity. Training used…

Computation and Language · Computer Science 2025-08-06 Pranshu Rastogi

We present an overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims, with focus on Task 1: Check-Worthiness. The task asks to predict which claims in a political debate should be…

We present the MULTISEM systems submitted to SemEval 2020 Task 3: Graded Word Similarity in Context (GWSC). We experiment with injecting semantic knowledge into pre-trained BERT models through fine-tuning on lexical semantic tasks related…

Computation and Language · Computer Science 2020-07-27 Aina Garí Soler , Marianna Apidianaki

This work presents an ensemble system based on various uni-modal and bi-modal model architectures developed for the SemEval 2022 Task 5: MAMI-Multimedia Automatic Misogyny Identification. The challenge organizers provide an English meme…

Computation and Language · Computer Science 2022-04-11 Wentao Yu , Benedikt Boenninghoff , Jonas Roehrig , Dorothea Kolossa

Users from the online environment can create different ways of expressing their thoughts, opinions, or conception of amusement. Internet memes were created specifically for these situations. Their main purpose is to transmit ideas by using…

Computation and Language · Computer Science 2020-11-11 George-Alexandru Vlad , George-Eduard Zaharia , Dumitru-Clementin Cercel , Costin-Gabriel Chiru , Stefan Trausan-Matu

In response to the continuing research interest in computational semantic analysis, we have proposed a new task for SemEval-2010: multi-way classification of mutually exclusive semantic relations between pairs of nominals. The task is…

This paper presents a system developed for SemEval 2025 Task 8: Question Answering (QA) over tabular data. Our approach integrates several key components: text-to-SQL and text-to-code generation modules, a self-correction mechanism, and a…

Computation and Language · Computer Science 2025-06-17 Nikolas Evkarpidi , Elena Tutubalina

Sentiment analysis is a process widely used in opinion mining campaigns conducted today. This phenomenon presents applications in a variety of fields, especially in collecting information related to the attitude or satisfaction of users…

Computation and Language · Computer Science 2020-09-08 George-Eduard Zaharia , George-Alexandru Vlad , Dumitru-Clementin Cercel , Traian Rebedea , Costin-Gabriel Chiru

We present an overview of the second edition of the CheckThat! Lab at CLEF 2019. The lab featured two tasks in two different languages: English and Arabic. Task 1 (English) challenged the participating systems to predict which claims in a…

Computation and Language · Computer Science 2021-10-01 Tamer Elsayed , Preslav Nakov , Alberto Barrón-Cedeño , Maram Hasanain , Reem Suwaileh , Giovanni Da San Martino , Pepa Atanasova

This paper describes our approach to the SemEval 2017 Task 10: "Extracting Keyphrases and Relations from Scientific Publications", specifically to Subtask (B): "Classification of identified keyphrases". We explored three different deep…

Computation and Language · Computer Science 2017-04-25 Steffen Eger , Erik-Lân Do Dinh , Ilia Kuznetsov , Masoud Kiaeeha , Iryna Gurevych