English
Related papers

Related papers: LRG at SemEval-2021 Task 4: Improving Reading Comp…

200 papers

Reading comprehension is a key for individual success, yet the assessment of question difficulty remains challenging due to the extensive human annotation and large-scale testing required by traditional methods such as linguistic analysis…

Computation and Language · Computer Science 2025-02-26 Yoshee Jain , John Hollander , Amber He , Sunny Tang , Liang Zhang , John Sabatini

We describe our system for SemEval-2026 Task 5, which requires rating the plausibility of given word senses of homonyms in short stories on a 5-point Likert scale. Systems are evaluated by the unweighted average of accuracy (within one…

Computation and Language · Computer Science 2026-03-18 Azwad Anjum Islam , Tisa Islam Erana

In this paper, we describe our approach for the SemEval 2025 Task 2 on Entity-Aware Machine Translation (EA-MT). Our system aims to improve the accuracy of translating named entities by combining two key approaches: Retrieval Augmented…

Computation and Language · Computer Science 2025-06-17 Jaebok Lee , Yonghyun Ryu , Seongmin Park , Yoonjung Choi

We present a novel neural architecture for the Argument Reasoning Comprehension task of SemEval 2018. It is a simple neural network consisting of three parts, collectively judging whether the logic built on a set of given sentences (a…

Computation and Language · Computer Science 2018-05-21 Taeuk Kim , Jihun Choi , Sang-goo Lee

This paper describes the architecture and systems built towards solving the SemEval 2023 Task 2: MultiCoNER II (Multilingual Complex Named Entity Recognition) [1]. We evaluate two approaches (a) a traditional Conditional Random Fields model…

Computation and Language · Computer Science 2024-01-02 Kiran Voderhobli Holla , Chaithanya Kumar , Aryan Singh

This paper presents the best-performing solution to the SemEval 2023 Task 3 on the subtask 3 dedicated to persuasion techniques detection. Due to a high multilingual character of the input data and a large number of 23 predicted labels…

Computation and Language · Computer Science 2024-06-11 Timo Hromadka , Timotej Smolen , Tomas Remis , Branislav Pecher , Ivan Srba

PCL detection task is aimed at identifying and categorizing language that is patronizing or condescending towards vulnerable communities in the general media.Compared to other NLP tasks of paragraph classification, the negative language…

Computation and Language · Computer Science 2022-08-03 Yong Deng , Chenxiao Dou , Liangyu Chen , Deqiang Miao , Xianghui Sun , Baochang Ma , Xiangang Li

This paper describes the system used by the Machine Learning Group of LTU in subtask 1 of the SemEval-2022 Task 4: Patronizing and Condescending Language (PCL) Detection. Our system consists of finetuning a pretrained Text-to-Text-Transfer…

Computation and Language · Computer Science 2022-05-06 Tosin Adewumi , Lama Alkhaled , Hamam Mokayed , Foteini Liwicki , Marcus Liwicki

This paper presents our system developed for the SemEval-2024 Task 1: Semantic Textual Relatedness for African and Asian Languages. The shared task aims at measuring the semantic textual relatedness between pairs of sentences, with a focus…

Computation and Language · Computer Science 2024-06-10 Miaoran Zhang , Mingyang Wang , Jesujoba O. Alabi , Dietrich Klakow

Identifying whether a word carries the same meaning or different meaning in two contexts is an important research area in natural language processing which plays a significant role in many applications such as question answering, document…

Computation and Language · Computer Science 2021-04-13 Hansi Hettiarachchi , Tharindu Ranasinghe

This paper describes our contribution to SemEval 2021 Task 1: Lexical Complexity Prediction. In our approach, we leverage the ELECTRA model and attempt to mirror the data annotation scheme. Although the task is a regression task, we show…

Computation and Language · Computer Science 2021-04-05 Neil Rajiv Shirude , Sagnik Mukherjee , Tushar Shandhilya , Ananta Mukherjee , Ashutosh Modi

The aim of SemEval-2024 Task 1, "Semantic Textual Relatedness for African and Asian Languages" is to develop models for identifying semantic textual relatedness (STR) between two sentences using multiple languages (14 African and Asian…

Computation and Language · Computer Science 2024-04-15 Shubhashis Roy Dipta , Sai Vallurupalli

This paper presents our strategy to address the SemEval-2022 Task 3 PreTENS: Presupposed Taxonomies Evaluating Neural Network Semantics. The goal of the task is to identify if a sentence is deemed acceptable or not, depending on the…

Computation and Language · Computer Science 2022-10-10 Injy Sarhan , Pablo Mosteiro , Marco Spruit

This work describes the development of different models to detect patronising and condescending language within extracts of news articles as part of the SemEval 2022 competition (Task-4). This work explores different models based on the…

Computation and Language · Computer Science 2022-04-25 Jayant Chhillar

This paper describes our system submitted to task 4 of SemEval 2020: Commonsense Validation and Explanation (ComVE) which consists of three sub-tasks. The task is to directly validate the given sentence whether or not it makes sense and…

Computation and Language · Computer Science 2020-07-29 Hongru Wang , Xiangru Tang , Sunny Lai , Kwong Sak Leung , Jia Zhu , Gabriel Pui Cheong Fung , Kam-Fai Wong

The Large Language Models (LLMs) exhibit remarkable ability to generate fluent content across a wide spectrum of user queries. However, this capability has raised concerns regarding misinformation and personal information leakage. In this…

SemEval-2024 Task 8 is focused on multigenerator, multidomain, and multilingual black-box machine-generated text detection. Such a detection is important for preventing a potential misuse of large language models (LLMs), the newest of which…

Computation and Language · Computer Science 2024-06-18 Michal Spiegel , Dominik Macko

The rising cost of acquiring supervised data has driven significant interest in self-improvement for large language models (LLMs). Straightforward unsupervised signals like majority voting have proven effective in generating pseudo-labels…

Computation and Language · Computer Science 2026-04-01 Chunyang Jiang , Yonggang Zhang , Yiyang Cai , Chi-Min Chan , Yulong Liu , Mingming Chen , Wei Xue , Yike Guo

Recent years the task of incomplete utterance rewriting has raised a large attention. Previous works usually shape it as a machine translation task and employ sequence to sequence based architecture with copy mechanism. In this paper, we…

Computation and Language · Computer Science 2020-09-29 Qian Liu , Bei Chen , Jian-Guang Lou , Bin Zhou , Dongmei Zhang

In this paper, we present language model system submitted to SemEval-2020 Task 4 competition: "Commonsense Validation and Explanation". We participate in two subtasks for subtask A: validation and subtask B: Explanation. We implemented with…

Computation and Language · Computer Science 2020-09-08 Pai Liu