English
Related papers

Related papers: SemEval-2021 Task 1: Lexical Complexity Prediction

200 papers

This paper describes the SemEval--2016 Task 3 on Community Question Answering, which we offered in English and Arabic. For English, we had three subtasks: Question--Comment Similarity (subtask A), Question--Question Similarity (B), and…

Computation and Language · Computer Science 2019-12-05 Preslav Nakov , Lluís Màrquez , Alessandro Moschitti , Walid Magdy , Hamdy Mubarak , Abed Alhakim Freihat , James Glass , Bilal Randeree

The rapid spread of online disinformation presents a global challenge, and machine learning has been widely explored as a potential solution. However, multilingual settings and low-resource languages are often neglected in this field. To…

This paper introduces the SemEval-2021 shared task 4: Reading Comprehension of Abstract Meaning (ReCAM). This shared task is designed to help evaluate the ability of machines in representing and understanding abstract concepts. Given a…

Computation and Language · Computer Science 2021-06-02 Boyuan Zheng , Xiaoyu Yang , Yu-Ping Ruan , Zhenhua Ling , Quan Liu , Si Wei , Xiaodan Zhu

In this paper, we present the results of the SemEval-2020 Task 9 on Sentiment Analysis of Code-Mixed Tweets (SentiMix 2020). We also release and describe our Hinglish (Hindi-English) and Spanglish (Spanish-English) corpora annotated with…

Computation and Language · Computer Science 2020-08-11 Parth Patwa , Gustavo Aguilar , Sudipta Kar , Suraj Pandey , Srinivas PYKL , Björn Gambäck , Tanmoy Chakraborty , Thamar Solorio , Amitava Das

This paper presents our submission to the SemEval 2020 - Task 10 on emphasis selection in written text. We approach this emphasis selection problem as a sequence labeling task where we represent the underlying text with various contextual…

Computation and Language · Computer Science 2020-09-08 Sarthak Anand , Pradyumna Gupta , Hemant Yadav , Debanjan Mahata , Rakesh Gosangi , Haimin Zhang , Rajiv Ratn Shah

Understanding tables is an important and relevant task that involves understanding table structure as well as being able to compare and contrast information within cells. In this paper, we address this challenge by presenting a new dataset…

Computation and Language · Computer Science 2021-06-04 Nancy X. R. Wang , Diwakar Mahajan , Marina Danilevsky , Sara Rosenthal

In this paper, we describe the 2015 iteration of the SemEval shared task on Sentiment Analysis in Twitter. This was the most popular sentiment analysis shared task to date with more than 40 teams participating in each of the last three…

Computation and Language · Computer Science 2019-12-09 Sara Rosenthal , Saif M Mohammad , Preslav Nakov , Alan Ritter , Svetlana Kiritchenko , Veselin Stoyanov

This paper presents the MasonTigers entry to the SemEval-2024 Task 1 - Semantic Textual Relatedness. The task encompasses supervised (Track A), unsupervised (Track B), and cross-lingual (Track C) approaches across 14 different languages.…

Computation and Language · Computer Science 2024-04-09 Dhiman Goswami , Sadiya Sayara Chowdhury Puspo , Md Nishat Raihan , Al Nahian Bin Emran , Amrita Ganguly , Marcos Zampieri

This paper presents our approach to the SemEval-2025 Task~6 (PromiseEval), which focuses on verifying promises in corporate ESG (Environmental, Social, and Governance) reports. We explore three model architectures to address the four…

Computation and Language · Computer Science 2025-05-30 Nawar Turk , Eeham Khan , Leila Kosseim

Question answering from semi-structured tables can be seen as a semantic parsing task and is significant and practical for pushing the boundary of natural language understanding. Existing research mainly focuses on understanding contents…

Artificial Intelligence · Computer Science 2021-06-08 Xiaoyi Ruan , Meizhi Jin , Jian Ma , Haiqin Yang , Lianxin Jiang , Yang Mo , Mengyuan Zhou

This paper describes our system developed for the SemEval-2024 Task 1: Semantic Textual Relatedness. The challenge is focused on automatically detecting the degree of relatedness between pairs of sentences for 14 languages including both…

Computation and Language · Computer Science 2024-04-09 Udvas Basak , Rajarshi Dutta , Shivam Pandey , Ashutosh Modi

Semantic Textual Similarity (STS) measures the meaning similarity of sentences. Applications include machine translation (MT), summarization, generation, question answering (QA), short answer grading, semantic search, dialog and…

Computation and Language · Computer Science 2017-08-02 Daniel Cer , Mona Diab , Eneko Agirre , Iñigo Lopez-Gazpio , Lucia Specia

In this work, we present our approach for solving the SemEval 2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation (MCL-WiC). The task is a sentence pair classification problem where the goal is to detect whether a…

Computation and Language · Computer Science 2021-04-06 Rohan Gupta , Jay Mundra , Deepak Mahajan , Ashutosh Modi

This paper describes the system submitted by our team (BabelEnconding) to SemEval-2020 Task 3: Predicting the Graded Effect of Context in Word Similarity. We propose an approach that relies on translation and multilingual language models in…

Computation and Language · Computer Science 2020-08-20 Lucas R. C. Pessutto , Tiago de Melo , Viviane P. Moreira , Altigran da Silva

This paper describes the winning contribution to SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection (Subtask 2) handed in by team UG Student Intern. We present an ensemble model that makes predictions based on context-free…

Computation and Language · Computer Science 2020-10-07 Martin Pömsl , Roman Lyapin

This paper describes our system for the SemEval2022 task of matching dictionary glosses to word embeddings. We focus on the Reverse Dictionary Track of the competition, which maps multilingual glosses to reconstructed vector…

Computation and Language · Computer Science 2022-06-09 Zhiyong Wang , Ge Zhang , Nineli Lashkarashvili

We present the results and the main findings of SemEval-2019 Task 6 on Identifying and Categorizing Offensive Language in Social Media (OffensEval). The task was based on a new dataset, the Offensive Language Identification Dataset (OLID),…

Computation and Language · Computer Science 2019-04-30 Marcos Zampieri , Shervin Malmasi , Preslav Nakov , Sara Rosenthal , Noura Farra , Ritesh Kumar

Identifying whether a word carries the same meaning or different meaning in two contexts is an important research area in natural language processing which plays a significant role in many applications such as question answering, document…

Computation and Language · Computer Science 2021-04-13 Hansi Hettiarachchi , Tharindu Ranasinghe

This paper describes our approach to the SemEval 2017 Task 10: "Extracting Keyphrases and Relations from Scientific Publications", specifically to Subtask (B): "Classification of identified keyphrases". We explored three different deep…

Computation and Language · Computer Science 2017-04-25 Steffen Eger , Erik-Lân Do Dinh , Ilia Kuznetsov , Masoud Kiaeeha , Iryna Gurevych