English
Related papers

Related papers: LTG at SemEval-2025 Task 10: Optimizing Context fo…

200 papers

This paper presents our approach to the SemEval-2025 Task~6 (PromiseEval), which focuses on verifying promises in corporate ESG (Environmental, Social, and Governance) reports. We explore three model architectures to address the four…

Computation and Language · Computer Science 2025-05-30 Nawar Turk , Eeham Khan , Leila Kosseim

Both encoder-only models (e.g., BERT, RoBERTa) and large language models (LLMs, e.g., Llama3) have been widely used for text classification tasks. However, there is a lack of systematic studies comparing the performance of encoder-based…

Computation and Language · Computer Science 2025-05-13 Hang Zhao , Qile P. Chen , Yijing Barry Zhang , Gang Yang

This paper presents the Annif system in the LLMs4Subjects shared task (Subtask 2) at GermEval-2025. The task required creating subject predictions for bibliographic records using large language models, with a special focus on computational…

Computation and Language · Computer Science 2025-08-25 Osma Suominen , Juho Inkinen , Mona Lehtinen

This work presents our contribution in the context of the 6th task of SemEval-2020: Extracting Definitions from Free Text in Textbooks (DeftEval). This competition consists of three subtasks with different levels of granularity: (1)…

Computation and Language · Computer Science 2020-09-18 Andrei-Marius Avram , Dumitru-Clementin Cercel , Costin-Gabriel Chiru

In this paper, we present our approach for sentiment classification on Spanish-English code-mixed social media data in the SemEval-2020 Task 9. We investigate performance of various pre-trained Transformer models by using different…

Computation and Language · Computer Science 2020-10-20 Bertelt Braaksma , Richard Scholtens , Stan van Suijlekom , Remy Wang , Ahmet Üstün

The SemEval task on Argument Reasoning in Civil Procedure is challenging in that it requires understanding legal concepts and inferring complex arguments. Currently, most Large Language Models (LLM) excelling in the legal realm are…

Computation and Language · Computer Science 2024-05-15 Odysseas S. Chlapanis , Ion Androutsopoulos , Dimitrios Galanis

We leverage pre-trained language models to solve the task of complex NER for two low-resource languages: Chinese and Spanish. We use the technique of Whole Word Masking(WWM) to boost the performance of masked language modeling objective on…

Computation and Language · Computer Science 2022-07-15 Amit Pandey , Swayatta Daw , Narendra Babu Unnam , Vikram Pudi

This paper presents our findings for SemEval 2025 Task 2, a shared task on entity-aware machine translation (EA-MT). The goal of this task is to develop translation models that can accurately translate English sentences into target…

Despite the increasing use of large language models (LLMs) for context-grounded tasks like summarization and question-answering, understanding what makes an LLM produce a certain response is challenging. We propose Multi-Level Explanations…

In this paper, we present our submission to the MM-ArgFallacy2025 shared task, which aims to advance research in multimodal argument mining, focusing on logical fallacies in political debates. Our approach uses pretrained Transformer-based…

Computation and Language · Computer Science 2025-08-07 Alessio Pittiglio

This paper presents our system for SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization, which identifies polarized social media content in 22 languages through three subtasks: binary detection,…

Computation and Language · Computer Science 2026-05-12 Fengze Guo , Yue Chang

Semantic text classification requires the understanding of the contextual significance of specific tokens rather than surface-level patterns or keywords (as in rule-based or statistical text classification), making large language models…

Machine Learning · Computer Science 2025-08-13 Adit Krishnan , Chu Wang , Chris Kong

The aim of SemEval-2024 Task 1, "Semantic Textual Relatedness for African and Asian Languages" is to develop models for identifying semantic textual relatedness (STR) between two sentences using multiple languages (14 African and Asian…

Computation and Language · Computer Science 2024-04-15 Shubhashis Roy Dipta , Sai Vallurupalli

This paper introduces our systems for all three subtasks of SemEval-2021 Task 4: Reading Comprehension of Abstract Meaning. To help our model better represent and understand abstract concepts in natural language, we well-design many simple…

Computation and Language · Computer Science 2021-02-26 Yuqiang Xie , Luxi Xing , Wei Peng , Yue Hu

In this paper, we present an end-to-end joint entity and relation extraction approach based on transformer-based language models. We apply the model to the task of linking mathematical symbols to their descriptions in LaTeX documents. In…

Computation and Language · Computer Science 2022-05-05 Nicholas Popovic , Walter Laurito , Michael Färber

SemEval-2025 Task 1 focuses on ranking images based on their alignment with a given nominal compound that may carry idiomatic meaning in both English and Brazilian Portuguese. To address this challenge, this work uses generative large…

Computation and Language · Computer Science 2025-05-02 Thanet Markchom , Tong Wu , Liting Huang , Huizhi Liang

We present our system for semantic frame induction that showed the best performance in Subtask B.1 and finished as the runner-up in Subtask A of the SemEval 2019 Task 2 on unsupervised semantic frame induction (QasemiZadeh et al., 2019).…

Computation and Language · Computer Science 2019-10-22 Saba Anwar , Dmitry Ustalov , Nikolay Arefyev , Simone Paolo Ponzetto , Chris Biemann , Alexander Panchenko

This paper presents our system developed for the SemEval-2025 Task 9: The Food Hazard Detection Challenge. The shared task's objective is to evaluate explainable classification systems for classifying hazards and products in two levels of…

Computation and Language · Computer Science 2025-04-30 Foteini Papadopoulou , Osman Mutlu , Neris Özen , Bas H. M. van der Velden , Iris Hendrickx , Ali Hürriyetoğlu

Idiomatic expressions present a unique challenge in NLP, as their meanings are often not directly inferable from their constituent words. Despite recent advancements in Large Language Models (LLMs), idiomaticity remains a significant…

Computation and Language · Computer Science 2025-06-05 Thomas Pickard , Aline Villavicencio , Maggie Mi , Wei He , Dylan Phelps , Marco Idiart

This paper summarizes Team SCaLAR's work on SemEval-2024 Task 5: Legal Argument Reasoning in Civil Procedure. To address this Binary Classification task, which was daunting due to the complexity of the Legal Texts involved, we propose a…

Computation and Language · Computer Science 2024-07-03 M Manvith Prabhu , Haricharana Srinivasa , Anand Kumar M