English
Related papers

Related papers: MSA at SemEval-2025 Task 3: High Quality Weak Labe…

200 papers

Large Vision Language Models (LVLMs) have recently achieved superior performance in various tasks on natural image and text data, which inspires a large amount of studies for LVLMs fine-tuning and training. Despite their advancements, there…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zishan Gu , Changchang Yin , Fenglin Liu , Ping Zhang

Hallucination is a persistent issue affecting all large language Models (LLMs), particularly within low-resource languages such as Persian. PerHalluEval (Persian Hallucination Evaluation) is the first dynamic hallucination evaluation…

Computation and Language · Computer Science 2025-09-26 Mohammad Hosseini , Kimia Hosseini , Shayan Bali , Zahra Zanjani , Saeedeh Momtazi

The proliferation of online news and the increasing spread of misinformation necessitate robust methods for automatic data analysis. Narrative classification is emerging as a important task, since identifying what is being said online is…

Computation and Language · Computer Science 2025-05-30 Iknoor Singh , Carolina Scarton , Kalina Bontcheva

In this paper, we present our novel systems developed for the SemEval-2024 hallucination detection task. Our investigation spans a range of strategies to compare model predictions with reference standards, encompassing diverse baselines,…

Computation and Language · Computer Science 2024-04-10 Elisei Rykov , Yana Shishkina , Kseniia Petrushina , Kseniia Titova , Sergey Petrakov , Alexander Panchenko

Large language models (LLMs) are increasingly deployed across diverse domains, yet they are prone to generating factually incorrect outputs - commonly known as "hallucinations." Among existing mitigation strategies, uncertainty-based…

Computation and Language · Computer Science 2025-03-11 Samir Abdaljalil , Hasan Kurban , Parichit Sharma , Erchin Serpedin , Rachad Atat

This paper describes our system to SemEval-2026 Task 3 Track A Subtask 1 on Dimensional Aspect Sentiment Regression (DimASR). We propose a lightweight and resource-efficient system built entirely on multilingual pre-trained encoders,…

Computation and Language · Computer Science 2026-05-12 Liyuan Huang , Jiawei He , Wutao Shen , Lin Li , Jin Zhang

While Large Language Models (LLMs) have emerged as powerful foundational models to solve a variety of tasks, they have also been shown to be prone to hallucinations, i.e., generating responses that sound confident but are actually incorrect…

Computation and Language · Computer Science 2026-04-29 Jiawei Li , Akshayaa Magesh , Venugopal V. Veeravalli

In the era of large language models (LLMs), hallucination (i.e., the tendency to generate factually incorrect content) poses great challenge to trustworthy and reliable deployment of LLMs in real-world applications. To tackle the LLM…

Computation and Language · Computer Science 2024-01-09 Junyi Li , Jie Chen , Ruiyang Ren , Xiaoxue Cheng , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

The Large Language Models (LLMs) exhibit remarkable ability to generate fluent content across a wide spectrum of user queries. However, this capability has raised concerns regarding misinformation and personal information leakage. In this…

Recent advances in language models have substantially improved Natural Language Understanding (NLU). Although widely used benchmarks suggest that Large Language Models (LLMs) can effectively disambiguate, their practical applicability in…

Computation and Language · Computer Science 2026-04-20 Deshan Sumanathilaka , Nicholas Micallef , Julian Hough , Saman Jayasinghe

This paper describes our system submitted to SemEval-2026 Task 11: Disentangling Content and Formal Reasoning in Large Language Models. We present an efficient modular neuro-symbolic approach, combining a symbolic prover with small…

Computation and Language · Computer Science 2026-05-07 Ivan Kartáč , Kristýna Onderková , Jan Bronec , Zdeněk Kasner , Mateusz Lango , Ondřej Dušek

In this article, we present our methodologies for SemEval-2021 Task-4: Reading Comprehension of Abstract Meaning. Given a fill-in-the-blank-type question and a corresponding context, the task is to predict the most suitable word from a list…

Computation and Language · Computer Science 2022-02-24 Abheesht Sharma , Harshit Pandey , Gunjan Chhablani , Yash Bhartia , Tirtharaj Dash

Hallucination detection is a critical step toward understanding the trustworthiness of modern language models (LMs). To achieve this goal, we re-examine existing detection approaches based on the self-consistency of LMs and uncover two…

Computation and Language · Computer Science 2024-02-20 Jiaxin Zhang , Zhuohang Li , Kamalika Das , Bradley A. Malin , Sricharan Kumar

Large Language Models (LLMs) are adept at text manipulation -- tasks such as machine translation and text summarization. However, these models can also be prone to hallucination, which can be detrimental to the faithfulness of any answers…

Computation and Language · Computer Science 2024-04-04 Priyesh Vakharia , Devavrat Joshi , Meenal Chavan , Dhananjay Sonawane , Bhrigu Garg , Parsa Mazaheri

This paper describes our system for SemEval-2021 Task 5 on Toxic Spans Detection. We developed ensemble models using BERT-based neural architectures and post-processing to combine tokens into spans. We evaluated several pre-trained language…

Computation and Language · Computer Science 2021-08-30 Mikhail Kotyushev , Anna Glazkova , Dmitry Morozov

This paper describes the system used by the Machine Learning Group of LTU in subtask 1 of the SemEval-2022 Task 4: Patronizing and Condescending Language (PCL) Detection. Our system consists of finetuning a pretrained Text-to-Text-Transfer…

Computation and Language · Computer Science 2022-05-06 Tosin Adewumi , Lama Alkhaled , Hamam Mokayed , Foteini Liwicki , Marcus Liwicki

In recent years, sentiment analysis has gained significant importance in natural language processing. However, most existing models and datasets for sentiment analysis are developed for high-resource languages, such as English and Chinese,…

Computation and Language · Computer Science 2023-09-19 Daniil Homskiy , Narek Maloyan

Abstractive text summarization has garnered increased interest as of late, in part due to the proliferation of large language models (LLMs). One of the most pressing problems related to generation of abstractive summaries is the need to…

Computation and Language · Computer Science 2023-10-17 Grant C. Forbes , Parth Katlana , Zeydy Ortiz

This paper describes the participation of QUST_NLP in the SemEval-2025 Task 7. We propose a three-stage retrieval framework specifically designed for fact-checked claim retrieval. Initially, we evaluate the performance of several retrieval…

Information Retrieval · Computer Science 2025-06-24 Youzheng Liu , Jiyan Liu , Xiaoman Xu , Taihang Wang , Yimin Wang , Ye Jiang

We present MSA-MathEval, our submission to the BEA 2025 Shared Task on evaluating AI tutor responses across four instructional dimensions: Mistake Identification, Mistake Location, Providing Guidance, and Actionability. Our approach uses a…

Computation and Language · Computer Science 2025-05-27 Baraa Hikal , Mohamed Basem , Islam Oshallah , Ali Hamdi