English
Related papers

Related papers: Duluth at SemEval-2025 Task 7: TF-IDF with Optimiz…

200 papers

Traditional multimodal retrieval systems rely primarily on bi-encoder architectures, where performance is closely tied to embedding dimensionality. Recent work, Think-Then-Embed (TTE), shows that incorporating multimodal reasoning to elicit…

This paper describes our Triple X speech recognition system submitted to Task 1 of the Multi-Lingual Conversational Speech Language Modeling (MLC-SLM) Challenge. Our work focuses on optimizing speech recognition accuracy in multilingual…

Computation and Language · Computer Science 2026-03-16 Miaomiao Gao , Xiaoxiao Xiang , Yiwen Guo

Document retrieval is an important task for search and Retrieval-Augmented Generation (RAG) applications. Large Language Models (LLMs) have contributed to improving the accuracy of text-based document retrieval. However, documents with…

Information Retrieval · Computer Science 2025-05-22 Radek Osmulski , Gabriel de Souza P. Moreira , Ronay Ak , Mengyao Xu , Benedikt Schifferer , Even Oldridge

The rapid spread of multilingual misinformation requires robust automated fact verification systems capable of handling fine-grained veracity assessments across diverse languages. While large language models have shown remarkable…

Computation and Language · Computer Science 2025-07-29 Hanna Shcharbakova , Tatiana Anikina , Natalia Skachkova , Josef van Genabith

The amount of data managed in many academic institutions has increased in recent years, particularly in all the research work done by undergraduate students, who simply use empirical techniques for keyword selection, forgetting existing…

Information Retrieval · Computer Science 2022-06-28 Fred Torres-Cruz , Edelfre Flores , William E. Arcaya , Irenio L. Chagua , Marga I. Ingaluque

SemEval-2025 Task 3 (Mu-SHROOM) focuses on detecting hallucinations in content generated by various large language models (LLMs) across multiple languages. This task involves not only identifying the presence of hallucinations but also…

Computation and Language · Computer Science 2025-05-13 Jiaying Hong , Thanet Markchom , Jianfei Xu , Tong Wu , Huizhi Liang

Safe and reliable natural language inference is critical for extracting insights from clinical trial reports but poses challenges due to biases in large pre-trained language models. This paper presents a novel data augmentation technique to…

Computation and Language · Computer Science 2024-04-16 Yuqi Wang , Zeqiang Wang , Wei Wang , Qi Chen , Kaizhu Huang , Anh Nguyen , Suparna De

While Large Language Models (LLMs) have achieved remarkable success in a wide range of applications, their performance often degrades in complex reasoning tasks. In this work, we introduce SELT (Self-Evaluation LLM Tree Search), a novel…

Computation and Language · Computer Science 2025-06-10 Mengsong Wu , Di Zhang , Yuqiang Li , Dongzhan Zhou , Wenliang Chen

Processing complex and ambiguous named entities is a challenging research problem, but it has not received sufficient attention from the natural language processing community. In this short paper, we present our participation in the English…

Computation and Language · Computer Science 2022-03-08 Ngoc Minh Lai

Large language models (LLMs) are incredible and versatile tools for text-based tasks that have enabled countless, previously unimaginable, applications. Retrieval models, in contrast, have not yet seen such capable general-purpose models…

Information Retrieval · Computer Science 2025-09-10 Julian Killingback , Hamed Zamani

This paper presents an overview of the shared task on multilingual coreference resolution associated with the CRAC 2022 workshop. Shared task participants were supposed to develop trainable systems capable of identifying mentions and…

Instruction following is a core capability of modern Large language models (LLMs), making evaluating this capability essential to understanding these models. The Instruction Following Evaluation (IFEval) benchmark from the literature does…

Computation and Language · Computer Science 2025-02-10 Antoine Dussolle , Andrea Cardeña Díaz , Shota Sato , Peter Devine

This study aims to improve the accuracy and quality of large-scale language models (LLMs) in answering questions by integrating Elasticsearch into the Retrieval Augmented Generation (RAG) framework. The experiment uses the Stanford Question…

Information Retrieval · Computer Science 2024-10-21 Jiajing Chen , Runyuan Bao , Hongye Zheng , Zhen Qi , Jianjun Wei , Jiacheng Hu

Text-to-video retrieval systems have recently made significant progress by utilizing pre-trained models trained on large-scale image-text pairs. However, most of the latest methods primarily focus on the video modality while disregarding…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Sarah Ibrahimi , Xiaohang Sun , Pichao Wang , Amanmeet Garg , Ashutosh Sanan , Mohamed Omar

Multilingual hallucination detection stands as an underexplored challenge, which the Mu-SHROOM shared task seeks to address. In this work, we propose an efficient, training-free LLM prompting strategy that enhances detection by translating…

Computation and Language · Computer Science 2025-08-04 Dimitra Karkani , Maria Lymperaiou , Giorgos Filandrianos , Nikolaos Spanos , Athanasios Voulodimos , Giorgos Stamou

Retrieving semantically relevant documents in niche domains poses significant challenges for traditional TF-IDF-based systems, often resulting in low similarity scores and suboptimal retrieval performance. This paper addresses these…

Information Retrieval · Computer Science 2024-12-24 Elham Peimani , Gurpreet Singh , Nisarg Mahyavanshi , Aman Arora , Awais Shaikh

Large language models (LLMs) are increasingly used across diverse linguistic and cultural contexts, yet their cultural knowledge remains uneven across regions and languages. We present the DFKI-MLT system for SemEval-2026 Task 7 on cultural…

Computation and Language · Computer Science 2026-05-25 Yusser Al Ghussin , Daniil Gurgurov , Yasser Hamidullah , Josef van Genabith , Cristina España-Bonet , Simon Ostermann

This paper describes our winning system on SemEval 2022 Task 7: Identifying Plausible Clarifications of Implicit and Underspecified Phrases in Instructional Texts. A replaced token detection pre-trained model is utilized with minorly…

Computation and Language · Computer Science 2022-11-29 Junyuan Shang , Shuohuan Wang , Yu Sun , Yanjun Yu , Yue Zhou , Li Xiang , Guixiu Yang

This paper presents the participation of team QUST in Task 8 SemEval 2024. We first performed data augmentation and cleaning on the dataset to enhance model training efficiency and accuracy. In the monolingual task, we evaluated traditional…

Computation and Language · Computer Science 2024-02-20 Xiaoman Xu , Xiangrun Li , Taihang Wang , Jianxiang Tian , Ye Jiang

Continued pretraining and instruction tuning on large-scale multilingual data have proven to be effective in scaling large language models (LLMs) to low-resource languages. However, the unaligned nature of such data limits its ability to…

Computation and Language · Computer Science 2025-10-22 Yingli Shen , Wen Lai , Shuo Wang , Ge Gao , Kangyang Luo , Alexander Fraser , Maosong Sun