English
Related papers

Related papers: AILS-NTUA at SemEval-2026 Task 8: Evaluating Multi…

200 papers

Retrieval-augmented generation (RAG) faces challenges related to factual correctness, source attribution, and response completeness. The LiveRAG Challenge hosted at SIGIR'25 aims to advance RAG research using a fixed corpus and a shared,…

Information Retrieval · Computer Science 2025-06-30 Weronika Łajewska , Ivica Kostric , Gabriel Iturra-Bocaz , Mariam Arustashvili , Krisztian Balog

This paper presents our submission to the QIAS 2025 shared task on Islamic knowledge understanding and reasoning. We developed a hybrid retrieval-augmented generation (RAG) system that combines sparse and dense retrieval methods with…

Computation and Language · Computer Science 2025-09-30 Muhammad Abu Ahmad , Mohamad Ballout , Raia Abu Ahmad , Elia Bruni

Complex scientific questions often entail multiple intents, such as identifying gene mutations and linking them to related diseases. These tasks require evidence from diverse sources and multi-hop reasoning, while conventional…

Artificial Intelligence · Computer Science 2025-11-21 Zhiyuan Li , Haisheng Yu , Guangchuan Guo , Nan Zhou , Jiajun Zhang

This study develops a question-answering system based on Retrieval-Augmented Generation (RAG) using Chinese Wikipedia and Lawbank as retrieval sources. Using TTQA and TMMLU+ as evaluation datasets, the system employs BGE-M3 for dense vector…

Information Retrieval · Computer Science 2025-01-17 Te-Lun Yang , Jyi-Shane Liu , Yuen-Hsien Tseng , Jyh-Shing Roger Jang

This paper presents the RMIT--ADM+S winning system in the SIGIR 2025 LiveRAG Challenge. Our Generation-Retrieval-Augmented Generation (G-RAG) approach generates a hypothetical answer that is used during the retrieval phase, alongside the…

Information Retrieval · Computer Science 2025-07-25 Kun Ran , Shuoqi Sun , Khoi Nguyen Dinh Anh , Damiano Spina , Oleg Zendel

Retrieval-augmented generation (RAG) has become a cornerstone of contemporary NLP, enhancing large language models (LLMs) by allowing them to access richer factual contexts through in-context retrieval. While effective in monolingual…

Computation and Language · Computer Science 2026-03-31 Leonardo Ranaldi , Barry Haddow , Alexandra Birch

This paper presents the Duluth approach to the SemEval-2025 Task 7 on Multilingual and Crosslingual Fact-Checked Claim Retrieval. We implemented a TF-IDF-based retrieval system with experimentation on vector dimensions and tokenization…

Computation and Language · Computer Science 2025-05-20 Shujauddin Syed , Ted Pedersen

This paper presents the best-performing solution to the SemEval 2023 Task 3 on the subtask 3 dedicated to persuasion techniques detection. Due to a high multilingual character of the input data and a large number of 23 predicted labels…

Computation and Language · Computer Science 2024-06-11 Timo Hromadka , Timotej Smolen , Tomas Remis , Branislav Pecher , Ivan Srba

We describe our system for SemEval-2026 Task 6 (CLARITY: Unmasking Political Question Evasions), which classifies English political interview responses by coarse-grained clarity (3-way) and fine-grained evasion strategy (9-way). Since…

Computation and Language · Computer Science 2026-04-30 Gabriel Stefan , Sergiu Nisioi

This paper presents the award-winning RMIT-ADM+S system for the Text-to-Text track of the NeurIPS~2025 MMU-RAG Competition. We introduce Routing-to-RAG (R2RAG), a research-focused retrieval-augmented generation (RAG) architecture composed…

With the increasing number of clinical trial reports generated every day, it is becoming hard to keep up with novel discoveries that inform evidence-based healthcare recommendations. To help automate this process and assist medical experts,…

Computation and Language · Computer Science 2023-05-03 Juraj Vladika , Florian Matthes

SemEval 2018 Task 7 focuses on relation ex- traction and classification in scientific literature. In this work, we present our tree-based LSTM network for this shared task. Our approach placed 9th (of 28) for subtask 1.1 (relation…

Computation and Language · Computer Science 2018-04-17 Sean MacAvaney , Luca Soldaini , Arman Cohan , Nazli Goharian

Multimodal retrieval models are becoming increasingly important in scenarios such as food delivery, where rich multimodal features can meet diverse user needs and enable precise retrieval. Mainstream approaches typically employ a dual-tower…

Information Retrieval · Computer Science 2026-02-09 Boyu Chen , Tai Guo , Weiyu Cui , Yuqing Li , Xingxing Wang , Chuan Shi , Cheng Yang

This paper presents the participation of team QUST in Task 8 SemEval 2024. We first performed data augmentation and cleaning on the dataset to enhance model training efficiency and accuracy. In the monolingual task, we evaluated traditional…

Computation and Language · Computer Science 2024-02-20 Xiaoman Xu , Xiangrun Li , Taihang Wang , Jianxiang Tian , Ye Jiang

This paper describes the results of SemEval 2023 task 7 -- Multi-Evidence Natural Language Inference for Clinical Trial Data (NLI4CT) -- consisting of 2 tasks, a Natural Language Inference (NLI) task, and an evidence selection task on…

Computation and Language · Computer Science 2023-05-12 Maël Jullien , Marco Valentino , Hannah Frost , Paul O'Regan , Donal Landers , André Freitas

Multi-task learning (MTL) is a powerful machine learning paradigm designed to leverage shared knowledge across tasks to improve generalization and performance. Previous works have proposed approaches to MTL that can be divided into feature…

Machine Learning · Computer Science 2024-06-13 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Retrieval-Augmented Generation (RAG) integrates non-parametric knowledge into Large Language Models (LLMs), typically from unstructured texts and structured graphs. While recent progress has advanced text-based RAG to multi-turn reasoning…

Computation and Language · Computer Science 2025-12-11 Yucan Guo , Miao Su , Saiping Guan , Zihao Sun , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

This paper presents our strategy to address the SemEval-2022 Task 3 PreTENS: Presupposed Taxonomies Evaluating Neural Network Semantics. The goal of the task is to identify if a sentence is deemed acceptable or not, depending on the…

Computation and Language · Computer Science 2022-10-10 Injy Sarhan , Pablo Mosteiro , Marco Spruit

In this paper we present a multi-adapter retrieval augmented generation system (MARAGS) for Meta's Comprehensive RAG (CRAG) competition for KDD CUP 2024. CRAG is a question answering dataset contains 3 different subtasks aimed at realistic…

Computation and Language · Computer Science 2024-11-05 Mitchell DeHaven

We introduce MCTS-RAG, a novel approach that enhances the reasoning capabilities of small language models on knowledge-intensive tasks by leveraging retrieval-augmented generation (RAG) to provide relevant context and Monte Carlo Tree…

Computation and Language · Computer Science 2025-10-09 Yunhai Hu , Yilun Zhao , Chen Zhao , Arman Cohan