English
Related papers

Related papers: A Question Answering Dataset for Temporal-Sensitiv…

200 papers

Retrieval-Augmented Generation (RAG) has become the standard approach for grounding large language models in information that was not available during training. While existing datasets and benchmarks focus on web or other public sources,…

Information Retrieval · Computer Science 2026-05-21 Yuhong Sun , Joachim Rahmfeld , Chris Weaver , Weijia Chen , Roshan Desai , Wenxi Huang , Mark H. Butler

While Retrieval-Augmented Generation (RAG) has been swiftly adopted in scientific and clinical QA systems, a comprehensive evaluation benchmark in the medical domain is lacking. To address this gap, we introduce the Medical…

Computation and Language · Computer Science 2026-02-12 Liz Li , Wei Zhu

Many individuals are likely to face a legal dispute at some point in their lives, but their lack of understanding of how to navigate these complex issues often renders them vulnerable. The advancement of natural language processing opens…

Computation and Language · Computer Science 2023-10-02 Antoine Louis , Gijs van Dijck , Gerasimos Spanakis

We introduce a novel retrieval-augmented generation (RAG) framework tailored for multihop question answering. First, our system uses large language model (LLM) to decompose complex multihop questions into a sequence of single-hop…

Computation and Language · Computer Science 2025-08-14 Seokgi Lee

Multi-hop Question Answering (QA) necessitates complex reasoning by integrating multiple pieces of information to resolve intricate questions. However, existing QA systems encounter challenges such as outdated information, context window…

Computation and Language · Computer Science 2024-08-23 Xiaoming Zhang , Ming Wang , Xiaocui Yang , Daling Wang , Shi Feng , Yifei Zhang

Recent advancements in Large Language Models (LLMs) have pushed the boundaries of natural language processing, especially in long-context understanding. However, the evaluation of these models' long-context abilities remains a challenge due…

Computation and Language · Computer Science 2025-04-24 Cunxiang Wang , Ruoxi Ning , Boqi Pan , Tonghui Wu , Qipeng Guo , Cheng Deng , Guangsheng Bao , Xiangkun Hu , Zheng Zhang , Qian Wang , Yue Zhang

Temporal reasoning is fundamental to human cognition and is crucial for various real-world applications. While recent advances in Large Language Models have demonstrated promising capabilities in temporal reasoning, existing benchmarks…

Computation and Language · Computer Science 2025-02-25 Zhenglin Wang , Jialong Wu , Pengfei LI , Yong Jiang , Deyu Zhou

With the rapid growth in sensor data, effectively interpreting and interfacing with these data in a human-understandable way has become crucial. While existing research primarily focuses on learning classification models, fewer studies have…

Computation and Language · Computer Science 2025-03-04 Benjamin Reichman , Xiaofan Yu , Lanxiang Hu , Jack Truxal , Atishay Jain , Rushil Chandrupatla , Tajana Šimunić Rosing , Larry Heck

Retrieval-Augmented Generation (RAG) utilizes external knowledge to augment Large Language Models' (LLMs) reliability. For flexibility, agentic RAG employs autonomous, multi-round retrieval and reasoning to resolve queries. Although recent…

Information Retrieval · Computer Science 2025-11-10 Chao Zhang , Yuhao Wang , Derong Xu , Haoxin Zhang , Yuanjie Lyu , Yuhao Chen , Shuochen Liu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

We introduce RoMQA, the first benchmark for robust, multi-evidence, multi-answer question answering (QA). RoMQA contains clusters of questions that are derived from related constraints mined from the Wikidata knowledge graph. RoMQA…

Computation and Language · Computer Science 2022-11-16 Victor Zhong , Weijia Shi , Wen-tau Yih , Luke Zettlemoyer

Machine reading is a fundamental task for testing the capability of natural language understanding, which is closely related to human cognition in many aspects. With the rising of deep learning techniques, algorithmic models rival human…

Computation and Language · Computer Science 2020-07-17 Jian Liu , Leyang Cui , Hanmeng Liu , Dandan Huang , Yile Wang , Yue Zhang

In this paper, we present the mQA model, which is able to answer questions about the content of an image. The answer can be a sentence, a phrase or a single word. Our model contains four components: a Long Short-Term Memory (LSTM) to…

Computer Vision and Pattern Recognition · Computer Science 2015-11-04 Haoyuan Gao , Junhua Mao , Jie Zhou , Zhiheng Huang , Lei Wang , Wei Xu

Recently proposed systems for open-domain question answering (OpenQA) require large amounts of training data to achieve state-of-the-art performance. However, data annotation is known to be time-consuming and therefore expensive to acquire.…

Computation and Language · Computer Science 2024-02-23 Piotr Rybak , Piotr Przybyła , Maciej Ogrodniczuk

Test-time compute is central to large reasoning models, yet analysing their reasoning behaviour through generated text is increasingly impractical and unreliable. Response length is often used as a brute proxy for reasoning effort, but this…

Computation and Language · Computer Science 2026-02-09 Quoc Tuan Pham , Mehdi Jafari , Flora Salim

Conversational Question Answering is a challenging task since it requires understanding of conversational history. In this project, we propose a new system RoBERTa + AT +KD, which involves rationale tagging multi-task, adversarial training,…

Computation and Language · Computer Science 2019-09-25 Ying Ju , Fubang Zhao , Shijie Chen , Bowen Zheng , Xuefeng Yang , Yunfeng Liu

We present PeerQA, a real-world, scientific, document-level Question Answering (QA) dataset. PeerQA questions have been sourced from peer reviews, which contain questions that reviewers raised while thoroughly examining the scientific…

Computation and Language · Computer Science 2025-02-20 Tim Baumgärtner , Ted Briscoe , Iryna Gurevych

Domain-specific QA systems require not just generative fluency but high factual accuracy grounded in structured expert knowledge. While recent Retrieval-Augmented Generation (RAG) frameworks improve context recall, they struggle with…

Computation and Language · Computer Science 2025-05-26 David Osei Opoku , Ming Sheng , Yong Zhang

We introduce SciQAG, a novel framework for automatically generating high-quality science question-answer pairs from a large corpus of scientific literature based on large language models (LLMs). SciQAG consists of a QA generator and a QA…

Computation and Language · Computer Science 2024-07-11 Yuwei Wan , Yixuan Liu , Aswathy Ajith , Clara Grazian , Bram Hoex , Wenjie Zhang , Chunyu Kit , Tong Xie , Ian Foster

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for enhancing large language models (LLMs) on multi-hop question answering (QA), which requires reasoning over evidence from multiple documents. Current multi-hop RAG…

Computation and Language · Computer Science 2026-05-28 Yikai Zhu , Kunfeng Chen , Qihuang Zhong , Juhua Liu , Bo Du

Spoken question answering (SQA) systems are critical for digital assistants and other real-world use cases, but evaluating their performance is a challenge due to the importance of human-spoken questions. This study presents a new…

Computation and Language · Computer Science 2024-02-28 Yijing Wu , SaiKrishna Rallabandi , Ravisutha Srinivasamurthy , Parag Pravin Dakle , Alolika Gon , Preethi Raghavan