中文
相关论文

相关论文: FM2DS: Few-Shot Multimodal Multihop Data Synthesis…

200 篇论文

Multi-hop reasoning requires aggregating multiple documents to answer a complex question. Existing methods usually decompose the multi-hop question into simpler single-hop questions to solve the problem for illustrating the explainable…

计算与语言 · 计算机科学 2022-08-23 Siyuan Wang , Zhongyu Wei , Zhihao Fan , Qi Zhang , Xuanjing Huang

Textual response generation is an essential task for multimodal task-oriented dialog systems.Although existing studies have achieved fruitful progress, they still suffer from two critical limitations: 1) focusing on the attribute knowledge…

计算与语言 · 计算机科学 2023-05-18 Xiaolin Chen , Xuemeng Song , Yinwei Wei , Liqiang Nie , Tat-Seng Chua

The ability to understand and answer questions over documents can be useful in many business and practical applications. However, documents often contain lengthy and diverse multimodal contents such as texts, figures, and tables, which are…

Multi-source multi-hop question answering (QA) represents a challenging task in natural language processing due to the need for dynamic integration of heterogeneous knowledge sources and multi-step reasoning. Existing methods often suffer…

计算与语言 · 计算机科学 2025-02-11 Jackson Coleman , Isaiah Lawrence , Benjamin Turner

Multimodal Large Language Models (MLLMs) in real-world applications require access to external knowledge sources and must remain responsive to the dynamic and ever-changing real-world information in order to address information-seeking and…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Kartik Narayan , Yang Xu , Tian Cao , Kavya Nerella , Vishal M. Patel , Navid Shiee , Peter Grasch , Chao Jia , Yinfei Yang , Zhe Gan

Understanding real-world videos such as movies requires integrating visual and dialogue cues. Yet existing VideoQA benchmarks struggle to capture this multimodal reasoning and, given the difficulty of evaluating free-form answers, largely…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Shaden Shaar , Bradon Thymes , Sirawut Chaixanien , Claire Cardie , Bharath Hariharan

Multi-hop question answering (QA) often requires sequential retrieval (multi-hop retrieval), where each hop retrieves missing knowledge based on information from previous hops. To facilitate more effective retrieval, we aim to distill…

计算与语言 · 计算机科学 2025-03-03 Zehua Xia , Yuyang Wu , Yiyun Xia , Cam-Tu Nguyen

Multi-hop Question Answering over Knowledge Graph~(KGQA) aims to find the answer entities that are multiple hops away from the topic entities mentioned in a natural language question on a large-scale Knowledge Graph (KG). To cope with the…

计算与语言 · 计算机科学 2023-03-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Ji-Rong Wen

Most Reading Comprehension methods limit themselves to queries which can be answered using a single sentence, paragraph, or document. Enabling models to combine disjoint pieces of textual evidence would extend the scope of machine…

计算与语言 · 计算机科学 2018-06-12 Johannes Welbl , Pontus Stenetorp , Sebastian Riedel

Training conversational question-answering (QA) systems requires a substantial amount of in-domain data, which is often scarce in practice. A common solution to this challenge is to generate synthetic data. Traditional methods typically…

机器学习 · 计算机科学 2025-04-22 Kun Qian , Maximillian Chen , Siyan Li , Arpit Sharma , Zhou Yu

Question answering systems are typically evaluated on factual correctness, yet many real-world applications-such as education and career guidance-require mentorship: responses that provide reflection and guidance. Existing QA benchmarks…

计算与语言 · 计算机科学 2026-01-27 Parth Bhalerao , Diola Dsouza , Ruiwen Guan , Oana Ignat

This paper presents a new approach to form-filling by reformulating the task as multimodal natural language Question Answering (QA). The reformulation is achieved by first translating the elements on the GUI form (text fields, buttons,…

人工智能 · 计算机科学 2024-03-26 Larry Heck , Simon Heck , Anirudh Sundar

Multi-hop textual question answering requires combining information from multiple sentences. We focus on a natural setting where, unlike typical reading comprehension, only partial information is provided with each question. The model must…

计算与语言 · 计算机科学 2019-09-23 Tushar Khot , Ashish Sabharwal , Peter Clark

Commonsense question answering (QA) research requires machines to answer questions based on commonsense knowledge. However, this research requires expensive labor costs to annotate data as the basis of research, and models that rely on…

计算与语言 · 计算机科学 2023-05-11 Xin Guan , Biwei Cao , Qingqing Gao , Zheng Yin , Bo Liu , Jiuxin Cao

Multi-hop question answering (QA) requires a model to retrieve and integrate information from different parts of a long text to answer a question. Humans answer this kind of complex questions via a divide-and-conquer approach. In this…

计算与语言 · 计算机科学 2021-01-28 Yixuan Tang , Hwee Tou Ng , Anthony K. H. Tung

Multimodal Large Language Models are increasingly applied to biomedical imaging, yet scientific reasoning for microscopy remains limited by the scarcity of large-scale, high-quality training data. We introduce MicroVQA++, a three-stage,…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Manyu Li , Ruian He , Chenxi Ma , Weimin Tan , Bo Yan

Multimodal Question Answering (MMQA) is crucial as it enables comprehensive understanding and accurate responses by integrating insights from diverse data representations such as tables, charts, and text. Most existing researches in MMQA…

计算与语言 · 计算机科学 2024-10-30 Bowen Zhao , Tianhao Cheng , Yuejie Zhang , Ying Cheng , Rui Feng , Xiaobo Zhang

Multi-hop question answering (MQA) under knowledge editing (KE) has garnered significant attention in the era of large language models. However, existing models for MQA under KE exhibit poor performance when dealing with questions…

计算与语言 · 计算机科学 2024-04-02 Keyuan Cheng , Gang Lin , Haoyang Fei , Yuxuan zhai , Lu Yu , Muhammad Asif Ali , Lijie Hu , Di Wang

Explainable multi-hop question answering (QA) not only predicts answers but also identifies rationales, i. e. subsets of input sentences used to derive the answers. This problem has been extensively studied under the supervised setting,…

计算与语言 · 计算机科学 2023-05-24 Wenting Zhao , Justin T. Chiu , Claire Cardie , Alexander M. Rush

Multi-hop QA (MHQA) involves step-by-step reasoning to answer complex questions and find multiple relevant supporting facts. However, Existing large language models'(LLMs) reasoning ability in multi-hop question answering remains…

计算与语言 · 计算机科学 2024-02-20 Jian Wu , Linyi Yang , Yuliang Ji , Wenhao Huang , Börje F. Karlsson , Manabu Okumura