中文
相关论文

相关论文: Textbook Question Answering with Multi-modal Conte…

200 篇论文

Knowledge graph question answering (KGQA) based on information retrieval aims to answer a question by retrieving answer from a large-scale knowledge graph. Most existing methods first roughly retrieve the knowledge subgraphs (KSG) that may…

计算与语言 · 计算机科学 2022-10-06 Hanning Gao , Lingfei Wu , Po Hu , Zhihua Wei , Fangli Xu , Bo Long

Table Question Answering (TQA) presents a substantial challenge at the intersection of natural language processing and data analytics. This task involves answering natural language (NL) questions on top of tabular data, demanding…

数据库 · 计算机科学 2023-10-03 Yunjia Zhang , Jordan Henkel , Avrilia Floratou , Joyce Cahoon , Shaleen Deep , Jignesh M. Patel

Recently, end-to-end trained models for multiple-choice commonsense question answering (QA) have delivered promising results. However, such question-answering systems cannot be directly applied in real-world scenarios where answer…

计算与语言 · 计算机科学 2023-03-21 Zhen Han , Yue Feng , Mingming Sun

Integrating outside knowledge for reasoning in visio-linguistic tasks such as visual question answering (VQA) is an open problem. Given that pretrained language models have been shown to include world knowledge, we propose to use a unimodal…

计算机视觉与模式识别 · 计算机科学 2022-09-14 Ander Salaberria , Gorka Azkune , Oier Lopez de Lacalle , Aitor Soroa , Eneko Agirre

Multiple-Choice Question Answering (MCQA) is a challenging task in machine reading comprehension. The main challenge in MCQA is to extract "evidence" from the given context that supports the correct answer. In the OpenbookQA dataset, the…

计算与语言 · 计算机科学 2020-10-07 Sicheng Yu , Hao Zhang , Wei Jing , Jing Jiang

Fact-based Visual Question Answering (FVQA), a challenging variant of VQA, requires a QA-system to include facts from a diverse knowledge graph (KG) in its reasoning process to produce an answer. Large KGs, especially common-sense KGs, are…

计算与语言 · 计算机科学 2021-06-22 Kiran Ramnath , Mark Hasegawa-Johnson

Conversational question answering (CQA) is a novel QA task that requires understanding of dialogue context. Different from traditional single-turn machine reading comprehension (MRC) tasks, CQA includes passage comprehension, coreference…

计算与语言 · 计算机科学 2019-01-04 Chenguang Zhu , Michael Zeng , Xuedong Huang

Despite the success of Transformer models in vision and language tasks, they often learn knowledge from enormous data implicitly and cannot utilize structured input data directly. On the other hand, structured learning approaches such as…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Xuehai He , Xin Eric Wang

Answering complex questions about textual narratives requires reasoning over both stated context and the world knowledge that underlies it. However, pretrained language models (LM), the foundation of most modern QA systems, do not robustly…

Question Answering over Temporal Knowledge Graphs (TKGQA) has attracted growing interest for handling time-sensitive queries. However, existing methods still struggle with: 1) weak incorporation of temporal constraints in question…

计算与语言 · 计算机科学 2026-02-24 Wuzhenghong Wen , Bowen Zhou , Jinwen Huang , Xianjie Wu , Yuwei Sun , Su Pan , Liang Li , Jianting Liu

Many visual scenes contain text that carries crucial information, and it is thus essential to understand text in images for downstream reasoning tasks. For example, a deep water label on a warning sign warns people about the danger in the…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Ronghang Hu , Amanpreet Singh , Trevor Darrell , Marcus Rohrbach

Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how…

计算机视觉与模式识别 · 计算机科学 2017-09-26 Supriya Pandhre , Shagun Sodhani

Visual Question Answering (VQA) is challenging due to the complex cross-modal relations. It has received extensive attention from the research community. From the human perspective, to answer a visual question, one needs to read the…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Hantao Huang , Tao Han , Wei Han , Deep Yap , Cheng-Ming Chiang

We introduce an approach for open-domain question answering (QA) that retrieves and reads a passage graph, where vertices are passages of text and edges represent relationships that are derived from an external knowledge base or…

计算与语言 · 计算机科学 2020-04-14 Sewon Min , Danqi Chen , Luke Zettlemoyer , Hannaneh Hajishirzi

Prior work in standardized science exams requires support from large text corpus, such as targeted science corpus fromWikipedia or SimpleWikipedia. However, retrieving knowledge from the large corpus is time-consuming and questions embedded…

人工智能 · 计算机科学 2020-04-28 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Visual Question Answering (VQA) is a challenging task that has received increasing attention from both the computer vision and the natural language processing communities. Given an image and a question in natural language, it requires…

计算机视觉与模式识别 · 计算机科学 2016-07-21 Qi Wu , Damien Teney , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

Conversational question answering (convQA) over knowledge graphs (KGs) involves answering multi-turn natural language questions about information contained in a KG. State-of-the-art methods of ConvQA often struggle with inexplicit…

计算与语言 · 计算机科学 2024-04-01 Lihui Liu , Blaine Hill , Boxin Du , Fei Wang , Hanghang Tong

Direct answering of questions that involve multiple entities and relations is a challenge for text-based QA. This problem is most pronounced when answers can be found only by joining evidence from multiple documents. Curated knowledge…

信息检索 · 计算机科学 2020-12-01 Xiaolu Lu , Soumajit Pramanik , Rishiraj Saha Roy , Abdalghani Abujabal , Yafang Wang , Gerhard Weikum

Automatic Chart Question Answering (ChartQA) is challenging due to the complex distribution of chart elements with patterns of the underlying data not explicitly displayed in charts. To address this challenge, we design a joint multimodal…

计算与语言 · 计算机科学 2024-08-12 Yue Dai , Soyeon Caren Han , Wei Liu

The predominant approach to Visual Question Answering (VQA) demands that the model represents within its weights all of the information required to answer any question about any image. Learning this information from any real training set…

计算机视觉与模式识别 · 计算机科学 2017-11-23 Damien Teney , Anton van den Hengel