English
Related papers

Related papers: Multimodal Question Answering for Unified Informat…

200 papers

Knowledge-based Visual Question Answering (VQA) expects models to rely on external knowledge for robust answer prediction. Though significant it is, this paper discovers several leading factors impeding the advancement of current…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Yangyang Guo , Liqiang Nie , Yongkang Wong , Yibing Liu , Zhiyong Cheng , Mohan Kankanhalli

In this paper, we present the mQA model, which is able to answer questions about the content of an image. The answer can be a sentence, a phrase or a single word. Our model contains four components: a Long Short-Term Memory (LSTM) to…

Computer Vision and Pattern Recognition · Computer Science 2015-11-04 Haoyuan Gao , Junhua Mao , Jie Zhou , Zhiheng Huang , Lei Wang , Wei Xu

Large Language Models (LLMs) have shown proficiency in question-answering tasks but often struggle to integrate real-time knowledge, leading to potentially outdated or inaccurate responses. This problem becomes even more challenging when…

Computation and Language · Computer Science 2024-08-15 Yucheng Shi , Qiaoyu Tan , Xuansheng Wu , Shaochen Zhong , Kaixiong Zhou , Ninghao Liu

Quantum Machine Learning has the potential to improve traditional machine learning methods and overcome some of the main limitations imposed by the classical computing paradigm. However, the practical advantages of using quantum resources…

Quantum Physics · Physics 2023-03-21 Antonio Macaluso , Matthias Klusch , Stefano Lodi , Claudio Sartori

Question answering (QA) is a critical task for speech-based retrieval from knowledge sources, by sifting only the answers without requiring to read supporting documents. Specifically, open-domain QA aims to answer user questions on…

Computation and Language · Computer Science 2023-08-09 Sang-eun Han , Yeonseok Jeong , Seung-won Hwang , Kyungjae Lee

The recent success of machine learning systems on various QA datasets could be interpreted as a significant improvement in models' language understanding abilities. However, using various perturbations, multiple recent works have shown that…

Computation and Language · Computer Science 2020-11-24 Krunal Shah , Nitish Gupta , Dan Roth

Multimodal Knowledge Editing (MKE) extends traditional knowledge editing to settings involving both textual and visual modalities. However, existing MKE benchmarks primarily assess final answer correctness while neglecting the quality of…

Artificial Intelligence · Computer Science 2025-12-02 Li Yuan , Qingfei Huang , Bingshan Zhu , Yi Cai , Qingbao Huang , Changmeng Zheng , Zikun Deng , Tao Wang

Multimodal Question Answering (MMQA) is crucial as it enables comprehensive understanding and accurate responses by integrating insights from diverse data representations such as tables, charts, and text. Most existing researches in MMQA…

Computation and Language · Computer Science 2024-10-30 Bowen Zhao , Tianhao Cheng , Yuejie Zhang , Ying Cheng , Rui Feng , Xiaobo Zhang

Embodied Question Answering (EQA) requires agents to explore 3D environments to obtain observations and answer questions related to the scene. Existing methods leverage VLMs to directly explore the environment and answer questions without…

Artificial Intelligence · Computer Science 2025-10-28 Mingliang Zhai , Hansheng Liang , Xiaomeng Fan , Zhi Gao , Chuanhao Li , Che Sun , Xu Bin , Yuwei Wu , Yunde Jia

Multi-modal entity alignment (MMEA) aims to identify equivalent entity pairs across different multi-modal knowledge graphs (MMKGs). Existing approaches focus on how to better encode and aggregate information from different modalities.…

Information Retrieval · Computer Science 2024-04-30 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

Question Answer (QA) systems for biomedical experiments facilitate cross-disciplinary communication, and serve as a foundation for downstream tasks, e.g., laboratory automation. High Information Density (HID) and Multi-Step Reasoning (MSR)…

Artificial Intelligence · Computer Science 2026-01-09 Haofei Hou , Shunyi Zhao , Fanxu Meng , Kairui Yang , Lecheng Ruan , Qining Wang

We study open-domain question answering with structured, unstructured and semi-structured knowledge sources, including text, tables, lists and knowledge bases. Departing from prior work, we propose a unifying approach that homogenizes all…

Computation and Language · Computer Science 2022-05-05 Barlas Oguz , Xilun Chen , Vladimir Karpukhin , Stan Peshterliev , Dmytro Okhonko , Michael Schlichtkrull , Sonal Gupta , Yashar Mehdad , Scott Yih

Researchers produce thousands of scholarly documents containing valuable technical knowledge. The community faces the laborious task of reading these documents to identify, extract, and synthesize information. To automate information…

Computation and Language · Computer Science 2023-12-13 Tavish McDonald , Brian Tsan , Amar Saini , Juanita Ordonez , Luis Gutierrez , Phan Nguyen , Blake Mason , Brenda Ng

This paper describes our system for the SciVQA 2025 Shared Task on Scientific Visual Question Answering. Our system employs an ensemble of two Multimodal Large Language Models and various few-shot example retrieval strategies. The model and…

Computation and Language · Computer Science 2025-07-04 Christian Jaumann , Annemarie Friedrich , Rainer Lienhart

Information extraction (IE) is a fundamental area in natural language processing where prompting large language models (LLMs), even with in-context examples, cannot defeat small LMs tuned on very small IE datasets. We observe that IE tasks,…

Computation and Language · Computer Science 2024-04-02 Letian Peng , Zilong Wang , Feng Yao , Zihan Wang , Jingbo Shang

Retrieval question answering (ReQA) is the task of retrieving a sentence-level answer to a question from an open corpus (Ahmad et al.,2019).This paper presents MultiReQA, anew multi-domain ReQA evaluation suite com-posed of eight retrieval…

Computation and Language · Computer Science 2020-05-07 Mandy Guo , Yinfei Yang , Daniel Cer , Qinlan Shen , Noah Constant

Prior work on multilingual question answering has mostly focused on using large multilingual pre-trained language models (LM) to perform zero-shot language-wise learning: train a QA model on English and test on other languages. In this…

Computation and Language · Computer Science 2020-12-14 Mihaela Bornea , Lin Pan , Sara Rosenthal , Radu Florian , Avirup Sil

Broadcast and media organizations increasingly rely on artificial intelligence to automate the labor-intensive processes of content indexing, tagging, and metadata generation. However, existing AI systems typically operate on a single…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yassir Benhammou , Suman Kalyan , Sujay Kumar

Research in Document Intelligence and especially in Document Key Information Extraction (DocKIE) has been mainly solved as Token Classification problem. Recent breakthroughs in both natural language processing (NLP) and computer vision…

Computation and Language · Computer Science 2023-04-24 Laurent Lam , Pirashanth Ratnamogan , Joël Tang , William Vanhuffel , Fabien Caspani

Embodied Question Answering (EQA) is an essential yet challenging task for robot assistants. Large vision-language models (VLMs) have shown promise for EQA, but existing approaches either treat it as static video question answering without…

Robotics · Computer Science 2025-08-12 Kai Cheng , Zhengyuan Li , Xingpeng Sun , Byung-Cheol Min , Amrit Singh Bedi , Aniket Bera