English
Related papers

Related papers: LEAF-QA: Locate, Encode & Attend for Figure Questi…

200 papers

Question answering (QA) is a fundamental means to facilitate assessment and training of narrative comprehension skills for both machines and young children, yet there is scarcity of high-quality QA datasets carefully designed to serve this…

Documents are fundamental to preserving and disseminating information, often incorporating complex layouts, tables, and charts that pose significant challenges for automatic document understanding (DU). While vision-language large models…

Computation and Language · Computer Science 2025-06-19 Negar Foroutan , Angelika Romanou , Matin Ansaripour , Julian Martin Eisenschlos , Karl Aberer , Rémi Lebret

Audio-Visual Question Answering (AVQA) is a complex multi-modal reasoning task, demanding intelligent systems to accurately respond to natural language queries based on audio-video input pairs. Nevertheless, prevalent AVQA approaches are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Jie Ma , Min Hu , Pinghui Wang , Wangchun Sun , Lingyun Song , Hongbin Pei , Jun Liu , Youtian Du

Knowledge-based Visual Question Answering (KVQA) requires external knowledge beyond the visible content to answer questions about an image. This ability is challenging but indispensable to achieve general VQA. One limitation of existing…

Artificial Intelligence · Computer Science 2020-11-04 Jing Yu , Zihao Zhu , Yujing Wang , Weifeng Zhang , Yue Hu , Jianlong Tan

With the growing number and size of Linked Data datasets, it is crucial to make the data accessible and useful for users without knowledge of formal query languages. Two approaches towards this goal are knowledge graph visualization and…

Information Retrieval · Computer Science 2019-07-22 Gerhard Wohlgenannt , Dmitry Mouromtsev , Dmitry Pavlov , Yury Emelyanov , Alexey Morozov

Visual question answering (VQA) requires systems to perform concept-level reasoning by unifying unstructured (e.g., the context in question and answer; "QA context") and structured (e.g., knowledge graph for the QA context and scene;…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Yanan Wang , Michihiro Yasunaga , Hongyu Ren , Shinya Wada , Jure Leskovec

Knowledge Graph Question Answering (KGQA) aims to answer user-questions from a knowledge graph (KG) by identifying the reasoning relations between topic entity and answer. As a complex branch task of KGQA, multi-hop KGQA requires reasoning…

Computation and Language · Computer Science 2022-11-15 Weiqiang Jin , Biao Zhao , Hang Yu , Xi Tao , Ruiping Yin , Guizhong Liu

Dashboards are powerful visualization tools for data-driven decision-making, integrating multiple interactive views that allow users to explore, filter, and navigate data. Unlike static charts, dashboards support rich interactivity, which…

Recently, Vision Language Models (VLMs) have increasingly emphasized document visual grounding to achieve better human-computer interaction, accessibility, and detailed understanding. However, its application to visualizations such as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Alexander Vogel , Omar Moured , Yufan Chen , Jiaming Zhang , Rainer Stiefelhagen

In recent years, people have increasingly used AI to help them with their problems by asking questions on different topics. One of these topics can be software-related and programming questions. In this work, we focus on the questions which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Motahhare Mirzaei , Mohammad Javad Pirhadi , Sauleh Eetemadi

Long-form question answering (LFQA) poses a challenge as it involves generating detailed answers in the form of paragraphs, which go beyond simple yes/no responses or short factual answers. While existing QA models excel in questions with…

Computation and Language · Computer Science 2023-11-17 Pritom Saha Akash , Kashob Kumar Roy , Lucian Popa , Kevin Chen-Chuan Chang

Retrieval-Augmented Generation (RAG) models frequently produce answers grounded in parametric memory rather than the retrieved context, undermining the core promise of retrieval augmentation. A fundamental obstacle to fixing this…

Computation and Language · Computer Science 2026-04-30 Li Ju , Junzhe Wang , Qi Zhang

The ability of reasoning over evidence has received increasing attention in question answering (QA). Recently, natural language database (NLDB) conducts complex QA in knowledge base with textual evidences rather than structured…

Computation and Language · Computer Science 2022-10-18 Minjun Zhu , Yixuan Weng , Shizhu He , Kang Liu , Jun Zhao

Multimodal reasoning models often produce fluent answers supported by seemingly coherent rationales. Existing benchmarks evaluate only final-answer correctness. They do not support atomic visual entailment verification of intermediate…

Artificial Intelligence · Computer Science 2026-03-25 Saleem Ahmed , Srirangaraj Setlur , Venu Govindaraju

Tables are often created with hierarchies, but existing works on table reasoning mainly focus on flat tables and neglect hierarchical tables. Hierarchical tables challenge existing methods by hierarchical indexing, as well as implicit…

Computation and Language · Computer Science 2022-03-29 Zhoujun Cheng , Haoyu Dong , Zhiruo Wang , Ran Jia , Jiaqi Guo , Yan Gao , Shi Han , Jian-Guang Lou , Dongmei Zhang

Decoding visual content from fMRI signals recorded while a person views images, and specifically answering questions about the seen images, is a long-standing challenge. While significant progress has been made in recent years in visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Roman Beliy , Matias Cosarinsky , Oliver Heinimann , Navve Wasserman , Michal Irani

Chart understanding enables automated data analysis for humans, which requires models to achieve highly accurate visual comprehension. While existing Visual Language Models (VLMs) have shown progress in chart understanding, the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Muye Huang , Han Lai , Xinyu Zhang , Wenjun Wu , Jie Ma , Lingling Zhang , Jun Liu

Large Language Models (LLMs) excel in many natural language processing tasks but often exhibit factual inconsistencies in knowledge-intensive settings. Integrating external knowledge resources, particularly knowledge graphs (KGs), provides…

Computation and Language · Computer Science 2026-02-17 Shuai Wang , Yinan Yu

Knowledge-based visual question answering (QA) aims to answer a question which requires visually-grounded external knowledge beyond image content itself. Answering complex questions that require multi-hop reasoning under weak supervision is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Yu-Jung Heo , Eun-Sol Kim , Woo Suk Choi , Byoung-Tak Zhang

Time series data are foundational in finance, healthcare, and energy domains. However, most existing methods and datasets remain focused on a narrow spectrum of tasks, such as forecasting or anomaly detection. To bridge this gap, we…

Computation and Language · Computer Science 2025-07-01 Yaxuan Kong , Yiyuan Yang , Yoontae Hwang , Wenjie Du , Stefan Zohren , Zhangyang Wang , Ming Jin , Qingsong Wen