English
Related papers

Related papers: Hybrid Graphs for Table-and-Text based Question An…

200 papers

Answering complex questions over textual resources remains a challenge, particularly when dealing with nuanced relationships between multiple entities expressed within natural-language sentences. To this end, curated knowledge bases (KBs)…

Computation and Language · Computer Science 2023-09-08 Jingjing Xu , Maria Biryukov , Martin Theobald , Vinu Ellampallil Venugopal

In the real world, knowledge often exists in a multimodal and heterogeneous form. Addressing the task of question answering with hybrid data types, including text, tables, and images, is a challenging task (MMHQA). Recently, with the rise…

Computation and Language · Computer Science 2023-09-12 Weihao Liu , Fangyu Lei , Tongxu Luo , Jiahe Lei , Shizhu He , Jun Zhao , Kang Liu

Open Domain Question Answering (QA) is evolving from complex pipelined systems to end-to-end deep neural networks. Specialized neural models have been developed for extracting answers from either text alone or Knowledge Bases (KBs) alone.…

Computation and Language · Computer Science 2018-09-05 Haitian Sun , Bhuwan Dhingra , Manzil Zaheer , Kathryn Mazaitis , Ruslan Salakhutdinov , William W. Cohen

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Question-Answering (QA) from technical documents often involves questions whose answers are present in figures, such as flowcharts or flow diagrams. Text-based Retrieval Augmented Generation (RAG) systems may fail to answer such questions.…

Computation and Language · Computer Science 2025-08-01 Sumit Soman , H. G. Ranjani , Sujoy Roychowdhury , Venkata Dharma Surya Narayana Sastry , Akshat Jain , Pranav Gangrade , Ayaaz Khan

Vision-Language Models (VLMs) have emerged as versatile solutions for zero-shot question answering (QA) across various domains. However, enabling VLMs to effectively comprehend structured graphs and perform accurate, efficient QA remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Yanbin Wei , Jiangyue Yan , Chun Kang , Yang Chen , Hua Liu , James Kwok , Yu Zhang

The generation of questions and answers (QA) from knowledge graphs (KG) plays a crucial role in the development and testing of educational platforms, dissemination tools, and large language models (LLM). However, existing approaches often…

Computation and Language · Computer Science 2025-11-17 Sania Nayab , Marco Simoni , Giulio Rossolini , Andrea Saracino

Retrieval of information from graph-structured knowledge bases represents a promising direction for improving the factuality of LLMs. While various solutions have been proposed, a comparison of methods is difficult due to the lack of…

Machine Learning · Computer Science 2025-12-05 Alberto Cattaneo , Carlo Luschi , Daniel Justus

We propose a novel framework that leverages Visual Question Answering (VQA) models to automate the evaluation of LLM-generated data visualizations. Traditional evaluation methods often rely on human judgment, which is costly and unscalable,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 James Ford , Xingmeng Zhao , Dan Schumacher , Anthony Rios

Integrating structured knowledge from tabular formats poses significant challenges within natural language processing (NLP), mainly when dealing with complex, semi-structured tables like those found in the FeTaQA dataset. These tables…

Computation and Language · Computer Science 2024-10-31 Hossein Sholehrasa , Sanaz Saki Norouzi , Pascal Hitzler , Majid Jaberi-Douraki

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

Large language models (LLMs) excel in generating fluent utterances but can lack reliable grounding in verified information. At the same time, knowledge-graph-based fact-checkers deliver precise and interpretable evidence, yet suffer from…

Computation and Language · Computer Science 2025-11-06 Shaghayegh Kolli , Richard Rosenbaum , Timo Cavelius , Lasse Strothe , Andrii Lata , Jana Diesner

In Textual question answering (TQA) systems, complex questions often require retrieving multiple textual fact chains with multiple reasoning steps. While existing benchmarks are limited to single-chain or single-hop retrieval scenarios. In…

Computation and Language · Computer Science 2023-05-24 Minjun Zhu , Yixuan Weng , Shizhu He , Kang Liu , Jun Zhao

In the real-world question answering scenarios, hybrid form combining both tabular and textual contents has attracted more and more attention, among which numerical reasoning problem is one of the most typical and challenging problems.…

Computation and Language · Computer Science 2022-10-21 Fangyu Lei , Shizhu He , Xiang Li , Jun Zhao , Kang Liu

Direct answering of questions that involve multiple entities and relations is a challenge for text-based QA. This problem is most pronounced when answers can be found only by joining evidence from multiple documents. Curated knowledge…

Information Retrieval · Computer Science 2020-12-01 Xiaolu Lu , Soumajit Pramanik , Rishiraj Saha Roy , Abdalghani Abujabal , Yafang Wang , Gerhard Weikum

Answering natural language questions on knowledge graphs (KGQA) remains a great challenge in terms of understanding complex questions via multi-hop reasoning. Previous efforts usually exploit large-scale entity-related text corpora or…

Computation and Language · Computer Science 2022-09-05 Zile Qiao , Wei Ye , Tong Zhang , Tong Mo , Weiping Li , Shikun Zhang

Most available data is unstructured, making it challenging to access valuable information. Automatically building Knowledge Graphs (KGs) is crucial for structuring data and making it accessible, allowing users to search for information…

Artificial Intelligence · Computer Science 2024-09-06 Yassir Lairgi , Ludovic Moncla , Rémy Cazabet , Khalid Benabdeslem , Pierre Cléau

Fine-tuning for large language models (LLMs) typically requires substantial amounts of high-quality supervised data, which is both costly and labor-intensive to acquire. While synthetic data generation has emerged as a promising solution,…

Computation and Language · Computer Science 2025-05-28 Zihong Chen , Wanli Jiang , Jinzhe Li , Zhonghang Yuan , Huanjun Kong , Wanli Ouyang , Nanqing Dong

In this work, we address question answering (QA) over a hybrid of tabular and textual data that are very common content on the Web (e.g. SEC filings), where discrete reasoning capabilities are often required. Recently, large language models…

Computation and Language · Computer Science 2024-10-01 Fengbin Zhu , Ziyang Liu , Fuli Feng , Chao Wang , Moxin Li , Tat-Seng Chua

The scarcity of high-quality knowledge graphs (KGs) remains a critical bottleneck for downstream AI applications, as existing extraction methods rely heavily on error-prone pattern-matching techniques or resource-intensive large language…

Computation and Language · Computer Science 2025-10-28 Teng Lin