English
Related papers

Related papers: DocDancer: Towards Agentic Document-Grounded Infor…

200 papers

We propose a new model, DocHopper, that iteratively attends to different parts of long, hierarchically structured documents to answer complex questions. Similar to multi-hop question-answering (QA) systems, at each step, DocHopper uses a…

Computation and Language · Computer Science 2021-10-25 Haitian Sun , William W. Cohen , Ruslan Salakhutdinov

Complex table question answering (TQA) aims to answer questions that require complex reasoning, such as multi-step or multi-category reasoning, over data represented in tabular form. Previous approaches demonstrated notable performance by…

Computation and Language · Computer Science 2025-02-11 Wei Zhou , Mohsen Mesgar , Annemarie Friedrich , Heike Adel

We introduce DeepSearchQA, a 900-prompt benchmark for evaluating agents on difficult multi-step information-seeking tasks across 17 different fields. Unlike traditional benchmarks that target single answer retrieval or broad-spectrum…

Research in Document Intelligence and especially in Document Key Information Extraction (DocKIE) has been mainly solved as Token Classification problem. Recent breakthroughs in both natural language processing (NLP) and computer vision…

Computation and Language · Computer Science 2023-04-24 Laurent Lam , Pirashanth Ratnamogan , Joël Tang , William Vanhuffel , Fabien Caspani

While digital assistants are increasingly used to help with various productivity tasks, less attention has been paid to employing them in the domain of business documents. To build an agent that can handle users' information needs in this…

Human-Computer Interaction · Computer Science 2022-09-09 Farnaz Jahanbakhsh , Elnaz Nouri , Robert Sim , Ryen W. White , Adam Fourney

We propose DocVXQA, a novel framework for visually self-explainable document question answering. The framework is designed not only to produce accurate answers to questions but also to learn visual heatmaps that highlight contextually…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Mohamed Ali Souibgui , Changkyu Choi , Andrey Barsky , Kangsoo Jung , Ernest Valveny , Dimosthenis Karatzas

Deep Research systems have revolutionized how LLMs solve complex questions through iterative reasoning and evidence gathering. However, current systems remain fundamentally constrained to textual web data, overlooking the vast knowledge…

Information Retrieval · Computer Science 2025-10-27 Kuicai Dong , Shurui Huang , Fangda Ye , Wei Han , Zhi Zhang , Dexun Li , Wenjun Li , Qu Yang , Gang Wang , Yichao Wang , Chen Zhang , Yong Liu

The performance gap between closed-source and open-source large language models (LLMs) is largely attributed to disparities in access to high-quality training data. To bridge this gap, we introduce a novel framework for the automated…

Visually-situated languages such as charts and plots are omnipresent in real-world documents. These graphical depictions are human-readable and are often analyzed in visually-rich documents to address a variety of questions that necessitate…

Artificial Intelligence · Computer Science 2023-10-31 Anran Wu , Luwei Xiao , Xingjiao Wu , Shuwen Yang , Junjie Xu , Zisong Zhuang , Nian Xie , Cheng Jin , Liang He

Large Language Models (LLMs), despite their advancements, are fundamentally limited by their static parametric knowledge, hindering performance on tasks requiring open-domain up-to-date information. While enabling LLMs to interact with…

Computation and Language · Computer Science 2025-05-27 Jianbiao Mei , Tao Hu , Daocheng Fu , Licheng Wen , Xuemeng Yang , Rong Wu , Pinlong Cai , Xinyu Cai , Xing Gao , Yu Yang , Chengjun Xie , Botian Shi , Yong Liu , Yu Qiao

Reading comprehension models are based on recurrent neural networks that sequentially process the document tokens. As interest turns to answering more complex questions over longer documents, sequential reading of large portions of text…

Computation and Language · Computer Science 2018-09-11 Mor Geva , Jonathan Berant

Answering questions related to the legal domain is a complex task, primarily due to the intricate nature and diverse range of legal document systems. Providing an accurate answer to a legal query typically necessitates specialized knowledge…

Computation and Language · Computer Science 2023-09-18 Abdelrahman Abdallah , Bhawna Piryani , Adam Jatowt

The growing volume of academic papers has made it increasingly difficult for researchers to efficiently extract key information. While large language models (LLMs) based agents are capable of automating question answering (QA) workflows for…

Computation and Language · Computer Science 2026-03-31 Tiancheng Huang , Ruisheng Cao , Yuxin Zhang , Zhangyi Kang , Zijian Wang , Chenrun Wang , Yijie Luo , Hang Zheng , Lirong Qian , Lu Chen , Kai Yu

Agentic knowledge graph question answering (KGQA) requires an agent to iteratively interact with knowledge graphs (KGs), posing challenges in both training data scarcity and reasoning generalization. Specifically, existing approaches often…

Computation and Language · Computer Science 2026-04-07 Shuwen Xu , Yao Xu , Jiaxiang Liu , Chenhao Yuan , Wenshuo Peng , Jun Zhao , Kang Liu

We analyze the language learned by an agent trained with reinforcement learning as a component of the ActiveQA system [Buck et al., 2017]. In ActiveQA, question answering is framed as a reinforcement learning task in which an agent sits…

Computation and Language · Computer Science 2018-01-24 Christian Buck , Jannis Bulian , Massimiliano Ciaramita , Wojciech Gajewski , Andrea Gesmundo , Neil Houlsby , Wei Wang

Multimodal agents offer a promising path to automating complex document-intensive workflows. Yet, a critical question remains: do these agents demonstrate genuine strategic reasoning, or merely stochastic trial-and-error search? To address…

Document Understanding (DU) in long-contextual scenarios with complex layouts remains a significant challenge in vision-language research. Although Large Vision-Language Models (LVLMs) excel at short-context DU tasks, their performance…

The advent of Large Language Model (LLM)-powered agents has revolutionized artificial intelligence by enabling solutions to complex, open-ended tasks through web-based information-seeking (IS) capabilities. The scarcity of high-quality…

Computation and Language · Computer Science 2025-07-22 Zhengwei Tao , Jialong Wu , Wenbiao Yin , Junkai Zhang , Baixuan Li , Haiyang Shen , Kuan Li , Liwen Zhang , Xinyu Wang , Yong Jiang , Pengjun Xie , Fei Huang , Jingren Zhou

Charts are very popular to analyze data and convey important insights. People often analyze visualizations to answer open-ended questions that require explanatory answers. Answering such questions are often difficult and time-consuming as…

Machine Learning · Computer Science 2022-10-14 Shankar Kantharaj , Xuan Long Do , Rixie Tiffany Ko Leong , Jia Qing Tan , Enamul Hoque , Shafiq Joty

Document understanding and information extraction include different tasks to understand a document and extract valuable information automatically. Recently, there has been a rising demand for developing document understanding among…

Information Retrieval · Computer Science 2023-08-01 Soyeon Caren Han , Yihao Ding , Siwen Luo , Josiah Poon , HeeGuen Yoon , Zhe Huang , Paul Duuring , Eun Jung Holden