English
Related papers

Related papers: ARIAL: An Agentic Framework for Document VQA with …

200 papers

Despite recent progress in multimodal large language models (MLLMs), reliable visual question answering in aerial scenes remains challenging. In such scenes, task-critical evidence is often carried by small objects, explicit quantities,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Junxiao Xue , Quan Deng , Tingqi Hu , Meicong Si , Xinyi Yin , Yunyun Shi , Xuecheng Wu

Document Visual Question Answering (Document VQA) must cope with documents that span dozens of pages, yet leading systems still concatenate every page or rely on very large vision-language models, both of which are memory-hungry.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Eric López , Artemis Llabrés , Ernest Valveny

Answering Questions over Knowledge Graphs (KGQA) is key to well-functioning autonomous language agents in various real-life applications. To improve the neural-symbolic reasoning capabilities of language agents powered by Large Language…

Computation and Language · Computer Science 2024-06-12 Haishuo Fang , Xiaodan Zhu , Iryna Gurevych

Retrieval-based multimodal document QA aims to identify and integrate relevant information from visually rich documents with complex multimodal structures. While retrieval-augmented generation (RAG) has shown strong performance in…

Information Retrieval · Computer Science 2026-04-21 Hui Wu , Haoquan Zhai , Yuchen Li , Hengyi Cai , Peirong Zhang , Yidan Zhang , Lei Wang , Chunle Wang , Yingyan Hou , Shuaiqiang Wang , Dawei Yin

Text-based Visual Question Answering~(TextVQA) aims to produce correct answers for given questions about the images with multiple scene texts. In most cases, the texts naturally attach to the surface of the objects. Therefore, spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Hao Li , Jinfa Huang , Peng Jin , Guoli Song , Qi Wu , Jie Chen

With the increasing prevalence of video content, effectively understanding and answering questions about long form videos has become essential for numerous applications. Although large vision language models (LVLMs) have enhanced…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Urjitkumar Patel , Fang-Chun Yeh , Chinmay Gondhalekar

Radiology visual question answering (RVQA) provides precise answers to questions about chest X-ray images, alleviating radiologists' workload. While recent methods based on multimodal large language models (MLLMs) and retrieval-augmented…

Artificial Intelligence · Computer Science 2025-08-06 Ziruo Yi , Jinyu Liu , Ting Xiao , Mark V. Albert

Real-world visual question answering (VQA) is often context-dependent: an image-question pair may be under-specified, such that the correct answer depends on external information that is not observable in the image. In such cases, directly…

Computation and Language · Computer Science 2026-01-26 Zongwan Cao , Bingbing Wen , Lucy Lu Wang

Retrieval-Augmented Generation (RAG) utilizes external knowledge to augment Large Language Models' (LLMs) reliability. For flexibility, agentic RAG employs autonomous, multi-round retrieval and reasoning to resolve queries. Although recent…

Information Retrieval · Computer Science 2025-11-10 Chao Zhang , Yuhao Wang , Derong Xu , Haoxin Zhang , Yuanjie Lyu , Yuhao Chen , Shuochen Liu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

Document Visual Question Answering (Document VQA) faces significant challenges when processing long documents in low-resource environments due to context limitations and insufficient training data. This paper presents AdaDocVQA, a unified…

Computation and Language · Computer Science 2025-08-20 Haoxuan Li , Wei Song , Aofan Liu , Peiwu Qin

Bridging the semantic gap between image and question is an important step to improve the accuracy of the Visual Question Answering (VQA) task. However, most of the existing VQA methods focus on attention mechanisms or visual relations for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Binh X. Nguyen , Tuong Do , Huy Tran , Erman Tjiputra , Quang D. Tran , Anh Nguyen

Computer Use Agents (CUAs) translate natural-language instructions into Graphical User Interface (GUI) actions such as clicks, keystrokes, and scrolls by relying on a Vision-Language Model (VLM) to interpret screenshots and predict grounded…

Computation and Language · Computer Science 2026-03-16 Xunzhuo Liu , Bowei He , Xue Liu , Andy Luo , Haichen Zhang , Huamin Chen

As the ecosystem of Large Language Model (LLM)-based agents expands rapidly, efficient and accurate Agent Discovery becomes a critical bottleneck for large-scale multi-agent collaboration. Existing approaches typically face a dichotomy:…

Artificial Intelligence · Computer Science 2026-05-07 Jinliang Xu

Visual Question Answering (VQA) is a core task for evaluating the capabilities of Vision-Language Models (VLMs). Existing VQA benchmarks primarily feature clear and unambiguous image-question pairs, whereas real-world scenarios often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jihyoung Jang , Hyounghun Kim

Diagram question answering (DQA) requires models to interpret structured visual representations such as charts, maps, infographics, circuit schematics, and scientific diagrams. Recent vision-language models (VLMs) often achieve high answer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Anirudh Iyengar Kaniyar Narayana Iyengar , Tampu Ravi Kumar , Gaurav Najpande , Manan Suri , Dinesh Manocha , Puneet Mathur , Vivek Gupta

Language agents powered by large language models (LLMs) have demonstrated remarkable capabilities in understanding, reasoning, and executing complex tasks. However, developing robust agents presents significant challenges: substantial…

Computation and Language · Computer Science 2025-06-02 Qianqian Zhang , Jiajia Liao , Heting Ying , Yibo Ma , Haozhan Shen , Jingcheng Li , Peng Liu , Lu Zhang , Chunxin Fang , Kyusong Lee , Ruochen Xu , Tiancheng Zhao

The large language model (LLM) has achieved significant success across various domains. However, the inherent complexity of causal problems and causal theory poses challenges in accurately describing them in natural language, making it…

Artificial Intelligence · Computer Science 2025-10-15 Kairong Han , Kun Kuang , Ziyu Zhao , Junjian Ye , Fei Wu

AI practitioners increasingly use large language model (LLM) agents in compound AI systems to solve complex reasoning tasks, these agent executions often fail to meet human standards, leading to errors that compromise the system's overall…

Artificial Intelligence · Computer Science 2025-03-18 Yoo Yeon Sung , Hannah Kim , Dan Zhang

Analytical reasoning is an essential and challenging task that requires a system to analyze a scenario involving a set of particular circumstances and perform reasoning over it to make conclusions. In this paper, we study the challenge of…

Computation and Language · Computer Science 2021-04-16 Wanjun Zhong , Siyuan Wang , Duyu Tang , Zenan Xu , Daya Guo , Jiahai Wang , Jian Yin , Ming Zhou , Nan Duan

The rapid expansion of scientific data has widened the gap between analytical capability and research intent. Existing AI-based analysis tools, ranging from AutoML frameworks to agentic research assistants, either favor automation over…

Artificial Intelligence · Computer Science 2025-10-14 Chuke Chen , Biao Luo , Nan Li , Boxiang Wang , Hang Yang , Jing Guo , Ming Xu