中文
相关论文

相关论文: ARIAL: An Agentic Framework for Document VQA with …

200 篇论文

Knowledge-based conversational question answering (KBCQA) confronts persistent challenges in resolving coreference, modeling contextual dependencies, and executing complex logical reasoning. Existing approaches often suffer from…

计算与语言 · 计算机科学 2026-05-27 Hao Wang , Jialun Zhong , Changcheng Wang , Zhujun Nie , Zheng Li , Shunyu Yao , Yanzeng Li , Xinchi Li

Accurate auto-formalization of theorem statements is essential for advancing automated discovery and verification of research-level mathematics, yet remains a major bottleneck for LLMs due to hallucinations, semantic mismatches, and their…

人工智能 · 计算机科学 2025-10-07 Hanyu Wang , Ruohan Xie , Yutong Wang , Guoxiong Gao , Xintao Yu , Bin Dong

We present a Collaborative Agent-Based Framework for Multi-Image Reasoning. Our approach tackles the challenge of interleaved multimodal reasoning across diverse datasets and task formats by employing a dual-agent system: a language-based…

The dominant paradigm of monolithic scaling in Vision-Language Models (VLMs) is failing for understanding and reasoning in documents, yielding diminishing returns as it struggles with the inherent need of this domain for document-based…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Xinlei Yu , Chengming Xu , Zhangquan Chen , Yudong Zhang , Shilin Lu , Cheng Yang , Jiangning Zhang , Shuicheng Yan , Xiaobin Hu

Automated content-aware layout generation -- the task of arranging visual elements such as text, logos, and underlays on a background canvas -- remains a fundamental yet under-explored problem in intelligent design systems. While recent…

We propose DocVXQA, a novel framework for visually self-explainable document question answering. The framework is designed not only to produce accurate answers to questions but also to learn visual heatmaps that highlight contextually…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Mohamed Ali Souibgui , Changkyu Choi , Andrey Barsky , Kangsoo Jung , Ernest Valveny , Dimosthenis Karatzas

Image captioning is a critical task at the intersection of computer vision and natural language processing, with wide-ranging applications across various domains. For complex tasks such as diagnostic report generation, deep learning models…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Pu Yang , Bin Dong

Existing multimodal document question-answering (QA) systems predominantly rely on flat semantic retrieval, representing documents as a set of disconnected text chunks and largely neglecting their intrinsic hierarchical and relational…

信息检索 · 计算机科学 2026-01-28 ShunLiang Fu , Yanxin Zhang , Yixin Xiang , Xiaoyu Du , Jinhui Tang

AI systems' ability to explain their reasoning is critical to their utility and trustworthiness. Deep neural networks have enabled significant progress on many challenging problems such as visual question answering (VQA). However, most of…

计算与语言 · 计算机科学 2019-06-05 Jialin Wu , Raymond J. Mooney

Document Visual Question Answering (DocVQA) requires vision-language models to reason not only about what information in a document is relevant to a question, but also where the answer is grounded on the page. Existing DocVQA models…

机器学习 · 计算机科学 2026-05-08 Kjetil Indrehus , Adrian Duric , Changkyu Choi , Ali Ramezani-Kebrya

Traditional augmented reality (AR) systems predominantly rely on fixed class detectors or fiducial markers, limiting their ability to interpret complex, open-vocabulary natural language queries. We present a modular AR agent system that…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Lixing Guo , Tobias Höllerer

Legal reasoning requires both precise interpretation of statutory language and consistent application of complex rules, presenting significant challenges for AI systems. This paper introduces a modular multi-agent framework that decomposes…

人工智能 · 计算机科学 2025-11-11 Albert Sadowski , Jarosław A. Chudziak

Recent advancements in Video Question Answering (VideoQA) have introduced LLM-based agents, modular frameworks, and procedural solutions, yielding promising results. These systems use dynamic agents and memory-based mechanisms to break down…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Tony Montes , Fernando Lozano

Large-scale generative language and vision-language models (LLMs and VLMs) excel in few-shot learning but require high-quality demonstrations. We propose In-Context Abstraction Learning (ICAL), enabling VLM agents to transform suboptimal…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Gabriel Sarch , Lawrence Jang , Michael J. Tarr , William W. Cohen , Kenneth Marino , Katerina Fragkiadaki

Recent progress has been made in region-aware vision-language modeling, particularly with the emergence of the Describe Anything Model (DAM). DAM is capable of generating detailed descriptions of any specific image areas or objects without…

Multimodal Large Language Models (MLLMs) excel at descriptive tasks within images but often struggle with precise object localization, a critical element for reliable visual interpretation. In contrast, traditional object detection models…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Jingru Yang , Huan Yu , Yang Jingxin , Chentianye Xu , Yin Biao , Yu Sun , Shengfeng He

Recent advancements in reasoning optimization have greatly enhanced the performance of large language models (LLMs). However, existing work fails to address the complexities of audio-visual scenarios, underscoring the need for further…

音频与语音处理 · 电气工程与系统科学 2025-04-01 Sanjoy Chowdhury , Hanan Gani , Nishit Anand , Sayan Nag , Ruohan Gao , Mohamed Elhoseiny , Salman Khan , Dinesh Manocha

Translating natural language into Jira Query Language (JQL) requires resolving ambiguous field references, instance-specific categorical values, and complex Boolean predicates. Single-pass LLMs cannot discover which categorical values…

计算与语言 · 计算机科学 2026-04-13 Vishnu Murali , Anmol Gulati , Elias Lumer , Kevin Frank , Sindy Campagna , Vamse Kumar Subbiah

There are two main lines of research on visual question answering (VQA): compositional model with explicit multi-hop reasoning, and monolithic network with implicit reasoning in the latent feature space. The former excels in…

计算机视觉与模式识别 · 计算机科学 2020-10-13 Ruixue Tang , Chao Ma

Visual Question Answering (VQA) is increasingly used in diverse applications ranging from general visual reasoning to safety-critical domains such as medical imaging and autonomous systems, where models must provide not only accurate…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Xingjian Diao , Weiyi Wu , Keyi Kong , Peijun Qing , Xinwen Xu , Ming Cheng , Soroush Vosoughi , Jiang Gui