English
Related papers

Related papers: Multimodal DeepResearcher: Generating Text-Chart I…

200 papers

The increasing diversity and scale of video data demand retrieval systems capable of multimodal understanding, adaptive reasoning, and domain-specific knowledge integration. This paper presents LLandMark, a modular multi-agent framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Minh-Chi Phung , Thien-Bao Le , Cam-Tu Tran-Thi , Thu-Dieu Nguyen-Thi , Vu-Hung Dao

Understanding information from visually rich documents remains a significant challenge for traditional Retrieval-Augmented Generation (RAG) methods. Existing benchmarks predominantly focus on image-based question answering (QA), overlooking…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Qiuchen Wang , Ruixue Ding , Zehui Chen , Weiqi Wu , Shihang Wang , Pengjun Xie , Feng Zhao

Retrieval-augmented generation (RAG) is a paradigm that augments large language models (LLMs) with external knowledge to tackle knowledge-intensive question answering. While several benchmarks evaluate Multimodal LLMs (MLLMs) under…

Computation and Language · Computer Science 2025-08-18 Yin Wu , Quanyu Long , Jing Li , Jianfei Yu , Wenya Wang

Despite recent progress in multimodal large language models (MLLMs), reliable visual question answering in aerial scenes remains challenging. In such scenes, task-critical evidence is often carried by small objects, explicit quantities,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Junxiao Xue , Quan Deng , Tingqi Hu , Meicong Si , Xinyi Yin , Yunyun Shi , Xuecheng Wu

Recent advances in large language models (LLMs) have given rise to powerful coding agents, making it possible for code assistants to evolve into code engineers. However, existing methods still face significant challenges in achieving…

Software Engineering · Computer Science 2025-12-10 Zongwei Li , Zhonghang Li , Zirui Guo , Xubin Ren , Chao Huang

With the rapid advancement of tool-use capabilities in Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) is shifting from static, one-shot retrieval toward autonomous, multi-turn evidence acquisition. However, existing…

Artificial Intelligence · Computer Science 2026-02-13 Zhanli Li , Huiwen Tian , Lvzhou Luo , Yixuan Cao , Ping Luo

Multimodal Retrieval-Augmented Generation (MRAG) enhances reasoning capabilities by integrating external knowledge. However, existing benchmarks primarily focus on simple image-text interactions, overlooking complex visual formats like…

Artificial Intelligence · Computer Science 2025-02-21 Yuming Yang , Jiang Zhong , Li Jin , Jingwang Huang , Jingpeng Gao , Qing Liu , Yang Bai , Jingyuan Zhang , Rui Jiang , Kaiwen Wei

Unified multimodal understanding and generation have recently received much attention in the area of vision and language. Existing UniMs are designed to simultaneously learn both multimodal understanding and generation capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Jianwen Sun , Yukang Feng , Chuanhao Li , Fanrui Zhang , Zizhen Li , Jiaxin Ai , Sizhuo Zhou , Yu Dai , Shenglin Zhang , Kaipeng Zhang

This research introduces a transformative framework for integrating Vision-Enhanced Large Language Models (LLMs) with advanced transformer-based architectures to tackle challenges in high-resolution image synthesis and multimodal data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Karthikeya KV

In real-world multimodal applications, systems usually need to comprehend arbitrarily combined and interleaved multimodal inputs from users, while also generating outputs in any interleaved multimedia form. This capability defines the goal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Yanlin Li , Minghui Guo , Kaiwen Zhang , Shize Zhang , Yiran Zhao , Haodong Li , Congyue Zhou , Weijie Zheng , Yushen Yan , Shengqiong Wu , Wei Ji , Lei Cui , Furu Wei , Hao Fei , Mong-Li Lee , Wynne Hsu

Lately, researchers in artificial intelligence have been really interested in how language and vision come together, giving rise to the development of multimodal models that aim to seamlessly integrate textual and visual information.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Rajat Chawla , Arkajit Datta , Tushar Verma , Adarsh Jha , Anmol Gautam , Ayush Vatsal , Sukrit Chaterjee , Mukunda NS , Ishaan Bhola

Recent advances in Retrieval-Augmented Generation (RAG) have significantly improved response accuracy and relevance by incorporating external knowledge into Large Language Models (LLMs). However, existing RAG methods primarily focus on…

Machine Learning · Computer Science 2025-04-22 Qinhan Yu , Zhiyou Xiao , Binghui Li , Zhengren Wang , Chong Chen , Wentao Zhang

The powerful reasoning of modern Vision Language Models open a new frontier for advanced personalization study. However, progress in this area is critically hampered by the lack of suitable benchmarks. To address this gap, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xia Hu , Honglei Zhuang , Brian Potetz , Alireza Fathi , Bo Hu , Babak Samari , Howard Zhou

Large Vision-Language Models (LVLMs) show significant strides in general-purpose multimodal applications such as visual dialogue and embodied navigation. However, existing multimodal evaluation benchmarks cover a limited number of…

Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data. Retrieval-Augmented Generation (RAG) mitigates these issues by integrating external dynamic information for…

This paper presents a groundbreaking multimodal, multi-task, multi-teacher joint-grained knowledge distillation model for visually-rich form document understanding. The model is designed to leverage insights from both fine-grained and…

Computation and Language · Computer Science 2024-07-29 Yihao Ding , Lorenzo Vaiani , Caren Han , Jean Lee , Paolo Garza , Josiah Poon , Luca Cagliero

Web-scale visual entity recognition, the task of associating images with their corresponding entities within vast knowledge bases like Wikipedia, presents significant challenges due to the lack of clean, large-scale training data. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Mathilde Caron , Alireza Fathi , Cordelia Schmid , Ahmet Iscen

Recent methods for customizing Large Vision Language Models (LVLMs) for domain-specific tasks have shown promising results in scientific chart comprehension. However, existing approaches face two major limitations: First, they rely on…

Computation and Language · Computer Science 2025-07-22 Wan-Cyuan Fan , Yen-Chun Chen , Mengchen Liu , Alexander Jacobson , Lu Yuan , Leonid Sigal

Generating diverse, readable statistical charts from tabular data remains challenging for LLMs, as many failures become apparent after rendering and are not detectable from data or code alone. Existing chart datasets also rarely provide…

Machine Learning · Computer Science 2026-05-04 Pavlin G. Poličar , Andraž Pevcin , Blaž Zupan

With the advancement of multimodal large language models (MLLMs) and coding agents, the website development has shifted from manual programming to agent-based project-level code synthesis. Existing benchmarks rely on idealized assumptions,…

Artificial Intelligence · Computer Science 2026-05-01 Qiyao Wang , Haoran Hu , Longze Chen , Hongbo Wang , Hamid Alinejad-Rokny , Yuan Lin , Min Yang
‹ Prev 1 8 9 10 Next ›