English
Related papers

Related papers: BLUEPRINT Rebuilding a Legacy: Multimodal Retrieva…

200 papers

RAG-based QA has emerged as a powerful method for processing long industrial documents. However, conventional text chunking approaches often neglect complex and long industrial document structures, causing information loss and reduced…

Artificial Intelligence · Computer Science 2026-04-15 Joongmin Shin , Chanjun Park , Jeongbae Park , Jaehyung Seo , Heuiseok Lim

We consider and propose a new problem of retrieving audio files relevant to multimodal design document inputs comprising both textual elements and visual imagery, e.g., birthday/greeting cards. In addition to enhancing user experience,…

Multimedia · Computer Science 2023-03-01 Prachi Singh , Srikrishna Karanam , Sumit Shekhar

We present Omni-Embed-Nemotron, a unified multimodal retrieval embedding model developed to handle the increasing complexity of real-world information needs. While Retrieval-Augmented Generation (RAG) has significantly advanced language…

Computation and Language · Computer Science 2025-10-07 Mengyao Xu , Wenfei Zhou , Yauhen Babakhin , Gabriel Moreira , Ronay Ak , Radek Osmulski , Bo Liu , Even Oldridge , Benedikt Schifferer

Retrieval-Augmented Generation (RAG) has become a popular technique for enhancing the reliability and utility of Large Language Models (LLMs) by grounding responses in external documents. Traditional RAG systems rely on Optical Character…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Alexander Most , Joseph Winjum , Ayan Biswas , Shawn Jones , Nishath Rajiv Ranasinghe , Dan O'Malley , Manish Bhattarai

With the rapid advancement of multimodal information retrieval, increasingly complex retrieval tasks have emerged. Existing methods predominately rely on task-specific fine-tuning of vision-language models, often those trained with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yikun Liu , Pingan Chen , Jiayin Cai , Xiaolong Jiang , Yao Hu , Jiangchao Yao , Yanfeng Wang , Weidi Xie

Retrieval-augmented generation (RAG) systems have predominantly focused on text-based retrieval, limiting their effectiveness in handling visually-rich documents that encompass text, images, tables, and charts. To bridge this gap, we…

Information Retrieval · Computer Science 2025-05-07 Mingjun Xu , Zehui Wang , Hengxing Cai , Renxin Zhong

Current resources for data literacy education, such as visualization galleries and datasets, provide useful examples but lack mechanisms for learners to query, compare, and navigate the visualization design space efficiently. This position…

Human-Computer Interaction · Computer Science 2026-04-16 Huyen N. Nguyen , Nils Gehlenborg

Recent advances in large language models (LLMs) have demonstrated impressive capabilities in code-related tasks, such as code generation and automated program repair. Despite their promising performance, most existing approaches for code…

Software Engineering · Computer Science 2025-09-03 Yicong Zhao , Shisong Chen , Jiacheng Zhang , Zhixu Li

Documents are visually rich structures that convey information through text, but also figures, page layouts, tables, or even fonts. Since modern retrieval systems mainly rely on the textual information they extract from document pages to…

Information Retrieval · Computer Science 2025-03-03 Manuel Faysse , Hugues Sibille , Tony Wu , Bilel Omrani , Gautier Viaud , Céline Hudelot , Pierre Colombo

Despite their cultural and historical significance, Black digital archives continue to be a structurally underrepresented area in AI research and infrastructure. This is especially evident in efforts to digitize historical Black newspapers,…

Digital Libraries · Computer Science 2025-09-17 Fitsum Sileshi Beyene , Christopher L. Dancy

Large-scale digitization initiatives have unlocked massive collections of historical newspapers, yet effective computational access remains hindered by OCR corruption, multilingual orthographic variation, and temporal language drift. We…

Digital Libraries · Computer Science 2025-12-16 Anthony Mudet , Souhail Bakkali

In long, multi-page industrial documents, retrieval-augmented generation (RAG) depends heavily on whether chunk boundaries follow the document's true structure. Existing text-centric chunkers and generative hierarchy parsers often miss…

Information Retrieval · Computer Science 2026-05-20 Joongmin Shin , Jeongbae Park , Jaehyung Seo , Heuiseok Lim

Engineering drawings are fundamental to manufacturing communication, serving as the primary medium for conveying design intent, tolerances, and production details. However, interpreting complex multi-view drawings with dense annotations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Muhammad Tayyab Khan , Zane Yong , Lequn Chen , Wenhe Feng , Nicholas Yew Jin Tan , Seung Ki Moon

Searching for similar logos in the registered logo database is a very important and tedious task at the trademark office. Speed and accuracy are two aspects that one must attend to while developing a system for retrieval of logos. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Ushasi Chaudhuri , Partha Bhowmick , Jayanta Mukhopadhyay

Implementing new features across an entire codebase presents a formidable challenge for Large Language Models (LLMs). This proactive task requires a deep understanding of the global system architecture to prevent unintended disruptions to…

Software Engineering · Computer Science 2026-03-03 Mingwei Liu , Zhenxi Chen , Zheng Pei , Zihao Wang , Yanlin Wang , Zibin Zheng

In this paper, we introduce Technical-Embeddings, a novel framework designed to optimize semantic retrieval in technical documentation, with applications in both hardware and software development. Our approach addresses the challenges of…

Information Retrieval · Computer Science 2025-09-05 Songjiang Lai , Tsun-Hin Cheung , Ka-Chun Fung , Kaiwen Xue , Kwan-Ho Lin , Yan-Ming Choi , Vincent Ng , Kin-Man Lam

Document retrieval is an important task for search and Retrieval-Augmented Generation (RAG) applications. Large Language Models (LLMs) have contributed to improving the accuracy of text-based document retrieval. However, documents with…

Information Retrieval · Computer Science 2025-05-22 Radek Osmulski , Gabriel de Souza P. Moreira , Ronay Ak , Mengyao Xu , Benedikt Schifferer , Even Oldridge

Measuring advances in retrieval requires test collections with relevance judgments that can faithfully distinguish systems. This paper presents NeuCLIRTech, an evaluation collection for cross-language retrieval over technical information.…

Information Retrieval · Computer Science 2026-02-06 Dawn Lawrie , James Mayfield , Eugene Yang , Andrew Yates , Sean MacAvaney , Ronak Pradeep , Scott Miller , Paul McNamee , Luca Soldaini

Multi-modal retrieval has seen tremendous progress with the development of vision-language models. However, further improving these models require additional labelled data which is a huge manual effort. In this paper, we propose a framework…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Avinash Madasu , Estelle Aflalo , Gabriela Ben Melech Stan , Shachar Rosenman , Shao-Yen Tseng , Gedas Bertasius , Vasudev Lal

Designing high-performance neural networks for new tasks requires balancing optimization quality with search efficiency. Current methods fail to achieve this balance: neural architectural search is computationally expensive, while model…

Machine Learning · Computer Science 2026-02-13 Jialiang Wang , Hanmo Liu , Shimin Di , Zhili Wang , Jiachuan Wang , Lei Chen , Xiaofang Zhou