English
Related papers

Related papers: BLUEPRINT Rebuilding a Legacy: Multimodal Retrieva…

200 papers

Domain specific information retrieval process has been a prominent and ongoing research in the field of natural language processing. Many researchers have incorporated different techniques to overcome the technical and domain specificity…

Analog circuit design relies heavily on reusing existing intellectual property (IP), yet searching across heterogeneous representations such as SPICE netlists, schematics, and functional descriptions remains challenging. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yihan Wang , Lei Li , Yao Lai , Jing Wang , Yan Lu

Historical documents represent an invaluable cultural heritage, yet have undergone significant degradation over time through tears, water erosion, and oxidation. Existing Historical Document Restoration (HDR) methods primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yuyi Zhang , Peirong Zhang , Zhenhua Yang , Pengyu Yan , Yongxin Shi , Pengwei Liu , Fengjun Guo , Lianwen Jin

This paper addresses the challenge of building multimodal recommender systems for the movie domain, where sparse item metadata (e.g., title and genres) can limit retrieval quality and downstream recommendations. We introduce RAG-VisualRec,…

Information Retrieval · Computer Science 2026-02-17 Ali Tourani , Fatemeh Nazary , Yashar Deldjoo

With over 200 million published academic documents and millions of new documents being written each year, academic researchers face the challenge of searching for information within this vast corpus. However, existing retrieval systems…

Information Retrieval · Computer Science 2024-05-21 Gengchen Wei , Xinle Pang , Tianning Zhang , Yu Sun , Xun Qian , Chen Lin , Han-Sen Zhong , Wanli Ouyang

Document Reading Order Recovery is a fundamental task in document image understanding, playing a pivotal role in enhancing Retrieval-Augmented Generation (RAG) and serving as a critical preprocessing step for large language models (LLMs).…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Shuai Liu , Youmeng Li , Jizeng Wei

Multi-Label Online Continual Learning (MOCL) requires models to learn continuously from endless multi-label data streams, facing complex challenges including persistent catastrophic forgetting, potential missing labels, and uncontrollable…

Machine Learning · Computer Science 2025-05-27 Xinrui Wang , Shao-yuan Li , Jiaqiang Zhang , Songcan Chen

Retrieval Augmented Generation (RAG) is a promising technique for mitigating two key limitations of large language models (LLMs): outdated information and hallucinations. RAG system stores documents as embedding vectors in a database. Given…

Information Retrieval · Computer Science 2026-02-10 Taehee Jeong , Xingzhe Zhao , Peizu Li , Markus Valvur , Weihua Zhao

We introduce MRMR, the first expert-level multidisciplinary multimodal retrieval benchmark requiring intensive reasoning. MRMR contains 1,502 queries spanning 23 domains, with positive documents carefully verified by human experts. Compared…

Information Retrieval · Computer Science 2026-02-17 Siyue Zhang , Yuan Gao , Xiao Zhou , Yilun Zhao , Tingyu Song , Arman Cohan , Anh Tuan Luu , Chen Zhao

With the advent of large language models (LLMs) and multimodal large language models (MLLMs), the potential of retrieval-augmented generation (RAG) has attracted considerable research attention. Various novel algorithms and models have been…

Computation and Language · Computer Science 2025-02-25 Jiajie Jin , Yutao Zhu , Guanting Dong , Yuyao Zhang , Xinyu Yang , Chenghao Zhang , Tong Zhao , Zhao Yang , Zhicheng Dou , Ji-Rong Wen

The rise of Large Language Models (LLMs) has streamlined frontend interface creation through tools like Vercel's V0, yet surfaced challenges in design quality (e.g., accessibility, and usability). Current solutions, often limited by their…

Software Engineering · Computer Science 2025-04-29 Mingyue Yuan , Jieshan Chen , Zhenchang Xing , Aaron Quigley , Yuyu Luo , Tianqi Luo , Gelareh Mohammadi , Qinghua Lu , Liming Zhu

Multimodal Large Language Models (MLLMs) have shown immense promise in universal multimodal retrieval, which aims to find relevant items of various modalities for a given query. But their practical application is often hindered by the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Qi Li , Yanzhe Zhao , Yongxin Zhou , Yameng Wang , Yandong Yang , Yuanjia Zhou , Jue Wang , Zuojian Wang , Jinxiang Liu

This paper presents Universal Vision-Language Dense Retrieval (UniVL-DR), which builds a unified model for multi-modal retrieval. UniVL-DR encodes queries and multi-modality resources in an embedding space for searching candidates from…

Information Retrieval · Computer Science 2023-02-07 Zhenghao Liu , Chenyan Xiong , Yuanhuiyi Lv , Zhiyuan Liu , Ge Yu

Identifying species in biology among tens of thousands of visually similar taxa while discovering unknown species in open-world environments remains a fundamental challenge in biodiversity research. Current methods treat identification and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jiawei Wang , Ming Lei , Yaning Yang , Xinyan Lin , Yuquan Le , Qiwei Ma , Zhiwei Xu , Zheqi Lv , Yuchen Ang , Zhe Quan , Tat-Seng Chua

Automatic generation of executable Blender code from natural language remains challenging, with state-of-the-art LLMs producing frequent syntactic errors and geometrically inconsistent objects. We present BlenderRAG, a retrieval-augmented…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Massimo Rondelli , Francesco Pivi , Maurizio Gabbrielli

Aircraft Maintenance Technicians (AMTs) spend up to 30% of work time searching manuals, a documented efficiency bottleneck in MRO operations where every procedure must be traceable to certified sources. We present a compliance-preserving…

Computation and Language · Computer Science 2025-11-20 Byungho Jo

Visual document understanding (VDU) has rapidly advanced with the development of powerful multi-modal language models. However, these models typically require extensive document pre-training data to learn intermediate representations and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Souhail Bakkali , Sanket Biswas , Zuheng Ming , Mickaël Coustaty , Marçal Rusiñol , Oriol Ramos Terrades , Josep Lladós

Multimodal document retrieval systems enable information access across text, images, and layouts, benefiting various domains like document-based question answering, report analysis, and interactive content summarization. Rerankers improve…

Artificial Intelligence · Computer Science 2025-06-24 Mingjun Xu , Jinhan Dong , Jue Hou , Zehui Wang , Sihang Li , Zhifeng Gao , Renxin Zhong , Hengxing Cai

Visual retrieval system faces frequent model update and deployment. It is a heavy workload to re-extract features of the whole database every time.Feature compatibility enables the learned new visual features to be directly compared with…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Yan Bai , Jile Jiao , Shengsen Wu , Yihang Lou , Jun Liu , Xuetao Feng , Ling-Yu Duan

Reproducibility is the ability of recreating identical binaries under pre-defined build environments. Due to the need of quality assurance and the benefit of better detecting attacks against build environments, the practice of reproducible…

Software Engineering · Computer Science 2018-03-20 Zhilei Ren , He Jiang , Jifeng Xuan , Zijiang Yang