English
Related papers

Related papers: Finder: A Multimodal AI-Powered Search Framework f…

200 papers

Over 1,200 AI-enabled medical devices have received marketing authorization from the U.S. FDA, yet identifying devices suited to specific clinical needs remains challenging because the FDA's databases contain only limited metadata and…

Information Retrieval · Computer Science 2026-02-03 Arun Kavishwar , William Lotter

Audio-text retrieval is a challenging task, requiring the search for an audio clip or a text caption within a database. The predominant focus of existing research on English descriptions poses a limitation on the applicability of such…

Sound · Computer Science 2024-06-18 Zhiyong Yan , Heinrich Dinkel , Yongqing Wang , Jizhong Liu , Junbo Zhang , Yujun Wang , Bin Wang

Multimodal encoders have pushed the boundaries of visual document retrieval, matching textual query tokens directly to image patches and achieving state-of-the-art performance on public benchmarks. Recent models relying on this paradigm…

Computation and Language · Computer Science 2026-04-08 Omri Uzan , Asaf Yehudai , Roi pony , Eyal Shnarch , Ariel Gera

Code search, framed as information retrieval (IR), underpins modern software engineering and increasingly powers retrieval-augmented generation (RAG), improving code discovery, reuse, and the reliability of LLM-based coding. Yet existing…

Software Engineering · Computer Science 2026-04-20 Jiahui Geng , Qing Li , Fengyu Cai , Fakhri Karray

Traditional retrieval methods have been essential for assessing document similarity but struggle with capturing semantic nuances. Despite advancements in latent semantic analysis (LSA) and deep learning, achieving comprehensive semantic…

Information Retrieval · Computer Science 2024-09-27 Solmaz Seyed Monir , Irene Lau , Shubing Yang , Dongfang Zhao

User-generated content platforms curate their vast repositories into thematic compilations that facilitate the discovery of high-quality material. Platforms that seek tight editorial control employ people to do this curation, but this…

Human-Computer Interaction · Computer Science 2020-08-13 Yan Chen , Andrés Monroy-Hernández , Ian Wehrman , Steve Oney , Walter S. Lasecki , Rajan Vaish

Text-Video Retrieval (TVR) methods typically match query-candidate pairs by aligning text and video features in coarse-grained, fine-grained, or combined (coarse-to-fine) manners. However, these frameworks predominantly employ a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Bingqing Zhang , Zhuo Cao , Heming Du , Xin Yu , Xue Li , Jiajun Liu , Sen Wang

Information retrieval lies at the foundation of the modern digital industry. While natural language search has seen dramatic progress in recent years largely driven by embedding-based models and large-scale pretraining, the field still…

Artificial Intelligence · Computer Science 2026-02-20 Adrià Molina , Oriol Ramos Terrades , Josep Lladós

Fusion-in-Decoder (FiD) is an effective retrieval-augmented language model applied across a variety of open-domain tasks, such as question answering, fact checking, etc. In FiD, supporting passages are first retrieved and then processed…

Computation and Language · Computer Science 2023-11-07 Moshe Berchansky , Peter Izsak , Avi Caciularu , Ido Dagan , Moshe Wasserblat

Visual Document Retrieval (VDR), the task of retrieving visually-rich document pages using queries that combine visual and textual cues, is crucial for numerous real-world applications. Recent state-of-the-art methods leverage Large…

Computation and Language · Computer Science 2025-09-30 Yibo Yan , Guangwei Xu , Xin Zou , Shuliang Liu , James Kwok , Xuming Hu

Multimodal vector search offers a new paradigm for information retrieval by exposing numerous pieces of functionality which are not possible in traditional lexical search engines. While multimodal vector search can be treated as a drop in…

Information Retrieval · Computer Science 2024-09-19 Owen Pendrigh Elliott , Tom Hamer , Jesse Clark

This study presents a novel framework for smart search in digital archival systems, leveraging the capabilities of Large Language Models (LLMs) to enhance information retrieval. By employing a Retrieval-Augmented Generation (RAG) approach,…

Artificial Intelligence · Computer Science 2025-01-14 Ha Dung Nguyen , Thi-Hoang Anh Nguyen , Thanh Binh Nguyen

Most organizational data in this world are stored as documents, and visual retrieval plays a crucial role in unlocking the collective intelligence from all these documents. However, existing benchmarks focus on English-only document…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jian Chen , Ming Li , Jihyung Kil , Chenguang Wang , Tong Yu , Ryan Rossi , Tianyi Zhou , Changyou Chen , Ruiyi Zhang

Current text-video retrieval methods mainly rely on cross-modal matching between queries and videos to calculate their similarity scores, which are then sorted to obtain retrieval results. This method considers the matching between each…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yili Li , Jing Yu , Keke Gai , Bang Liu , Gang Xiong , Qi Wu

Audio-text retrieval enables semantic alignment between audio content and natural language queries, supporting applications in multimedia search, accessibility, and surveillance. However, current state-of-the-art approaches struggle with…

Computation and Language · Computer Science 2026-04-28 Meizhu Liu , Matthew Rowe , Amit Agarwal , Michael Avendi , Yassi Abbasi , Hitesh Laxmichand Patel , Paul Li , Kyu J. Han , Tao Sheng , Sujith Ravi , Dan Roth

As Vision-Language Models (VLMs) increasingly gain traction in medical applications, clinicians are progressively expecting AI systems not only to generate textual diagnoses but also to produce corresponding medical images that integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Junjie Yang , Yuhao Yan , Gang Wu , Yuxuan Wang , Ruoyu Liang , Xinjie Jiang , Xiang Wan , Fenglei Fan , Yongquan Zhang , Feiwei Qin , Changmiao Wang

With over 200 million published academic documents and millions of new documents being written each year, academic researchers face the challenge of searching for information within this vast corpus. However, existing retrieval systems…

Information Retrieval · Computer Science 2024-05-21 Gengchen Wei , Xinle Pang , Tianning Zhang , Yu Sun , Xun Qian , Chen Lin , Han-Sen Zhong , Wanli Ouyang

Existing information retrieval systems are largely constrained by their reliance on vector inner products to assess query-document relevance, which naturally limits the expressiveness of the relevance score they can produce. We propose a…

Information Retrieval · Computer Science 2025-05-02 Julian Killingback , Hansi Zeng , Hamed Zamani

Older adults commonly experience chronic conditions such as pain and sleep disturbances and may consider cannabidiol for symptom management. Safe use requires appropriate dosing, careful titration, and awareness of drug interactions, yet…

Information Retrieval · Computer Science 2026-04-14 Ali Abedi , Charlene H. Chu , Shehroz S. Khan

This paper introduces Seeker, a system that allows users to interactively refine search rankings in real time, through feedback in the form of likes and dislikes. When searching online, users may not know how to accurately describe their…

Information Retrieval · Computer Science 2020-06-09 Ari Biswas , Thai T Pham , Michael Vogelsong , Benjamin Snyder , Houssam Nassif