English
Related papers

Related papers: AnalogRetriever: Learning Cross-Modal Representati…

200 papers

Semantic retrieval, which retrieves semantically matched items given a textual query, has been an essential component to enhance system effectiveness in e-commerce search. In this paper, we study the multimodal retrieval problem, where the…

Information Retrieval · Computer Science 2025-06-26 Zhigong Zhou , Ning Ding , Xiaochuan Fan , Yue Shang , Yiming Qiu , Jingwei Zhuo , Zhiwei Ge , Songlin Wang , Lin Liu , Sulong Xu , Han Zhang

Measuring advances in retrieval requires test collections with relevance judgments that can faithfully distinguish systems. This paper presents NeuCLIRTech, an evaluation collection for cross-language retrieval over technical information.…

Information Retrieval · Computer Science 2026-02-06 Dawn Lawrie , James Mayfield , Eugene Yang , Andrew Yates , Sean MacAvaney , Ronak Pradeep , Scott Miller , Paul McNamee , Luca Soldaini

Music retrieval and recommendation applications often rely on content features encoded as embeddings, which provide vector representations of items in a music dataset. Numerous complementary embeddings can be derived from processing items…

Information Retrieval · Computer Science 2023-08-15 Andres Ferraro , Jaehun Kim , Sergio Oramas , Andreas Ehmann , Fabien Gouyon

Pre-training on large scale unlabelled datasets has shown impressive performance improvements in the fields of computer vision and natural language processing. Given the advent of large-scale instructional video datasets, a common strategy…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Valentin Gabeur , Arsha Nagrani , Chen Sun , Karteek Alahari , Cordelia Schmid

Effective image retrieval with text feedback stands to impact a range of real-world applications, such as e-commerce. Given a source image and text feedback that describes the desired modifications to that image, the goal is to retrieve the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Yuxin Tian , Shawn Newsam , Kofi Boakye

The rise of multi-modal search requests from users has highlighted the importance of multi-modal retrieval (i.e. image-to-text or text-to-image retrieval), yet the more complex task of image-to-multi-modal retrieval, crucial for many…

Information Retrieval · Computer Science 2024-06-11 Zida Cheng , Chen Ju , Shuai Xiao , Xu Chen , Zhonghua Zhai , Xiaoyi Zeng , Weilin Huang , Junchi Yan

Dual encoders and cross encoders have been widely used for image-text retrieval. Between the two, the dual encoder encodes the image and text independently followed by a dot product, while the cross encoder jointly feeds image and text as…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Jie Lei , Xinlei Chen , Ning Zhang , Mengjiao Wang , Mohit Bansal , Tamara L. Berg , Licheng Yu

In recent years, cross-modal retrieval has drawn much attention due to the rapid growth of multimodal data. It takes one type of data as the query to retrieve relevant data of another type. For example, a user can use a text to retrieve…

Multimedia · Computer Science 2016-07-22 Kaiye Wang , Qiyue Yin , Wei Wang , Shu Wu , Liang Wang

The rapid growth of Retrieval-Augmented Generation (RAG) has created a proliferation of toolkits, yet a fundamental gap remains between experimental prototypes and robust, production-ready systems. We present SearchGym, a modular…

Information Retrieval · Computer Science 2026-03-06 Jerome Tze-Hou Hsu

Existing prompt-optimization techniques rely on local signals to update behavior, often neglecting broader and recurring patterns across tasks, leading to poor generalization; they further rely on full-prompt rewrites or unstructured…

Software Engineering · Computer Science 2026-03-24 Balaji Dinesh Gangireddi , Aniketh Garikaparthi , Manasi Patwardhan , Arman Cohan

Composed Image Retrieval (CIR) is a multimodal retrieval task where a query consists of a reference image and a textual modification, and the goal is to retrieve a target image satisfying both. In principle, strong performance on CIR…

Both image-caption pairs and translation pairs provide the means to learn deep representations of and connections between languages. We use both types of pairs in MURAL (MUltimodal, MUltitask Representations Across Languages), a dual…

Information Retrieval · Computer Science 2021-09-14 Aashi Jain , Mandy Guo , Krishna Srinivasan , Ting Chen , Sneha Kudugunta , Chao Jia , Yinfei Yang , Jason Baldridge

Analog and mixed-signal circuit design remains challenging due to the shortage of high-quality data and the difficulty of embedding domain knowledge into automated flows. Traditional black-box optimization achieves sampling efficiency but…

Machine Learning · Computer Science 2025-09-18 Ziming Wei , Zichen Kong , Yuan Wang , David Z. Pan , Xiyuan Tang

In AI-facilitated teaching, leveraging various query styles to interpret abstract educational content is crucial for delivering effective and accessible learning experiences. However, existing retrieval systems predominantly focus on…

Artificial Intelligence · Computer Science 2025-07-08 Xinyi Wu , Yanhao Jia , Luwei Xiao , Shuai Zhao , Fengkuang Chiang , Erik Cambria

Ranking consistently emerges as a primary focus in information retrieval research. Retrieval and ranking models serve as the foundation for numerous applications, including web search, open domain QA, enterprise domain QA, and text-based…

Information Retrieval · Computer Science 2024-12-16 Hansa Meghwani

Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the…

Computation and Language · Computer Science 2024-11-13 Alexandria Leto , Cecilia Aguerrebere , Ishwar Bhati , Ted Willke , Mariano Tepper , Vy Ai Vo

Retrieval is a widely adopted approach for improving language models leveraging external information. As the field moves towards multi-modal large language models, it is important to extend the pure text based methods to incorporate other…

Computation and Language · Computer Science 2024-06-17 Jari Kolehmainen , Aditya Gourav , Prashanth Gurunath Shivakumar , Yile Gu , Ankur Gandhe , Ariya Rastrow , Grant Strimel , Ivan Bulyko

Large language models (LLMs) commonly struggle with specialized or emerging topics which are rarely seen in the training corpus. Graph-based retrieval-augmented generation (GraphRAG) addresses this by structuring domain knowledge as a graph…

Information Retrieval · Computer Science 2025-06-05 Zhefan Wang , Huanjun Kong , Jie Ying , Wanli Ouyang , Nanqing Dong

We propose a machine learning-driven optimisation framework for analog circuit design in this paper. The primary objective is to determine the device sizes for the optimal performance of analog circuits for a given set of specifications.…

Neural and Evolutionary Computing · Computer Science 2024-12-16 Ria Rashid , Komala Krishna , Clint Pazhayidam George , Nandakumar Nambath

The 3rd Generation Partnership Project (3GPP) produces complex technical specifications essential to global telecommunications, yet their hierarchical structure, dense formatting, and multi-modal content make them difficult to process.…

Machine Learning · Computer Science 2026-01-27 Rahul Ghosh , Chun-Hao Liu , Gaurav Rele , Vidya Sagar Ravipati , Hazar Aouad