English
Related papers

Related papers: Pailitao-VL: Unified Embedding and Reranker for Re…

200 papers

Item-to-Item (I2I) retrieval is a fundamental part of modern content platforms, supporting critical industrial workflows from recommendation engines to content auditing. While multimodal embedding methods have advanced general retrieval,…

Information Retrieval · Computer Science 2026-05-29 Jinghan Zhao , Wenwei Jin , Anqi Li , Jintao Tong , Luya Mo , Jiawei Li , Bin Li , Yao Hu

Candidate sourcing for recruiters is best viewed as a two-stage retrieval and reranking pipeline with recall as the primary objective under a limited review budget. An upstream production retriever first returns a candidate shortlist for…

Computation and Language · Computer Science 2026-04-21 Zhaohua Liang , Zhilin Wang , Renjie Cao , Yining Zhang

GUI prototyping is a fundamental component in the development of modern interactive systems, which are now ubiquitous across diverse application domains. GUI prototypes play a critical role in requirements elicitation by enabling…

Software Engineering · Computer Science 2025-08-06 Kristian Kolthoff , Felix Kretzer , Christian Bartelt , Alexander Maedche , Simone Paolo Ponzetto

The success of DeepSeek-R1 demonstrates the immense potential of using reinforcement learning (RL) to enhance LLMs' reasoning capabilities. This paper introduces Retrv-R1, the first R1-style MLLM specifically designed for multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Lanyun Zhu , Deyi Ji , Tianrun Chen , Haiyang Wu , Shiqi Wang

In this report, we introduce the Qwen3-VL-Embedding and Qwen3-VL-Reranker model series, the latest extensions of the Qwen family built on the Qwen3-VL foundation model. Together, they provide an end-to-end pipeline for high-precision…

Computation and Language · Computer Science 2026-01-21 Mingxin Li , Yanzhao Zhang , Dingkun Long , Keqin Chen , Sibo Song , Shuai Bai , Zhibo Yang , Pengjun Xie , An Yang , Dayiheng Liu , Jingren Zhou , Junyang Lin

This paper presents Universal Vision-Language Dense Retrieval (UniVL-DR), which builds a unified model for multi-modal retrieval. UniVL-DR encodes queries and multi-modality resources in an embedding space for searching candidates from…

Information Retrieval · Computer Science 2023-02-07 Zhenghao Liu , Chenyan Xiong , Yuanhuiyi Lv , Zhiyuan Liu , Ge Yu

Multi-modal retrieval becomes increasingly popular in practice. However, the existing retrievers are mostly text-oriented, which lack the capability to process visual information. Despite the presence of vision-language models like CLIP,…

Information Retrieval · Computer Science 2024-06-07 Junjie Zhou , Zheng Liu , Shitao Xiao , Bo Zhao , Yongping Xiong

Multimodal retrieval relies heavily on single-vector retrievers, which compress rich, sequential token sequences into one single global representation. While efficient, they discard fine-grained, local evidence critical for dense retrieval…

Information Retrieval · Computer Science 2026-05-26 Jianrui Zhang , Hyun Jung Lee , Sukanta Ganguly , Tae-Eui Kam , Donghyun Kim , Yong Jae Lee

Dense retrieval, as the core component of e-commerce search engines, maps user queries and items into a unified semantic space through pre-trained embedding models to enable large-scale real-time semantic retrieval. Despite the rapid…

Information Retrieval · Computer Science 2026-02-10 Xingxian Liu , Dongshuai Li , Jiahui Wan , Tao Wen , Gui Ling , Yuliang Yan , Fuyu Lv , Dan Ou , Haihong Tang , Bo Zheng

Video Large Language Models (VideoLLMs) excel at video understanding tasks where outputs are textual, such as Video Question Answering and Video Captioning. However, they underperform specialized embedding-based models in Retrieval tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Rohit Gupta , Jayakrishnan Unnikrishnan , Fan Fei , Sheng Liu , Son Tran , Mubarak Shah

State-of-the-art retrieval models typically address a straightforward search scenario, in which retrieval tasks are fixed (e.g., finding a passage to answer a specific question) and only a single modality is supported for both queries and…

Computation and Language · Computer Science 2025-02-25 Sheng-Chieh Lin , Chankyu Lee , Mohammad Shoeybi , Jimmy Lin , Bryan Catanzaro , Wei Ping

Cross-view geolocalization (CVGL) systems, while effective at retrieving a list of relevant candidates (high Recall@k), often fail to identify the single best match (low Top-1 accuracy). This work investigates the use of zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yunus Talha Erzurumlu , John E. Anderson , William J. Shuart , Charles Toth , Alper Yilmaz

Integrating external tools enables Large Language Models (LLMs) to interact with real-world environments and solve complex tasks. Given the growing scale of available tools, effective tool retrieval is essential to mitigate constraints of…

Information Retrieval · Computer Science 2026-02-06 Yichen Tang , Weihang Su , Yiqun Liu , Qingyao Ai

Multimodal retrieval is the task of aggregating information from queries across heterogeneous modalities to retrieve desired targets. State-of-the-art multimodal retrieval models can understand complex queries, yet they are typically…

Information Retrieval · Computer Science 2026-03-25 Chuong Huynh , Manh Luong , Abhinav Shrivastava

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

Universal multimodal retrieval (UMR), which aims to address complex retrieval tasks where both queries and candidates span diverse modalities, has been significantly advanced by the emergence of MLLMs. While state-of-the-art MLLM-based…

Information Retrieval · Computer Science 2026-02-17 Xiaojie Li , Chu Li , Shi-Zhe Chen , Xi Chen

In the current landscape of artificial intelligence, foundation models serve as the bedrock for advancements in both language and vision domains. OpenAI GPT-4 has emerged as the pinnacle in large language models (LLMs), while the computer…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Chris Kelly , Luhui Hu , Cindy Yang , Yu Tian , Deshun Yang , Bang Yang , Zaoshan Huang , Zihao Li , Yuexian Zou

The exponential growth of video content has created an urgent need for efficient multimodal moment retrieval systems. However, existing approaches face three critical challenges: (1) fixed-weight fusion strategies fail across cross modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Toan Le Ngo Thanh , Phat Ha Huu , Tan Nguyen Dang Duy , Thong Nguyen Le Minh , Anh Nguyen Nhu Tinh

Multimodal embedding models aim to yield informative unified representations that empower diverse cross-modal tasks. Despite promising developments in the evolution from CLIP-based dual-tower architectures to large vision-language models,…

Traditional multimodal retrieval systems rely primarily on bi-encoder architectures, where performance is closely tied to embedding dimensionality. Recent work, Think-Then-Embed (TTE), shows that incorporating multimodal reasoning to elicit…

‹ Prev 1 2 3 10 Next ›