English
Related papers

Related papers: ReasonEmbed: Enhanced Text Embeddings for Reasonin…

200 papers

We propose RT (Refine Thought), a method that can enhance the semantic rea-soning ability of text embedding models. The method obtains the final semanticrepresentation by running multiple forward passes of the text embedding…

Computation and Language · Computer Science 2025-11-19 Guangzhi Wang , Kai Li , Yinghao Jiao , Zhi Liu

In this paper we present APEX-Embedding-7B (Advanced Processing for Epistemic eXtraction), a 7-billion parameter decoder-only text Feature Extraction Model, specifically designed for Document Retrieval-Augmented Generation (RAG) tasks. Our…

Information Retrieval · Computer Science 2024-10-25 Thea Aviss

Large Language Models (LLMs) have shown remarkable capabilities in reasoning, exemplified by the success of OpenAI-o1 and DeepSeek-R1. However, integrating reasoning with external search processes remains challenging, especially for complex…

We introduce MRMR, the first expert-level multidisciplinary multimodal retrieval benchmark requiring intensive reasoning. MRMR contains 1,502 queries spanning 23 domains, with positive documents carefully verified by human experts. Compared…

Information Retrieval · Computer Science 2026-02-17 Siyue Zhang , Yuan Gao , Xiao Zhou , Yilun Zhao , Tingyu Song , Arman Cohan , Anh Tuan Luu , Chen Zhao

LLMs confront inherent limitations in terms of its knowledge, memory, and action. The retrieval augmentation stands as a vital mechanism to address these limitations, which brings in useful information from external sources to augment the…

Information Retrieval · Computer Science 2026-01-06 Peitian Zhang , Shitao Xiao , Zheng Liu , Zhicheng Dou , Jian-Yun Nie

Explaining why dense retrievers assign high relevance scores remains challenging because retrieval decisions are made through opaque high-dimensional embeddings. Existing explanations often focus on surface signals, such as lexical matches,…

Artificial Intelligence · Computer Science 2026-05-29 Zhixin Cai , Jun Bai , Yang Liu , Jiaqi Li , Yichi Zhang , Taichuan Li , Zhuofan Chen , Zixia Jia , Zilong Zheng , Wenge Rong

Visual document retrieval aims to retrieve a set of document pages relevant to a query from visually rich collections. Existing methods often employ Vision-Language Models (VLMs) to encode queries and visual pages into a shared embedding…

Information Retrieval · Computer Science 2026-04-10 Hao Yang , Yifan Ji , Zhipeng Xu , Zhenghao Liu , Yukun Yan , Zulong Chen , Shuo Wang , Yu Gu , Ge Yu

Retrieval-augmented generation (RAG) over long documents typically involves splitting the text into smaller chunks, which serve as the basic units for retrieval. However, due to dependencies across the original document, contextual…

Computation and Language · Computer Science 2026-04-22 Junjie Wu , Jiangnan Li , Yuqing Li , Lemao Liu , Liyan Xu , Jiwei Li , Dit-Yan Yeung , Jie Zhou , Mo Yu

The capability of large language models to handle long-context information is crucial across various real-world applications. Existing evaluation methods often rely either on real-world long texts, making it difficult to exclude the…

Computation and Language · Computer Science 2025-09-18 Mo Li , Songyang Zhang , Taolin Zhang , Haodong Duan , Yunxin Liu , Kai Chen

MLLMs have been successfully applied to multimodal embedding tasks, yet their generative reasoning capabilities remain underutilized. Directly incorporating chain-of-thought reasoning into embedding learning introduces two fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yuchi Wang , Haiyang Yu , Weikang Bian , Jiefeng Long , Xiao Liang , Chao Feng , Hongsheng Li

In this paper, we introduce a novel and simple method for obtaining high-quality text embeddings using only synthetic data and less than 1k training steps. Unlike existing methods that often depend on multi-stage intermediate pre-training…

Computation and Language · Computer Science 2024-06-03 Liang Wang , Nan Yang , Xiaolong Huang , Linjun Yang , Rangan Majumder , Furu Wei

Multimodal embeddings are widely used in downstream tasks such as multimodal retrieval, enabling alignment of interleaved modalities in a shared representation space. While recent studies show that Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Chunxu Liu , Jiyuan Yang , Ruopeng Gao , Yuhan Zhu , Feng Zhu , Rui Zhao , Limin Wang

In this work, we introduce the Qwen3 Embedding series, a significant advancement over its predecessor, the GTE-Qwen series, in text embedding and reranking capabilities, built upon the Qwen3 foundation models. Leveraging the Qwen3 LLMs'…

Computation and Language · Computer Science 2025-06-12 Yanzhao Zhang , Mingxin Li , Dingkun Long , Xin Zhang , Huan Lin , Baosong Yang , Pengjun Xie , An Yang , Dayiheng Liu , Junyang Lin , Fei Huang , Jingren Zhou

Prompt-driven scene synthesis allows users to generate complete 3D environments from textual descriptions. Current text-to-scene methods often struggle with complex geometries and object transformations, and tend to show weak adherence to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Frédéric Berdoz , Luca A. Lanzendörfer , Nick Tuninga , Roger Wattenhofer

Retrieval-augmented generation has achieved strong performance on knowledge-intensive tasks where query-document relevance can be identified through direct lexical or semantic matches. However, many real-world queries involve abstract…

Information Retrieval · Computer Science 2026-04-03 Duolin Sun , Meixiu Long , Dan Yang , Junjie Wang , Yecheng Luo , Yue Shen , Jian Wang , Hualei Zhou , Chunxiao Guo , Peng Wei , Jiahai Wang , Jinjie Gu

Recent advancements in Large Language Models (LLMs) have revealed a significant performance gap between closed-source and open-source models, particularly in tasks requiring complex reasoning and precise instruction following. This paper…

Artificial Intelligence · Computer Science 2025-07-01 Ziqi Zhong , Xunzhu Tang

Reasoning-intensive retrieval aims to surface evidence that supports downstream reasoning rather than merely matching topical similarity. This capability is increasingly important for agentic search systems, where retrievers must provide…

Computation and Language · Computer Science 2026-05-06 Yilun Zhao , Jinbiao Wei , Tingyu Song , Siyue Zhang , Chen Zhao , Arman Cohan

In mathematical reasoning tasks, the advancement of Large Language Models (LLMs) relies heavily on high-quality training data with clearly defined and well-graded difficulty levels. However, existing data synthesis methods often suffer from…

Machine Learning · Computer Science 2026-01-27 Xuchen Li , Jing Chen , Xuzhao Li , Hao Liang , Xiaohuan Zhou , Taifeng Wang , Wentao Zhang

Existing retrieval benchmarks primarily consist of information-seeking queries (e.g., aggregated questions from search engines) where keyword or semantic-based retrieval is usually sufficient. However, many complex real-world queries…

This technical report presents the training methodology and evaluation results of the open-source dewey_en_beta embedding model. The increasing demand for retrieval-augmented generation (RAG) systems and the expanding context window…

Information Retrieval · Computer Science 2025-03-27 Dun Zhang , Panxiang Zou , Yudong Zhou