English
Related papers

Related papers: Llama Nemoretriever Colembed: Top-Performing Text-…

200 papers

In this report, we introduce the Qwen3-VL-Embedding and Qwen3-VL-Reranker model series, the latest extensions of the Qwen family built on the Qwen3-VL foundation model. Together, they provide an end-to-end pipeline for high-precision…

Computation and Language · Computer Science 2026-01-21 Mingxin Li , Yanzhao Zhang , Dingkun Long , Keqin Chen , Sibo Song , Shuai Bai , Zhibo Yang , Pengjun Xie , An Yang , Dayiheng Liu , Jingren Zhou , Junyang Lin

The recent mainstream adoption of large language model (LLM) technology is enabling novel applications in the form of chatbots and virtual assistants across many domains. With the aim of grounding LLMs in trusted domains and avoiding the…

Computation and Language · Computer Science 2025-07-08 Antoine Nzeyimana , Andre Niyongabo Rubungo

Vision-Language-Action (VLA) models have emerged as a promising paradigm for end-to-end autonomous driving, yet their reliance on implicit parametric knowledge limits generalization in long-tail scenarios. While Retrieval-Augmented…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Rui Zhao , Haofeng Hu , Zhenhai Gao , Jiaqiao Liu , Gao Fei

While dense retrieval models have become the standard for state-of-the-art information retrieval, their deployment is often constrained by high memory requirements and reliance on GPU accelerators for vector similarity search. Learned…

Information Retrieval · Computer Science 2026-01-06 Zhichao Xu , Shengyao Zhuang , Crystina Zhang , Xueguang Ma , Yijun Tian , Maitrey Mehta , Jimmy Lin , Vivek Srikumar

A Retrieval-Augmented Language Model (RALM) combines a large language model (LLM) with a vector database to retrieve context-specific knowledge during text generation. This strategy facilitates impressive generation quality even with…

Machine Learning · Computer Science 2025-03-26 Wenqi Jiang , Marco Zeller , Roger Waleffe , Torsten Hoefler , Gustavo Alonso

With the booming of Large Language Models (LLMs), prompt-learning has become a promising method mainly researched in various research areas. Recently, many attempts based on prompt-learning have been made to improve the performance of text…

Computation and Language · Computer Science 2024-06-07 Chun Liu , Hongguang Zhang , Kainan Zhao , Xinghai Ju , Lin Yang

Vision Language Models (VLMs) integrate visual and text modalities to enable multimodal understanding and generation. These models typically combine a Vision Transformer (ViT) as an image encoder and a Large Language Model (LLM) for text…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Krishna Teja Chitty-Venkata , Murali Emani , Venkatram Vishwanath

We introduce Nemotron Nano V2 VL, the latest model of the Nemotron vision-language series designed for strong real-world document understanding, long video comprehension, and reasoning tasks. Nemotron Nano V2 VL delivers significant…

Machine Learning · Computer Science 2025-11-10 NVIDIA , : , Amala Sanjay Deshmukh , Kateryna Chumachenko , Tuomas Rintamaki , Matthieu Le , Tyler Poon , Danial Mohseni Taheri , Ilia Karmanov , Guilin Liu , Jarno Seppanen , Guo Chen , Karan Sapra , Zhiding Yu , Adi Renduchintala , Charles Wang , Peter Jin , Arushi Goel , Mike Ranzinger , Lukas Voegtle , Philipp Fischer , Timo Roman , Wei Ping , Boxin Wang , Zhuolin Yang , Nayeon Lee , Shaokun Zhang , Fuxiao Liu , Zhiqi Li , Di Zhang , Greg Heinrich , Hongxu Yin , Song Han , Pavlo Molchanov , Parth Mannan , Yao Xu , Jane Polak Scowcroft , Tom Balough , Subhashree Radhakrishnan , Paris Zhang , Sean Cha , Ratnesh Kumar , Zaid Pervaiz Bhat , Jian Zhang , Darragh Hanley , Pritam Biswas , Jesse Oliver , Kevin Vasques , Roger Waleffe , Duncan Riach , Oluwatobi Olabiyi , Ameya Sunil Mahabaleshwarkar , Bilal Kartal , Pritam Gundecha , Khanh Nguyen , Alexandre Milesi , Eugene Khvedchenia , Ran Zilberstein , Ofri Masad , Natan Bagrov , Nave Assaf , Tomer Asida , Daniel Afrimi , Amit Zuker , Netanel Haber , Zhiyu Cheng , Jingyu Xin , Di Wu , Nik Spirin , Maryam Moosaei , Roman Ageev , Vanshil Atul Shah , Yuting Wu , Daniel Korzekwa , Unnikrishnan Kizhakkemadam Sreekumar , Wanli Jiang , Padmavathy Subramanian , Alejandra Rico , Sandip Bhaskar , Saeid Motiian , Kedi Wu , Annie Surla , Chia-Chih Chen , Hayden Wolff , Matthew Feinberg , Melissa Corpuz , Marek Wawrzos , Eileen Long , Aastha Jhunjhunwala , Paul Hendricks , Farzan Memarian , Benika Hall , Xin-Yu Wang , David Mosallanezhad , Soumye Singhal , Luis Vega , Katherine Cheung , Krzysztof Pawelec , Michael Evans , Katherine Luna , Jie Lou , Erick Galinkin , Akshay Hazare , Kaustubh Purandare , Ann Guan , Anna Warno , Chen Cui , Yoshi Suhara , Shibani Likhite , Seph Mard , Meredith Price , Laya Sleiman , Saori Kaji , Udi Karpas , Kari Briski , Joey Conway , Michael Lightstone , Jan Kautz , Mohammad Shoeybi , Mostofa Patwary , Jonathen Cohen , Oleksii Kuchaiev , Andrew Tao , Bryan Catanzaro

Recent Mamba-based image restoration methods have achieved promising results but remain limited by fixed scanning patterns and inefficient feature utilization. Conventional Mamba architectures rely on predetermined paths that cannot adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Han Hu , Zhuoran Zheng , Liang Li , Chen Lyu

We introduce NVLM 1.0, a family of frontier-class multimodal large language models (LLMs) that achieve state-of-the-art results on vision-language tasks, rivaling the leading proprietary models (e.g., GPT-4o) and open-access models (e.g.,…

Computation and Language · Computer Science 2024-10-24 Wenliang Dai , Nayeon Lee , Boxin Wang , Zhuolin Yang , Zihan Liu , Jon Barker , Tuomas Rintamaki , Mohammad Shoeybi , Bryan Catanzaro , Wei Ping

This report explores the enhancement of text retrieval performance using advanced data refinement techniques. We develop Linq-Embed-Mistral\footnote{\url{https://huggingface.co/Linq-AI-Research/Linq-Embed-Mistral}} by building on the…

Computation and Language · Computer Science 2024-12-05 Chanyeol Choi , Junseong Kim , Seolhwa Lee , Jihoon Kwon , Sangmo Gu , Yejin Kim , Minkyung Cho , Jy-yong Sohn

While large language models (LLMs) are increasingly deployed as dense retrievers, the impact of their domain-specific specialization on retrieval effectiveness remains underexplored. This investigation systematically examines how…

Information Retrieval · Computer Science 2025-08-07 Hengran Zhang , Keping Bi , Jiafeng Guo

Large Language Models (LLMs)-based text retrieval retrieves documents relevant to search queries based on vector similarities. Documents are pre-encoded offline, while queries arrive in real-time, necessitating an efficient online query…

Information Retrieval · Computer Science 2026-02-02 Guangyuan Ma , Yongliang Ma , Xuanrui Gou , Zhenpeng Su , Ming Zhou , Songlin Hu

Multi-modal retrieval has seen tremendous progress with the development of vision-language models. However, further improving these models require additional labelled data which is a huge manual effort. In this paper, we propose a framework…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Avinash Madasu , Estelle Aflalo , Gabriela Ben Melech Stan , Shachar Rosenman , Shao-Yen Tseng , Gedas Bertasius , Vasudev Lal

Retrieval augmented models are becoming increasingly popular for computer vision tasks after their recent success in NLP problems. The goal is to enhance the recognition capabilities of the model by retrieving similar examples for the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Ahmet Iscen , Alireza Fathi , Cordelia Schmid

Recent multimodal models such as DALL-E and CM3 have achieved remarkable progress in text-to-image and image-to-text generation. However, these models store all learned knowledge (e.g., the appearance of the Eiffel Tower) in the model…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Michihiro Yasunaga , Armen Aghajanyan , Weijia Shi , Rich James , Jure Leskovec , Percy Liang , Mike Lewis , Luke Zettlemoyer , Wen-tau Yih

Our objective is to build an embedding model that captures the nuanced relationship between a search query and candidate videos. We cover three aspects of nuanced retrieval: (i) temporal, (ii) negation, and (iii) multimodal. For temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Piyush Bagad , Andrew Zisserman

The rapid growth of video content demands efficient and precise retrieval systems. While vision-language models (VLMs) excel in representation learning, they often struggle with adaptive, time-sensitive video retrieval. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yicheng Duan , Xi Huang , Duo Chen

Objective: To optimize in-context learning in biomedical natural language processing by improving example selection. Methods: We introduce a novel multi-mode retrieval-augmented generation (MMRAG) framework, which integrates four retrieval…

Computation and Language · Computer Science 2025-02-25 Zaifu Zhan , Jun Wang , Shuang Zhou , Jiawen Deng , Rui Zhang

This paper shows how diffusion language models (DLMs) can be used as effective and efficient retrievers. Existing DLM-based retrievers (e.g., DiffEmbed) follow BERT-style encoding, representing each query or passage as a single mean-pooled…

Information Retrieval · Computer Science 2026-05-29 Shuai Wang , Yu Yin , Shengyao Zhuang , Bevan Koopman , Guido Zuccon