English
Related papers

Related papers: M3DR: Towards Universal Multilingual Multimodal Do…

200 papers

Traditional dialogue retrieval aims to select the most appropriate utterance or image from recent dialogue history. However, they often fail to meet users' actual needs for revisiting semantically coherent content scattered across long-form…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hanbo Bi , Zhiqiang Yuan , Zexi Jia , Jiapei Zhang , Chongyang Li , Peixiang Luo , Ying Deng , Xiaoyue Duan , Jinchao Zhang

Domain specific information retrieval process has been a prominent and ongoing research in the field of natural language processing. Many researchers have incorporated different techniques to overcome the technical and domain specificity…

Bilingual word embeddings have been widely used to capture the similarity of lexical semantics in different human languages. However, many applications, such as cross-lingual semantic search and question answering, can be largely benefited…

Computation and Language · Computer Science 2019-09-10 Muhao Chen , Yingtao Tian , Haochen Chen , Kai-Wei Chang , Steven Skiena , Carlo Zaniolo

In recent years, multimodal learning has become essential in robotic vision and information fusion, especially for understanding human behavior in complex environments. However, current methods struggle to fully leverage the textual…

Robotics · Computer Science 2025-09-23 Yanxin Zhang , Liang He , Zeyi Kang , Zuheng Ming , Kaixing Zhao

We introduce mTVR, a large-scale multilingual video moment retrieval dataset, containing 218K English and Chinese queries from 21.8K TV show video clips. The dataset is collected by extending the popular TVR dataset (in English) with paired…

Computation and Language · Computer Science 2021-08-03 Jie Lei , Tamara L. Berg , Mohit Bansal

Text embeddings are typically evaluated on a limited set of tasks, which are constrained by language, domain, and task diversity. To address these limitations and provide a more comprehensive evaluation, we introduce the Massive…

With the advent of technology and use of latest devices, they produces voluminous data. Out of it, 80% of the data are unstructured and remaining 20% are structured and semi-structured. The produced data are in heterogeneous format and…

Most multi-modal tasks can be formulated into problems of either generation or embedding. Existing models usually tackle these two types of problems by decoupling language modules into a text decoder for generation, and a text encoder for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Feipeng Ma , Hongwei Xue , Guangting Wang , Yizhou Zhou , Fengyun Rao , Shilin Yan , Yueyi Zhang , Siying Wu , Mike Zheng Shou , Xiaoyan Sun

Multimodal large language models (MLLMs) have recently shown great progress in text-rich image understanding, yet they still struggle with complex, multi-page visually-rich documents. Traditional methods using document parsers for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jian Chen , Ruiyi Zhang , Yufan Zhou , Tong Yu , Franck Dernoncourt , Jiuxiang Gu , Ryan A. Rossi , Changyou Chen , Tong Sun

Dense vector representations for textual data are crucial in modern NLP. Word embeddings and sentence embeddings estimated from raw texts are key in achieving state-of-the-art results in various tasks requiring semantic understanding.…

Computation and Language · Computer Science 2023-07-06 Sonal Sannigrahi , Josef van Genabith , Cristina Espana-Bonet

In this paper, we propose to boost low-resource cross-lingual document retrieval performance with deep bilingual query-document representations. We match queries and documents in both source and target languages with four components, each…

Computation and Language · Computer Science 2019-06-11 Rui Zhang , Caitlin Westerfield , Sungrok Shim , Garrett Bingham , Alexander Fabbri , Neha Verma , William Hu , Dragomir Radev

Long-form video understanding presents significant challenges for interactive retrieval systems, as conventional methods struggle to process extensive video content efficiently. Existing approaches often rely on single models, inefficient…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Huu-Loc Tran , Tinh-Anh Nguyen-Nhu , Huu-Phong Phan-Nguyen , Tien-Huy Nguyen , Nhat-Minh Nguyen-Dich , Anh Dao , Huy-Duc Do , Quan Nguyen , Hoang M. Le , Quang-Vinh Dinh

Recent advancements in information retrieval have highlighted the potential of integrating visual and textual information, yet effective reranking for image-text documents remains challenging due to the modality gap and scarcity of aligned…

Information Retrieval · Computer Science 2026-01-29 Hongyi Cai

Visual Document Retrieval (VDR), which aims to retrieve relevant pages within vast corpora of visually-rich documents, is of significance in current multimodal retrieval applications. The state-of-the-art multi-vector paradigm excels in…

Computation and Language · Computer Science 2026-04-21 Yibo Yan , Mingdong Ou , Yi Cao , Xin Zou , Jiahao Huo , Shuliang Liu , James Kwok , Xuming Hu

Prior work has proved that Translation memory (TM) can boost the performance of Neural Machine Translation (NMT). In contrast to existing work that uses bilingual corpus as TM and employs source-side similarity search for memory retrieval,…

Computation and Language · Computer Science 2021-06-03 Deng Cai , Yan Wang , Huayang Li , Wai Lam , Lemao Liu

Since the release of ChatGPT, the field of Natural Language Processing has experienced rapid advancements, particularly in Large Language Models (LLMs) and their multimodal counterparts, Large Multimodal Models (LMMs). Despite their…

Computation and Language · Computer Science 2024-08-27 Florian Schneider , Sunayana Sitaram

Dense retrieval models using a transformer-based bi-encoder design have emerged as an active area of research. In this work, we focus on the task of monolingual retrieval in a variety of typologically diverse languages using one such…

Information Retrieval · Computer Science 2022-04-06 Xinyu Zhang , Kelechi Ogueji , Xueguang Ma , Jimmy Lin

This report presents our participation to the WSDM Cup 2026 shared task on multilingual document retrieval from English queries. The task provides a challenging benchmark for cross-lingual generalization. It also provides a natural testbed…

Information Retrieval · Computer Science 2026-02-25 Thibault Formal , Maxime Louis , Hervé Déjean , Stéphane Clinchant

Document retrieval is an important task for search and Retrieval-Augmented Generation (RAG) applications. Large Language Models (LLMs) have contributed to improving the accuracy of text-based document retrieval. However, documents with…

Information Retrieval · Computer Science 2025-05-22 Radek Osmulski , Gabriel de Souza P. Moreira , Ronay Ak , Mengyao Xu , Benedikt Schifferer , Even Oldridge

Harnessing the full potential of visually-rich documents requires retrieval systems that understand not just text, but intricate layouts, a core challenge in Visual Document Retrieval (VDR). The prevailing multi-vector architectures, while…

Computation and Language · Computer Science 2026-03-03 Yibo Yan , Mingdong Ou , Yi Cao , Xin Zou , Shuliang Liu , Jiahao Huo , Yu Huang , James Kwok , Xuming Hu