English
Related papers

Related papers: MUSE: A Simple Yet Effective Multimodal Search-Bas…

200 papers

Socially compliant navigation requires structured reasoning over dynamic pedestrians and physical constraints to ensure safe and interpretable decisions. However, existing social navigation datasets often lack explicit reasoning supervision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Zhuonan Liu , Xinyu Zhang , Zishuo Wang , Tomohito Kawabata , Xuesu Xiao , Ling Xiao

Many cultural institutions have made large digitized visual collections available online, often under permissible re-use licences. Creating interfaces for exploring and searching these collections is difficult, particularly in the absence…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Taylor Arnold , Lauren Tilton

Knowledge extraction from database is the fundamental task in database and data mining community, which has been applied to a wide range of real-world applications and situations. Different from the support-based mining models, the…

Modeling user interest based on lifelong user behavior sequences is crucial for enhancing Click-Through Rate (CTR) prediction. However, long post-click behavior sequences themselves pose severe performance issues: the sheer volume of data…

Information Retrieval · Computer Science 2025-09-01 Zhuoxing Wei , Qingchen Xie , Qi Liu

Sequential recommendation (SR) leverages users' dynamic preferences, with recent advances incorporating multi-interest learning to model diverse user interests. However, most multi-interest SR models rely on noisy, sparse implicit feedback,…

Information Retrieval · Computer Science 2025-05-08 Shutong Qiao , Chen Gao , Wei Yuan , Yong Li , Hongzhi Yin

Multi-modal retrieval has seen tremendous progress with the development of vision-language models. However, further improving these models require additional labelled data which is a huge manual effort. In this paper, we propose a framework…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Avinash Madasu , Estelle Aflalo , Gabriela Ben Melech Stan , Shachar Rosenman , Shao-Yen Tseng , Gedas Bertasius , Vasudev Lal

We present EMUSE (Evolutionary Map of the Universe Search Engine), a tool designed for searching specific radio sources within the extensive datasets of the EMU (Evolutionary Map of the Universe) survey, with potential applications to other…

Multimodal embedding models aim to yield informative unified representations that empower diverse cross-modal tasks. Despite promising developments in the evolution from CLIP-based dual-tower architectures to large vision-language models,…

User authentication is essential to ensure secure access to computer systems, yet traditional methods face limitations in usability, cost, and security. Mouse dynamics authentication, based on the analysis of users' natural interaction…

Cryptography and Security · Computer Science 2025-05-13 Yi Wang , Chengyv Wu , Yang Liao , Maowei You

Recommender systems (RSs) have gained widespread applications across various domains owing to the superior ability to capture users' interests. However, the complexity and nuanced nature of users' interests, which span a wide range of…

Information Retrieval · Computer Science 2024-02-22 Yuying Zhao , Minghua Xu , Huiyuan Chen , Yuzhong Chen , Yiwei Cai , Rashidul Islam , Yu Wang , Tyler Derr

Generative recommendation systems have achieved significant advances by leveraging semantic IDs to represent items. However, existing approaches that tokenize each modality independently face two critical limitations: (1) redundancy across…

Information Retrieval · Computer Science 2026-01-14 Haven Kim , Yupeng Hou , Julian McAuley

Recently, deep learning methods have become mainstream in code search since they do better at capturing semantic correlations between code snippets and search queries and have promising performance. However, code snippets have diverse…

Software Engineering · Computer Science 2021-07-14 Lun Du , Xiaozhou Shi , Yanlin Wang , Ensheng Shi , Shi Han , Dongmei Zhang

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across diverse modalities and tasks. Despite its growing success, a comprehensive and systematic…

Machine Learning · Computer Science 2026-05-28 Liangwei Nathan Zheng , Wei Emma Zhang , Olaf Maennel , Lin Yue , Weitong Chen

There is a recent surge of interest in cross-modal representation learning corresponding to images and text. The main challenge lies in mapping images and text to a shared latent space where the embeddings corresponding to a similar…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Pradyumna Narayana , Aniket Pednekar , Abishek Krishnamoorthy , Kazoo Sone , Sugato Basu

The problem of relevant and diverse subset selection has a wide range of applications, including recommender systems and retrieval-augmented generation (RAG). For example, in recommender systems, one is interested in selecting relevant…

Machine Learning · Computer Science 2026-03-10 Vu Nguyen , Andrey Kan

Universal multimodal embedding models have achieved great success in capturing semantic relevance between queries and candidates. However, current methods either condense queries and candidates into a single vector, potentially limiting the…

Information Retrieval · Computer Science 2026-04-08 Zilin Xiao , Qi Ma , Mengting Gu , Chun-cheng Jason Chen , Xintao Chen , Vicente Ordonez , Vijai Mohan

Acquiring valuable data from the rapidly expanding information on the internet has become a significant concern, and recommender systems have emerged as a widely used and effective tool for helping users discover items of interest. The…

Information Retrieval · Computer Science 2025-02-25 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Wei Wang , Xiping Hu , Steven Hoi , Edith Ngai

Ultrasound Strain Elastography (USE) is a powerful non-invasive imaging technique for assessing tissue mechanical properties, offering crucial diagnostic value across diverse clinical applications. However, its clinical application remains…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Shourov Joarder , Tushar Talukder Showrav , Md. Kamrul Hasan

Sequential Recommender Systems (SRS) aim to predict users' next interaction based on their historical behaviors, while still facing the challenge of data sparsity. With the rapid advancement of Multimodal Large Language Models (MLLMs),…

Information Retrieval · Computer Science 2026-02-17 Mingyao Huang , Qidong Liu , Wenxuan Yang , Moranxin Wang , Yuqi Sun , Haiping Zhu , Feng Tian , Yan Chen