English
Related papers

Related papers: Train Once, Deploy Anywhere: Matryoshka Representa…

200 papers

Multimodal recommender systems utilize various types of information to model user preferences and item features, helping users discover items aligned with their interests. The integration of multimodal information mitigates the inherent…

Information Retrieval · Computer Science 2024-02-20 Shanshan Zhong , Zhongzhan Huang , Daifeng Li , Wushao Wen , Jinghui Qin , Liang Lin

The lack of training data gives rise to the system cold-start problem in recommendation systems, making them struggle to provide effective recommendations. To address this problem, Large Language Models (LLMs) can model recommendation tasks…

Information Retrieval · Computer Science 2024-12-25 Wenlin Zhang , Chuhan Wu , Xiangyang Li , Yuhao Wang , Kuicai Dong , Yichao Wang , Xinyi Dai , Xiangyu Zhao , Huifeng Guo , Ruiming Tang

Multimodal Large Language Models (MLLMs) have shown immense promise in universal multimodal retrieval, which aims to find relevant items of various modalities for a given query. But their practical application is often hindered by the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Qi Li , Yanzhe Zhao , Yongxin Zhou , Yameng Wang , Yandong Yang , Yuanjia Zhou , Jue Wang , Zuojian Wang , Jinxiang Liu

Multimodal embeddings are widely used in downstream tasks such as multimodal retrieval, enabling alignment of interleaved modalities in a shared representation space. While recent studies show that Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Chunxu Liu , Jiyuan Yang , Ruopeng Gao , Yuhan Zhu , Feng Zhu , Rui Zhao , Limin Wang

Contemporary generative recommendation systems face significant challenges in handling multimodal data, eliminating algorithmic biases, and providing transparent decision-making processes. This paper introduces an enhanced generative…

Information Retrieval · Computer Science 2025-10-03 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Lau

Recent research efforts have investigated how to integrate Large Language Models (LLMs) into recommendation, capitalizing on their semantic comprehension and open-world knowledge for user behavior understanding. These approaches…

Information Retrieval · Computer Science 2025-04-15 Haokai Ma , Yunshan Ma , Ruobing Xie , Lei Meng , Jialie Shen , Xingwu Sun , Zhanhui Kang , Tat-Seng Chua

Combining different data modalities enables deep neural networks to tackle complex tasks more effectively, making multimodal learning increasingly popular. To harness multimodal data closer to end users, it is essential to integrate…

Machine Learning · Computer Science 2024-10-22 Ye Lin Tun , Chu Myaet Thwal , Minh N. H. Nguyen , Choong Seon Hong

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Recent advances in Large Language Models (LLMs) have opened new avenues for sequential recommendation by enabling natural language reasoning over user behavior sequences. A common approach formulates recommendation as a language modeling…

Information Retrieval · Computer Science 2026-04-08 Yu Wang , Yonghui Yang , Le Wu , Yi Zhang , Fei Liu , Richang Hong

Fine-grained text-to-image retrieval aims to retrieve a fine-grained target image with a given text query. Existing methods typically assume that each training image is accurately depicted by its textual descriptions. However, textual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Zehong Ma , Hao Chen , Wei Zeng , Limin Su , Shiliang Zhang

We present a unified model-based and data-driven approach for quadrupedal planning and control to achieve dynamic locomotion over uneven terrain. We utilize on-board proprioceptive and exteroceptive feedback to map sensory information and…

Robotics · Computer Science 2022-05-13 Siddhant Gangapurwala , Mathieu Geisert , Romeo Orsolino , Maurice Fallon , Ioannis Havoutis

Trajectory representation learning (TRL) maps trajectories to vectors that can then be used for various downstream tasks, including trajectory similarity computation, trajectory classification, and travel-time estimation. However, existing…

Machine Learning · Computer Science 2024-12-02 Silin Zhou , Shuo Shang , Lisi Chen , Christian S. Jensen , Panos Kalnis

Sequential recommendation addresses the issue of preference drift by predicting the next item based on the user's previous behaviors. Recently, a promising approach using contrastive learning has emerged, demonstrating its effectiveness in…

Information Retrieval · Computer Science 2023-08-08 Dongjun Lee , Donggeun Ko , Jaekwang Kim

Multimodal instruction tuning is the de facto recipe for adapting vision language models (VLMs), yet instruction data are highly redundant, making data selection critical for training efficiency. Existing methods derive selection signals…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Mingkang Dong , Hongyi Cai , Xiwen Lei , Jie Li , Tao Zhang , Muxin Pu

The WWW 2025 EReL@MIR Workshop Multimodal CTR Prediction Challenge focuses on effectively applying multimodal embedding features to improve click-through rate (CTR) prediction in recommender systems. This technical report presents our…

Information Retrieval · Computer Science 2025-05-07 Junwei Xu , Zehao Zhao , Xiaoyu Hu , Zhenjie Song

Current multimodal recommendation models have extensively explored the effective utilization of multimodal information; however, their reliance on ID embeddings remains a performance bottleneck. Even with the assistance of multimodal…

Information Retrieval · Computer Science 2024-10-28 Kangning Zhang , Jiarui Jin , Yingjie Qin , Ruilong Su , Jianghao Lin , Yong Yu , Weinan Zhang

We introduce SEE&TREK, the first training-free prompting framework tailored to enhance the spatial understanding of Multimodal Large Language Models (MLLMS) under vision-only constraints. While prior efforts have incorporated modalities…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Pengteng Li , Pinhao Song , Wuyang Li , Weiyu Guo , Huizai Yao , Yijie Xu , Dugang Liu , Hui Xiong

Recent advances in Large Language Models (LLMs) have demonstrated promising performance in sequential recommendation tasks, leveraging their superior language understanding capabilities. However, existing LLM-based recommendation approaches…

Information Retrieval · Computer Science 2024-12-10 Minglai Shao , Hua Huang , Qiyao Peng , Hongtao Liu

2D Matryoshka Training is an advanced embedding representation training approach designed to train an encoder model simultaneously across various layer-dimension setups. This method has demonstrated higher effectiveness in Semantic Text…

Information Retrieval · Computer Science 2024-11-27 Shuai Wang , Shengyao Zhuang , Bevan Koopman , Guido Zuccon

In modern recommender systems, especially in e-commerce, predicting multiple targets such as click-through rate (CTR) and post-view conversion rate (CTCVR) is common. Multi-task recommender systems are increasingly popular in both research…

Information Retrieval · Computer Science 2024-08-21 Yue Ding , Yanbiao Ji , Xun Cai , Xin Xin , Yuxiang Lu , Suizhi Huang , Chang Liu , Xiaofeng Gao , Tsuyoshi Murata , Hongtao Lu