English
Related papers

Related papers: QARM: Quantitative Alignment Multi-Modal Recommend…

200 papers

The importance of recommender systems is growing rapidly due to the exponential increase in the volume of content generated daily. This surge in content presents unique challenges for designing effective recommender systems. Key among these…

Computation and Language · Computer Science 2025-06-12 Jiahao Tian , Jinman Zhao , Zhenkai Wang , Zhicheng Ding

Multimodal representation learning is fundamentally about transforming incomparable modalities into comparable representations. While prior research primarily focused on explicitly aligning these representations through targeted learning…

Machine Learning · Computer Science 2025-06-16 Megan Tjandrasuwita , Chanakya Ekbote , Liu Ziyin , Paul Pu Liang

Multi-modal models have shown a promising capability to effectively integrate information from various sources, yet meanwhile, they are found vulnerable to pervasive perturbations, such as uni-modal attacks and missing conditions. To…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Zequn Yang , Yake Wei , Ce Liang , Di Hu

Multimodal learning integrates information from different modalities to enhance model performance, yet it often suffers from modality imbalance, where dominant modalities overshadow weaker ones during joint optimization. This paper reveals…

Machine Learning · Computer Science 2025-10-17 Xiaoyu Ma , Hao Chen

Recommender systems are often designed based on a collaborative filtering approach, where user preferences are predicted by modelling interactions between users and items. Many common approaches to solve the collaborative filtering task are…

Machine Learning · Computer Science 2021-10-11 Yinchong Yang , Florian Buettner

Multimodality Representation Learning, as a technique of learning to embed information from different modalities and their correlations, has achieved remarkable success on a variety of applications, such as Visual Question Answering (VQA),…

Artificial Intelligence · Computer Science 2024-03-04 Muhammad Arslan Manzoor , Sarah Albarri , Ziting Xian , Zaiqiao Meng , Preslav Nakov , Shangsong Liang

Accurately recommending products has long been a subject requiring in-depth research. This study proposes a multimodal paradigm for clothing recommendations. Specifically, it designs a multimodal analysis method that integrates clothing…

Information Retrieval · Computer Science 2024-10-22 Bingjie Huang , Qingyi Lu , Shuaishuai Huang , Xue-she Wang , Haowei Yang

Multimodal recommendation has emerged as an effective paradigm for enhancing collaborative filtering by incorporating heterogeneous content modalities. Existing multimodal recommenders predominantly focus on reinforcing cross-modal…

Information Retrieval · Computer Science 2026-03-03 Hao Zhan , Yihui Wang , Yonghui Yang , Danyang Yue , Yu Wang , Pengyang Shao , Fei Shen , Fei Liu , Le Wu

Sequential recommendation (SR) systems have evolved significantly over the past decade, transitioning from traditional collaborative filtering to deep learning approaches and, more recently, to large language models (LLMs). While the…

Information Retrieval · Computer Science 2024-12-31 Yucong Luo , Qitao Qin , Hao Zhang , Mingyue Cheng , Ruiran Yan , Kefan Wang , Jie Ouyang

With the explosive growth of multimodal content online, pre-trained visual-language models have shown great potential for multimodal recommendation. However, while these models achieve decent performance when applied in a frozen manner,…

Information Retrieval · Computer Science 2025-02-24 Wenyu Zhang , Jie Luo , Xinming Zhang , Yuan Fang

Ubiquitous information access becomes more and more important nowadays and research is aimed at making it adapted to users. Our work consists in applying machine learning techniques in order to bring a solution to some of the problems…

Machine Learning · Computer Science 2014-04-01 Djallel Bouneffouf

Reinforcement learning has driven impressive advances in machine learning. Simultaneously, quantum-enhanced machine learning algorithms using quantum annealing underlie heavy developments. Recently, a multi-agent reinforcement learning…

Artificial Intelligence · Computer Science 2021-11-23 Tobias Müller , Christoph Roch , Kyrill Schmid , Philipp Altmann

Developing a universal model that can effectively harness heterogeneous resources and respond to a wide range of personalized needs has been a longstanding community aspiration. Our daily choices, especially in domains like fashion and…

Information Retrieval · Computer Science 2024-03-29 Tianxin Wei , Bowen Jin , Ruirui Li , Hansi Zeng , Zhengyang Wang , Jianhui Sun , Qingyu Yin , Hanqing Lu , Suhang Wang , Jingrui He , Xianfeng Tang

Large-scale recommendation models are currently the dominant workload for many large Internet companies. These recommenders are characterized by massive embedding tables that are sparsely accessed by the index for user and item features.…

Information Retrieval · Computer Science 2024-10-29 Yang Zhou , Zhen Dong , Ellick Chan , Dhiraj Kalamkar , Diana Marculescu , Kurt Keutzer

Multi-behavioral recommendation optimizes user experiences by providing users with more accurate choices based on their diverse behaviors, such as view, add to cart, and purchase. Current studies on multi-behavioral recommendation mainly…

Information Retrieval · Computer Science 2024-04-19 Shunpan Liang , Junjie Zhao , Chen Li , Yu Lei

With the rapid development of mobile Internet and big data, a huge amount of data is generated in the network, but the data that users are really interested in a very small portion. To extract the information that users are interested in…

Information Retrieval · Computer Science 2022-05-09 Bo Liu

With the increasing multimedia information, multimodal recommendation has received extensive attention. It utilizes multimodal information to alleviate the data sparsity problem in recommendation systems, thus improving recommendation…

Information Retrieval · Computer Science 2024-03-01 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Edith C. -H. Ngai

Medical multimodal representation learning aims to integrate heterogeneous data into unified patient representations to support clinical outcome prediction. However, real-world medical datasets commonly contain systematic biases from…

Machine Learning · Computer Science 2026-05-19 Xiaoguang Zhu , Linxiao Gong , Lianlong Sun , Yang Liu , Haoyu Wang , Jing Liu

Modern recommender systems face critical challenges in handling information overload while addressing the inherent limitations of multimodal representation learning. Existing methods suffer from three fundamental limitations: (1) restricted…

Information Retrieval · Computer Science 2025-08-15 Zheyu Chen , Jinfeng Xu , Hewei Wang , Shuo Yang , Zitong Wan , Haibo Hu

This paper presents the first study to explore the potential of parameter quantization for multimodal large language models to alleviate the significant resource constraint encountered during vision-language instruction tuning. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Jingjing Xie , Yuxin Zhang , Mingbao Lin , Liujuan Cao , Rongrong Ji