English
Related papers

Related papers: Generating Negative Samples for Multi-Modal Recomm…

200 papers

Synthesizing MR imaging sequences is highly relevant in clinical practice, as single sequences are often missing or are of poor quality (e.g. due to motion). Naturally, the idea arises that a target modality would benefit from multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Hongwei Li , Johannes C. Paetzold , Anjany Sekuboyina , Florian Kofler , Jianguo Zhang , Jan S. Kirschke , Benedikt Wiestler , Bjoern Menze

Language Models (LMs) have been widely used in recommender systems to incorporate textual information of items into item IDs, leveraging their advanced language understanding and generation capabilities. Recently, generative recommender…

Information Retrieval · Computer Science 2026-04-28 Tongyoung Kim , Soojin Yoon , SeongKu Kang , Jinyoung Yeo , Dongha Lee

Multimodal learning systems often encounter challenges related to modality imbalance, where a dominant modality may overshadow others, thereby hindering the learning of weak modalities. Conventional approaches often force weak modalities to…

Machine Learning · Computer Science 2025-10-27 Baoquan Gong , Xiyuan Gao , Pengfei Zhu , Qinghua Hu , Bing Cao

The success of recommender systems in modern online platforms is inseparable from the accurate capture of users' personal tastes. In everyday life, large amounts of user feedback data are created along with user-item online interactions in…

Machine Learning · Computer Science 2019-06-25 Xiao Zhou , Danyang Liu , Jianxun Lian , Xing Xie

Multi-behavior sequential recommendation (MBSR) aims to incorporate behavior types of interactions for better recommendations. Existing approaches focus on the next-item prediction objective, neglecting the value of integrating the target…

Information Retrieval · Computer Science 2024-07-31 Zihan Liu , Yupeng Hou , Julian McAuley

Session-based recommendation aims to predict intents of anonymous users based on limited behaviors. With the ability in alleviating data sparsity, contrastive learning is prevailing in the task. However, we spot that existing contrastive…

Information Retrieval · Computer Science 2025-06-06 Xiaokun Zhang , Bo Xu , Fenglong Ma , Zhizheng Wang , Liang Yang , Hongfei Lin

Generative recommendation has emerged as a promising paradigm aiming at directly generating the identifiers of the target candidates. Most existing methods attempt to leverage prior knowledge embedded in Pre-trained Language Models (PLMs)…

Information Retrieval · Computer Science 2025-04-09 Jianyang Zhai , Zi-Feng Mai , Chang-Dong Wang , Feidiao Yang , Xiawu Zheng , Hui Li , Yonghong Tian

The learn-to-compare paradigm of contrastive representation learning (CRL), which compares positive samples with negative ones for representation learning, has achieved great success in a wide range of domains, including natural language…

Information Retrieval · Computer Science 2022-06-02 Lanling Xu , Jianxun Lian , Wayne Xin Zhao , Ming Gong , Linjun Shou , Daxin Jiang , Xing Xie , Ji-Rong Wen

The recently proposed Collaborative Metric Learning (CML) paradigm has aroused wide interest in the area of recommendation systems (RS) owing to its simplicity and effectiveness. Typically, the existing literature of CML depends largely on…

Machine Learning · Computer Science 2022-06-24 Shilong Bao , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

In this paper, we propose to use a Conditional Generative Adversarial Network (CGAN) for distilling (i.e. transferring) knowledge from sensor data and enhancing low-resolution target detection. In unconstrained surveillance settings, sensor…

Image and Video Processing · Electrical Eng. & Systems 2018-07-23 Siddharth Roheda , Benjamin S. Riggan , Hamid Krim , Liyi Dai

Multi-modal Retrieval-Augmented Generation (MMRAG) has emerged as a powerful paradigm for enhancing Multimodal Large Language Models in knowledge-intensive question answering by integrating external visual, textual, and structural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xiang Fang , Wanlong Fang , Changshuo Wang

Recently, deep learning has made significant progress in the task of sequential recommendation. Existing neural sequential recommenders typically adopt a generative way trained with Maximum Likelihood Estimation (MLE). When context…

Information Retrieval · Computer Science 2020-05-22 Ruiyang Ren , Zhaoyang Liu , Yaliang Li , Wayne Xin Zhao , Hui Wang , Bolin Ding , Ji-Rong Wen

Multimodal large language models (MLLMs) have become the cornerstone of today's generative AI ecosystem, sparking intense competition among tech giants and startups. In particular, an MLLM generates a text response given a prompt consisting…

Cryptography and Security · Computer Science 2024-09-09 Zedian Shao , Hongbin Liu , Yuepeng Hu , Neil Zhenqiang Gong

The performance of Dense retrieval (DR) is significantly influenced by the quality of negative sampling. Traditional DR methods primarily depend on naive negative sampling techniques or on mining hard negatives through external retriever…

Information Retrieval · Computer Science 2024-12-24 Xiaopeng Li , Xiangyang Li , Hao Zhang , Zhaocheng Du , Pengyue Jia , Yichao Wang , Xiangyu Zhao , Huifeng Guo , Ruiming Tang

To address the modality imbalance caused by data heterogeneity, existing multi-modal learning (MML) approaches primarily focus on balancing this difference from the perspective of optimization objectives. However, almost all existing…

Machine Learning · Computer Science 2025-01-06 Zhi-Hao Guan

It is known that the inconsistent distribution and representation of different modalities, such as image and text, cause the heterogeneity gap that makes it challenging to correlate such heterogeneous data. Generative adversarial networks…

Multimedia · Computer Science 2018-04-27 Yuxin Peng , Jinwei Qi , Yuxin Yuan

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in processing and generating content across multiple data modalities. However, a significant drawback of MLLMs is their reliance on static training data,…

Artificial Intelligence · Computer Science 2024-09-26 Zhanpeng Chen , Chengjin Xu , Yiyan Qi , Jian Guo

The task of entity linking, which involves associating mentions with their respective entities in a knowledge graph, has received significant attention due to its numerous potential applications. Recently, various multimodal entity linking…

Computation and Language · Computer Science 2025-10-06 KM Pooja , Cheng Long , Aixin Sun

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant potential in recommendation systems. However, the effective application of MLLMs to multimodal sequential recommendation remains unexplored: A)…

Information Retrieval · Computer Science 2025-12-25 Haoyu Wang , Yitong Wang , Jining Wang

Existing multi-object image generation methods face difficulties in achieving precise alignment between localized image generation regions and their corresponding semantics based on language descriptions, frequently resulting in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yanfeng Li , Yue Sun , Keren Fu , Sio-Kei Im , Xiaoming Liu , Guangtao Zhai , Xiaohong Liu , Tao Tan