English
Related papers

Related papers: Multimodality Invariant Learning for Multimedia-Ba…

200 papers

The recommender system (RS) has been an integral toolkit of online services. They are equipped with various deep learning techniques to model user preference based on identifier and attribute information. With the emergence of multimedia…

Information Retrieval · Computer Science 2024-09-05 Qidong Liu , Jiaxi Hu , Yutian Xiao , Xiangyu Zhao , Jingtong Gao , Wanyu Wang , Qing Li , Jiliang Tang

A common assumption in multimodal learning is the completeness of training data, i.e., full modalities are available in all training examples. Although there exists research endeavor in developing novel methods to tackle the incompleteness…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Mengmeng Ma , Jian Ren , Long Zhao , Sergey Tulyakov , Cathy Wu , Xi Peng

In this work, we address the problem of learning an ensemble of specialist networks using multimodal data, while considering the realistic and challenging scenario of possible missing modalities at test time. Our goal is to leverage the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Nuno C. Garcia , Sarah Adel Bargal , Vitaly Ablavsky , Pietro Morerio , Vittorio Murino , Stan Sclaroff

Recommender systems must balance personalization, diversity, and robustness to cold-start scenarios to remain effective in dynamic content environments. This paper introduces an adaptive, exploration-based recommendation framework that…

Information Retrieval · Computer Science 2025-03-26 Edoardo Bianchi

Multimodal information (e.g., visual, acoustic, and textual) has been widely used to enhance representation learning for micro-video recommendation. For integrating multimodal information into a joint representation of micro-video,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Han Liu , Yinwei Wei , Fan Liu , Wenjie Wang , Liqiang Nie , Tat-Seng Chua

Multimodal learning seeks to utilize data from multiple sources to improve the overall performance of downstream tasks. It is desirable for redundancies in the data to make multimodal systems robust to missing or corrupted observations in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

Users consume their favorite content in temporal proximity of consumption bundles according to their preferences and tastes. Thus, the underlying attributes of items implicitly match user preferences, however, current recommender systems…

Information Retrieval · Computer Science 2018-10-23 Arun Kumar , Karan Aggarwal , Paul Schrater

Generative recommendation, which directly generates item identifiers, has emerged as a promising paradigm for recommendation systems. However, its potential is fundamentally constrained by the reliance on purely autoregressive training.…

Information Retrieval · Computer Science 2026-04-24 KaiWen Wei , Kejun He , Xiaomian Kang , Jie Zhang , Yuming Yang , Li Jin , Zhenyang Li , Jiang Zhong , He Bai , Junnan Zhu

Multi-language recipe personalisation and recommendation is an under-explored field of information retrieval in academic and production systems. The existing gaps in our current understanding are numerous, even on fundamental questions such…

Information Retrieval · Computer Science 2020-08-19 Niall Twomey , Mikhail Fain , Andrey Ponikar , Nadine Sarraf

Multi-modal sequential recommendation systems leverage auxiliary signals (e.g., text, images) to alleviate data sparsity in user-item interactions. While recent methods exploit large language models to encode modalities into discrete…

Information Retrieval · Computer Science 2025-04-10 Kaiyuan Li , Rui Xiang , Yong Bai , Yongxiang Tang , Yanhua Cheng , Xialong Liu , Peng Jiang , Kun Gai

Sequential recommenders have made great strides in capturing a user's preferences. Nevertheless, the cold-start recommendation remains a fundamental challenge as they typically involve limited user-item interactions for personalization.…

Information Retrieval · Computer Science 2023-08-22 Minchang Kim , Yongjin Yang , Jung Hyun Ryu , Taesup Kim

Traditional recommender systems based on revealed preferences often fail to capture the fundamental duality in user behavior, where consumption choices are driven by both inherent value (enrichment) and instant appeal (temptation).…

Information Retrieval · Computer Science 2025-07-24 Md Sanzeed Anwar , Paramveer S. Dhillon , Grant Schoenebeck

Multimedia recommendation aims to predict users' future behaviors based on observed behaviors and item content information. However, the inherent noise contained in observed behaviors easily leads to suboptimal recommendation performance.…

Information Retrieval · Computer Science 2025-04-15 Jiarui Zhu , Jun Hou , Penghang Yu , Zhiyi Tan , Bing-Kun Bao

Collaborative filtering analyzes user preferences for items (e.g., books, movies, restaurants, academic papers) by exploiting the similarity patterns across users. In implicit feedback settings, all the items, including the ones that a user…

Machine Learning · Statistics 2016-02-05 Dawen Liang , Laurent Charlin , James McInerney , David M. Blei

As a knowledge discovery task over heterogeneous data sources, current Multimodal Affective Computing (MAC) heavily rely on the completeness of multiple modalities to accurately understand human's affective state. However, in real-world…

Artificial Intelligence · Computer Science 2026-02-03 Ronghao Lin , Honghao Lu , Ruixing Wu , Aolin Xiong , Qinggong Chu , Qiaolin He , Sijie Mai , Haifeng Hu

While the mining of modalities is the focus of most multimodal recommendation methods, we believe that how to fully utilize both collaborative and multimodal information is pivotal in e-commerce scenarios where, as clarified in this work,…

Information Retrieval · Computer Science 2024-12-17 Cong Xu , Yunhang He , Jun Wang , Wei Zhang

Imitation learning uses data for training policies to solve complex tasks. However, when the training data is collected from human demonstrators, it often leads to multimodal distributions because of the variability in human actions. Most…

Machine Learning · Computer Science 2023-11-01 Denis Blessing , Onur Celik , Xiaogang Jia , Moritz Reuss , Maximilian Xiling Li , Rudolf Lioutikov , Gerhard Neumann

One key property in recommender systems is the long-tail distribution in user-item interactions where most items only have few user feedback. Improving the recommendation of tail items can promote novelty and bring positive effects to both…

Information Retrieval · Computer Science 2022-10-11 Tieyun Qian , Yile Liang , Qing Li , Xuan Ma , Ke Sun , Zhiyong Peng

Modern web-based platforms show ranked lists of recommendations to users, attempting to maximise user satisfaction or business metrics. Typically, the goal of such systems boils down to maximising the exposure probability for items that are…

Information Retrieval · Computer Science 2023-07-27 Olivier Jeunen

Recommender selects and presents top-K items to the user at each online request, and a recommendation session consists of several sequential requests. Formulating a recommendation session as a Markov decision process and solving it by…

Information Retrieval · Computer Science 2024-05-06 Peilun Zhou , Xiaoxiao Xu , Lantao Hu , Han Li , Peng Jiang