English
Related papers

Related papers: LLM-Enhanced Multimodal Fusion for Cross-Domain Se…

200 papers

This paper addresses the prediction of commercial (brand) memorability as part of "Subtask 2: Commercial/Ad Memorability" within the "Memorability: Predicting movie and commercial memorability" task at the MediaEval 2025 workshop…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Aleksandar Pramov

Large language models (LLMs) have achieved remarkable success across various domains, but effectively incorporating complex and potentially noisy user timeline data into LLMs remains a challenge. Current approaches often involve translating…

Computation and Language · Computer Science 2024-09-11 Lin Ning , Luyang Liu , Jiaxing Wu , Neo Wu , Devora Berlowitz , Sushant Prakash , Bradley Green , Shawn O'Banion , Jun Xie

Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep learning framework that integrates useful clues from…

Multimedia · Computer Science 2017-06-15 Yu-Gang Jiang , Zuxuan Wu , Jinhui Tang , Zechao Li , Xiangyang Xue , Shih-Fu Chang

It is always a challenge for recommender systems to give high-quality outcomes to cold-start users. One potential solution to alleviate the data sparsity problem for cold-start users in the target domain is to add data from the auxiliary…

Information Retrieval · Computer Science 2024-02-06 Yuner Xuan

Combinatorial medication recommendation(CMR) is a fundamental task of healthcare, which offers opportunities for clinical physicians to provide more precise prescriptions for patients with intricate health conditions, particularly in the…

Artificial Intelligence · Computer Science 2025-01-14 Jie Tan , Yu Rong , Kangfei Zhao , Tian Bian , Tingyang Xu , Junzhou Huang , Hong Cheng , Helen Meng

Compared with unimodal data, multimodal data can provide more features to help the model analyze the sentiment of data. Previous research works rarely consider token-level feature fusion, and few works explore learning the common features…

Computation and Language · Computer Science 2022-06-15 Zhen Li , Bing Xu , Conghui Zhu , Tiejun Zhao

We study the problem of inferring substitutable and complementary items, which underpins applications such as alternative and follow-up purchase suggestions. Existing approaches typically learn from behavior-derived item-item associations…

Information Retrieval · Computer Science 2026-05-05 Junting Wang , Chenghuan Guo , Jiao Yang , Yanhui Guo , Hari Sundaram , Yan Gao

Multimodal information (e.g., visual, acoustic, and textual) has been widely used to enhance representation learning for micro-video recommendation. For integrating multimodal information into a joint representation of micro-video,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Han Liu , Yinwei Wei , Fan Liu , Wenjie Wang , Liqiang Nie , Tat-Seng Chua

Collaborative Metric Learning (CML) recently emerged as a powerful paradigm for recommendation based on implicit feedback collaborative filtering. However, standard CML methods learn fixed user and item representations, which fails to…

Information Retrieval · Computer Science 2021-08-11 Viet-Anh Tran , Guillaume Salha-Galvan , Romain Hennequin , Manuel Moussallam

Recommendation systems play a critical role in enhancing user experience and engagement in various online platforms. Traditional methods, such as Collaborative Filtering (CF) and Content-Based Filtering (CBF), rely heavily on past user…

Information Retrieval · Computer Science 2025-01-22 Xiaochuan Xu , Zeqiu Xu , Peiyang Yu , Jiani Wang

Multimodal Large Language Models (MLLMs) have shown remarkable success in comprehension tasks such as visual description and visual question answering. However, their direct application to embedding-based tasks like retrieval remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lihao Liu , Yan Wang , Biao Yang , Da Li , Jiangxia Cao , Yuxiao Luo , Xiang Chen , Xiangyu Wu , Wei Yuan , Fan Yang , Guiguang Ding , Tingting Gao , Guorui Zhou

Recently, there has been growing interest in developing the next-generation recommender systems (RSs) based on pretrained large language models (LLMs). However, the semantic gap between natural language and recommendation tasks is still not…

Information Retrieval · Computer Science 2024-02-23 Yaochen Zhu , Liang Wu , Qi Guo , Liangjie Hong , Jundong Li

Sequential recommendation aims to capture users' dynamic interest and predicts the next item of users' preference. Most sequential recommendation methods use a deep neural network as sequence encoder to generate user and item…

Information Retrieval · Computer Science 2023-05-17 Hanwen Du , Huanhuan Yuan , Pengpeng Zhao , Fuzhen Zhuang , Guanfeng Liu , Lei Zhao , Victor S. Sheng

User-centric recommendation has become essential for delivering personalized services, as it enables systems to adapt to users' evolving behaviors while respecting their long-term preferences and privacy constraints. Although federated…

Information Retrieval · Computer Science 2026-03-19 Chunxu Zhang , Zhiheng Xue , Guodong Long , Weipeng Zhang , Bo Yang

Conventional recommendation systems succeed in identifying relevant content but often fail to provide users with surprising or novel items. Multimodal Large Language Models (MLLMs) possess the world knowledge and multimodal understanding…

Information Retrieval · Computer Science 2025-09-23 Haoting Wang , Jianling Wang , Hao Li , Fangjun Yi , Mengyu Fu , Youwei Zhang , Yifan Liu , Liang Liu , Minmin Chen , Ed H. Chi , Lichan Hong , Haokai Lu

Recommending cold items remains a significant challenge in billion-scale online recommendation systems. While warm items benefit from historical user behaviors, cold items rely solely on content features, limiting their recommendation…

Information Retrieval · Computer Science 2024-12-30 Feiran Huang , Yuanchen Bei , Zhenghang Yang , Junyi Jiang , Hao Chen , Qijie Shen , Senzhang Wang , Fakhri Karray , Philip S. Yu

Multimodal recommender systems leverage diverse data sources, such as user interactions, content features, and contextual information, to address challenges like cold-start and data sparsity. However, existing methods often suffer from one…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

Recommender systems have become an essential component of many online platforms, providing personalized recommendations to users. A crucial aspect is embedding techniques that convert the high-dimensional discrete features, such as user and…

Information Retrieval · Computer Science 2025-10-23 Maolin Wang , Xinjian Zhao , Wanyu Wang , Sheng Zhang , Jiansheng Li , Bowen Yu , Binhao Wang , Shucheng Zhou , Dawei Yin , Qing Li , Ruocheng Guo , Xiangyu Zhao

Finding relevant products given a user query is pivotal to an e-commerce platform, as it can drive shopping behavior and generate revenue. The challenge lies in accurately predicting the correlation between queries and products. Recently,…

Information Retrieval · Computer Science 2026-03-25 Ge Zhang , Rohan Deepak Ajwani , Yaochen Hu , Tony Zheng , Hongjian Gu , Wei Guo , Mark Coates , Yingxue Zhang

The substantial interest in updating Large Language Models (LLMs) without retraining from scratch is accompanied by several challenges. This is particularly true when updating LLMs with datasets that necessitate domain-expert reasoning…

Computation and Language · Computer Science 2024-11-14 Xin Zhang , Tianjie Ju , Huijia Liang , Ying Fu , Qin Zhang