English
Related papers

Related papers: Multimodal Large Language Models with Adaptive Pre…

200 papers

While large language models (LLMs) have proven effective in leveraging textual data for recommendations, their application to multimodal recommendation tasks remains relatively underexplored. Although LLMs can process multimodal information…

Information Retrieval · Computer Science 2025-04-23 Chen Zhang , Bo Hu , Weidong Chen , Zhendong Mao

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across…

Information Retrieval · Computer Science 2023-11-07 Zhenrui Yue , Sara Rabhi , Gabriel de Souza Pereira Moreira , Dong Wang , Even Oldridge

Preference alignment is pivotal for empowering large language models (LLMs) to generate helpful and harmless responses. However, the performance of preference alignment is highly sensitive to the prevalent noise in the preference data.…

Machine Learning · Computer Science 2024-05-29 Xize Liang , Chao Chen , Shuang Qiu , Jie Wang , Yue Wu , Zhihang Fu , Zhihao Shi , Feng Wu , Jieping Ye

For aligning large language models (LLMs), prior work has leveraged reinforcement learning via human feedback (RLHF) or variations of direct preference optimization (DPO). While DPO offers a simpler framework based on maximum likelihood…

Artificial Intelligence · Computer Science 2025-05-27 Anirudhan Badrinath , Prabhat Agarwal , Jiajing Xu

Contemporary generative recommendation systems face significant challenges in handling multimodal data, eliminating algorithmic biases, and providing transparent decision-making processes. This paper introduces an enhanced generative…

Information Retrieval · Computer Science 2025-10-03 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Lau

Conventional recommendation methods have achieved notable advancements by harnessing collaborative or sequential information from user behavior. Recently, large language models (LLMs) have gained prominence for their capabilities in…

Information Retrieval · Computer Science 2026-01-21 Sichun Luo , Yuxuan Yao , Bowei He , Wei Shao , Jian Xu , Yinya Huang , Aojun Zhou , Xinyi Zhang , Yuanzhang Xiao , Hanxu Hou , Mingjie Zhan , Linqi Song

Multimodal Large Language Models (MLLMs) excel in generating responses based on visual inputs. However, they often suffer from a bias towards generating responses similar to their pretraining corpus, overshadowing the importance of visual…

Computation and Language · Computer Science 2024-04-04 Renjie Pi , Tianyang Han , Wei Xiong , Jipeng Zhang , Runtao Liu , Rui Pan , Tong Zhang

Direct preference optimization (DPO) has shown to be an effective method for large language model (LLM) alignment. Recent works have attempted to apply DPO to multimodal scenarios but have found it challenging to achieve consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Fei Wang , Wenxuan Zhou , James Y. Huang , Nan Xu , Sheng Zhang , Hoifung Poon , Muhao Chen

Large Language Models (LLMs) acquire extensive knowledge and remarkable abilities from extensive text corpora, making them powerful tools for various applications. To make LLMs more usable, aligning them with human preferences is essential.…

Computation and Language · Computer Science 2024-10-21 Mozhi Zhang , Pengyu Wang , Chenkun Tan , Mianqiu Huang , Dong Zhang , Yaqian Zhou , Xipeng Qiu

The successful integration of large language models (LLMs) into recommendation systems has proven to be a major breakthrough in recent studies, paving the way for more generic and transferable recommendations. However, LLMs struggle to…

Information Retrieval · Computer Science 2023-11-29 Junyan Qiu , Haitao Wang , Zhaolin Hong , Yiping Yang , Qiang Liu , Xingxing Wang

Implicit feedback, often used to build recommender systems, unavoidably confronts noise due to factors such as misclicks and position bias. Previous studies have attempted to alleviate this by identifying noisy samples based on their…

Information Retrieval · Computer Science 2024-09-17 Tianrui Song , Wenshuo Chao , Hao Liu

Post-training alignment of large language models (LLMs) is a critical challenge, as not all tokens contribute equally to model performance. This paper introduces a selective alignment strategy that prioritizes high-impact tokens within…

Computation and Language · Computer Science 2025-07-11 Zhijin Dong

Traditional recommender systems such as matrix factorization methods have primarily focused on learning a shared dense embedding space to represent both items and user preferences. Subsequently, sequence models such as RNN, GRUs, and,…

Information Retrieval · Computer Science 2024-08-27 Yaoyiran Li , Xiang Zhai , Moustafa Alzantot , Keyi Yu , Ivan Vulić , Anna Korhonen , Mohamed Hammad

The task adaptation and alignment of Large Multimodal Models (LMMs) have been significantly advanced by instruction tuning and further strengthened by recent preference optimization. Yet, most LMMs still suffer from severe modality…

Machine Learning · Computer Science 2025-10-10 Chenxi Liu , Tianyi Xiong , Yanshuo Chen , Ruibo Chen , Yihan Wu , Junfeng Guo , Tianyi Zhou , Heng Huang

Large Language Models (LLMs) have achieved remarkable success in various fields, prompting several studies to explore their potential in recommendation systems. However, these attempts have so far resulted in only modest improvements over…

Information Retrieval · Computer Science 2024-09-20 Junyi Chen , Lu Chi , Bingyue Peng , Zehuan Yuan

We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhancing recommender systems with logical reasoning abilities…

Information Retrieval · Computer Science 2024-08-13 Jiachen Zhu , Jianghao Lin , Xinyi Dai , Bo Chen , Rong Shan , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

Modern recommender systems struggle to effectively utilize the rich, yet high-dimensional and noisy, multi-modal features generated by Large Language Models (LLMs). Treating these features as static inputs decouples them from the core…

Information Retrieval · Computer Science 2025-12-02 Jiahao Tian , Zhenkai Wang

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Text-based recommendation holds a wide range of practical applications due to its versatility, as textual descriptions can represent nearly any type of item. However, directly employing the original item descriptions may not yield optimal…

Computation and Language · Computer Science 2024-04-03 Hanjia Lyu , Song Jiang , Hanqing Zeng , Yinglong Xia , Qifan Wang , Si Zhang , Ren Chen , Christopher Leung , Jiajie Tang , Jiebo Luo

It is crucial for large language models (LLMs) to follow instructions that involve multiple constraints. However, it is an unexplored area to enhance LLMs' ability to follow soft constraints. To bridge the gap, we initially design a…

Computation and Language · Computer Science 2025-06-03 Qingyu Ren , Jie Zeng , Qianyu He , Jiaqing Liang , Yanghua Xiao , Weikang Zhou , Zeye Sun , Fei Yu