English
Related papers

Related papers: Multimodal Large Language Models with Adaptive Pre…

200 papers

Recommender systems are critical for delivering personalized content across digital platforms, and recent advances in Large Language Models (LLMs) offer new opportunities to enhance them with richer world knowledge and explicit reasoning…

Information Retrieval · Computer Science 2026-05-22 Jingtong Gao , Zeyu Song , Chi Lu , Xiaopeng Li , Derong Xu , Maolin Wang , Peng Jiang , Kun Gai , Qingpeng Cai , Xiangyu Zhao

Vision-language alignment in multi-modal large language models (MLLMs) relies on supervised fine-tuning (SFT) or reinforcement learning (RL). To align multi-modal large language models (MLLMs) in the post-training stage, supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xin Jin , Siyuan Li , Siyong Jian , Kai Yu , Huan Wang

Despite large language models' (LLMs) recent advancements, their bias and hallucination issues persist, and their ability to offer consistent preferential rankings remains underexplored. This study investigates the capacity of LLMs to…

Computation and Language · Computer Science 2024-10-14 Xiutian Zhao , Ke Wang , Wei Peng

Recommender systems are essential for delivering personalized content across digital platforms by modeling user preferences and behaviors. Recently, large language models (LLMs) have been adopted for prompt-based recommendation due to their…

Information Retrieval · Computer Science 2025-05-28 Md Aminul Islam , Ahmed Sayeed Faruk

Despite the success of conventional collaborative filtering (CF) approaches for recommendation systems, they exhibit limitations in leveraging semantic knowledge within the textual attributes of users and items. Recent focus on the…

Information Retrieval · Computer Science 2024-08-19 Zhongzhou Liu , Hao Zhang , Kuicai Dong , Yuan Fang

Modern recommender systems face critical challenges in handling information overload while addressing the inherent limitations of multimodal representation learning. Existing methods suffer from three fundamental limitations: (1) restricted…

Information Retrieval · Computer Science 2025-08-15 Zheyu Chen , Jinfeng Xu , Hewei Wang , Shuo Yang , Zitong Wan , Haibo Hu

Large Language Models (LLMs) have demonstrated remarkable capabilities and have been extensively deployed across various domains, including recommender systems. Prior research has employed specialized \textit{prompts} to leverage the…

Information Retrieval · Computer Science 2024-04-02 Sichun Luo , Bowei He , Haohan Zhao , Wei Shao , Yanlin Qi , Yinya Huang , Aojun Zhou , Yuxuan Yao , Zongpeng Li , Yuanzhang Xiao , Mingjie Zhan , Linqi Song

Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains, thereby prompting researchers to explore their potential for use in recommendation systems. Initial attempts have leveraged the exceptional…

Information Retrieval · Computer Science 2023-10-18 Keqin Bao , Jizhi Zhang , Yang Zhang , Wenjie Wang , Fuli Feng , Xiangnan He

Large Visual Language Models (LVLMs) have demonstrated impressive capabilities across multiple tasks. However, their trustworthiness is often challenged by hallucinations, which can be attributed to the modality misalignment and the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Jiulong Wu , Zhengliang Shi , Shuaiqiang Wang , Jizhou Huang , Dawei Yin , Lingyong Yan , Min Cao , Min Zhang

Recently, there has been significant interest in replacing the reward model in Reinforcement Learning with Human Feedback (RLHF) methods for Large Language Models (LLMs), such as Direct Preference Optimization (DPO) and its variants. These…

Computation and Language · Computer Science 2024-09-27 Jian Li , Haojing Huang , Yujia Zhang , Pengfei Xu , Xi Chen , Rui Song , Lida Shi , Jingwen Wang , Hao Xu

Recommendation systems leverage user interaction data to suggest relevant items while filtering out irrelevant (negative) ones. The rise of large language models (LLMs) has garnered increasing attention for their potential in recommendation…

Information Retrieval · Computer Science 2025-08-14 Chenlu Ding , Daoxuan Liu , Jiancan Wu , Xingyu Hu , Junkang Wu , Haitao Wang , Yongkang Wang , Xingxing Wang , Xiang Wang

Generating user-friendly explanations regarding why an item is recommended has become increasingly common, largely due to advances in language generation technology, which can enhance user trust and facilitate more informed decision-making…

Information Retrieval · Computer Science 2024-01-04 Yucong Luo , Mingyue Cheng , Hao Zhang , Junyu Lu , Qi Liu , Enhong Chen

Large language models (LLMs) fine-tuned with alignment techniques, such as reinforcement learning from human feedback, have been instrumental in developing some of the most capable AI systems to date. Despite their success, existing methods…

Computation and Language · Computer Science 2025-07-01 Kyuyoung Kim , Ah Jeong Seo , Hao Liu , Jinwoo Shin , Kimin Lee

Adapting Large Language Models for Recommendation (LLM4Rec) has shown promising results. However, the challenges of deploying LLM4Rec in real-world scenarios remain largely unexplored. In particular, recommender models need incremental…

Information Retrieval · Computer Science 2024-07-31 Tianhao Shi , Yang Zhang , Zhijian Xu , Chong Chen , Fuli Feng , Xiangnan He , Qi Tian

Human preference alignment can greatly enhance Multimodal Large Language Models (MLLMs), but collecting high-quality preference data is costly. A promising solution is the self-evolution strategy, where models are iteratively trained on…

Machine Learning · Computer Science 2024-12-23 Wentao Tan , Qiong Cao , Yibing Zhan , Chao Xue , Changxing Ding

While Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, aligning these models with varying human preferences across multiple objectives remains a significant challenge…

Computation and Language · Computer Science 2025-11-17 Biao Liu , Ning Xu , Junming Yang , Xin Geng

Researchers have been studying approaches to steer the behavior of Large Language Models (LLMs) and build personalized LLMs tailored for various applications. While fine-tuning seems to be a direct solution, it requires substantial…

Computation and Language · Computer Science 2024-07-31 Yuanpu Cao , Tianrong Zhang , Bochuan Cao , Ziyi Yin , Lu Lin , Fenglong Ma , Jinghui Chen

Enhancing the conformity of large language models (LLMs) to human preferences remains an ongoing research challenge. Recently, offline approaches such as Direct Preference Optimization (DPO) have gained prominence as attractive options due…

Machine Learning · Computer Science 2024-09-05 Kaihui Chen , Hao Yi , Qingyang Li , Tianyu Qi , Yulan Hu , Fuzheng Zhang , Yong Liu

Alignment of large language models (LLMs) has predominantly relied on pairwise preference optimization, where annotators select the better of two responses to a prompt. While simple, this approach overlooks the opportunity to learn from…

Machine Learning · Computer Science 2026-02-11 Yuxuan Tang , Yifan Feng

Existing alignment methods for preference optimization of large language models (LLMs) aim to enhance model performance by utilizing pairs of positive and negative samples. However, due to the limited capacity of models in scoring or…

Computation and Language · Computer Science 2025-09-30 Jun Rao , Yunjie Liao , Xuebo Liu , Zepeng Lin , Lian Lian , Dong Jin , Shengjun Cheng , Jun Yu , Min Zhang