English
Related papers

Related papers: CoPL: Collaborative Preference Learning for Person…

200 papers

The recent surge of versatile large language models (LLMs) largely depends on aligning increasingly capable foundation models with human intentions by preference learning, enhancing LLMs with excellent applicability and effectiveness in a…

Computation and Language · Computer Science 2024-06-19 Ruili Jiang , Kehai Chen , Xuefeng Bai , Zhixuan He , Juntao Li , Muyun Yang , Tiejun Zhao , Liqiang Nie , Min Zhang

Adaptability has been regarded as a central feature in the foundation models, enabling them to effectively acclimate to unseen downstream tasks. Parameter-efficient fine-tuning methods such as celebrated LoRA facilitate efficient adaptation…

Machine Learning · Computer Science 2026-02-10 Gagik Magakyan , Amirhossein Reisizadeh , Chanwoo Park , Pablo A. Parrilo , Asuman Ozdaglar

Current large language models (LLMs) generally show a significant performance gap in alignment between English and other languages. To bridge this gap, existing research typically leverages the model's responses in English as a reference to…

Computation and Language · Computer Science 2025-09-16 Xue Zhang , Yunlong Liang , Fandong Meng , Songming Zhang , Yufeng Chen , Jinan Xu , Jie Zhou

Despite the success of conventional collaborative filtering (CF) approaches for recommendation systems, they exhibit limitations in leveraging semantic knowledge within the textual attributes of users and items. Recent focus on the…

Information Retrieval · Computer Science 2024-08-19 Zhongzhou Liu , Hao Zhang , Kuicai Dong , Yuan Fang

Vision-Language Models (VLMs) have broad potential in privacy-sensitive domains such as healthcare and finance, yet strict data-sharing constraints render centralized training infeasible. Federated Learning mitigates this issue by enabling…

Artificial Intelligence · Computer Science 2026-05-06 Shule Lu , Yujing Wang , Hainan Zhang , Xiaoshan Yang , Hongwei Zheng , Yongxin Tong , Changsheng Xu , Zhiming Zheng

Large language models (LLMs) have achieved remarkable success, yet aligning their generations with human preferences remains a critical challenge. Existing approaches to preference modeling often rely on an explicit or implicit reward…

Computation and Language · Computer Science 2025-05-09 Zhuocheng Gong , Jian Guan , Wei Wu , Huishuai Zhang , Dongyan Zhao

Traditional recommendation systems tend to trap users in strong feedback loops by excessively pushing content aligned with their historical preferences, thereby limiting exploration opportunities and causing content fatigue. Although large…

Information Retrieval · Computer Science 2026-03-05 Hongxiang Lin , Hao Guo , Zeshun Li , Erpeng Xue , Yongqian He , Zhaoyu Hu , Lei Wang , Sheng Chen , Long Zeng

Contrastive learning (CL) recently has spurred a fruitful line of research in the field of recommendation, since its ability to extract self-supervised signals from the raw data is well-aligned with recommender systems' needs for tackling…

Information Retrieval · Computer Science 2022-05-10 Junliang Yu , Hongzhi Yin , Xin Xia , Tong Chen , Lizhen Cui , Quoc Viet Hung Nguyen

Large language models (LLMs) are typically aligned with population-level preferences, despite substantial variation across individual users. We introduce POPI, a user-level personalization framework that separates the problem into two…

Computation and Language · Computer Science 2026-04-28 Yizhuo Chen , Xin Liu , Ruijie Wang , Zheng Li , Pei Chen , Changlong Yu , Qingyu Yin , Priyanka Nigam , Meng Jiang , Bing Yin

Preference learning in Large Language Models (LLMs) has advanced significantly, yet existing methods remain limited by modest performance gains, high computational costs, hyperparameter sensitivity, and insufficient modeling of global…

Computation and Language · Computer Science 2026-04-03 Liang Zhu , Yuelin Bai , Xiankun Ren , Jiaxi Yang , Lei Zhang , Feiteng Fang , Hamid Alinejad-Rokny , Minghuan Tan , Min Yang

Pre-trained vision-language (V-L) models such as CLIP have shown excellent generalization ability to downstream tasks. However, they are sensitive to the choice of input text prompts and require careful selection of prompt templates to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Muhammad Uzair Khattak , Hanoona Rasheed , Muhammad Maaz , Salman Khan , Fahad Shahbaz Khan

Personalized federated learning (FL) facilitates collaborations between multiple clients to learn personalized models without sharing private data. The mechanism mitigates the statistical heterogeneity commonly encountered in the system,…

Machine Learning · Computer Science 2022-09-23 Zichen Ma , Yu Lu , Wenye Li , Shuguang Cui

Human preference alignment is essential to improve the interaction quality of large language models (LLMs). Existing alignment methods depend on manually annotated preference data to guide the LLM optimization directions. However,…

Computation and Language · Computer Science 2024-06-04 Pengyu Cheng , Yifan Yang , Jian Li , Yong Dai , Tianhao Hu , Peixin Cao , Nan Du , Xiaolong Li

What enables large language models (LLMs) to effectively model user preferences in sequential recommendation? Our investigation reveals that existing preference-alignment approaches largely rely on binary pairwise comparisons, overlooking…

Information Retrieval · Computer Science 2026-04-20 Zhongyu Ouyang , Qianlong Wen , Chunhui Zhang , Yanfang Ye , Soroush Vosoughi

Recommender systems are essential for guiding users through the vast and diverse landscape of digital content by delivering personalized and relevant suggestions. However, improving both personalization and interpretability remains a…

Information Retrieval · Computer Science 2025-08-05 Danial Ebrat , Tina Aminian , Sepideh Ahmadian , Luis Rueda

Recommender systems (RSs) are designed to retrieve candidate items a user might be interested in from a large pool. A common approach is using graph neural networks (GNNs) to capture high-order interaction relationships. As large language…

Information Retrieval · Computer Science 2025-06-24 Junze Chen , Xinjie Yang , Cheng Yang , Junfei Bao , Zeyuan Guo , Yawen Li , Chuan Shi

LLMs' remarkable ability to tackle a wide range of language tasks opened new opportunities for collaborative human-AI problem solving. LLMs can amplify human capabilities by applying their intuitions and reasoning strategies at scale. We…

Computation and Language · Computer Science 2025-09-23 Abhishek Sharma , Dan Goldwasser

Personalized alignment is essential for enabling large language models (LLMs) to engage effectively in user-centric dialogue. While recent prompt-based and offline optimization methods offer preliminary solutions, they fall short in…

Computation and Language · Computer Science 2025-12-12 Weixiang Zhao , Xingyu Sui , Yulin Hu , Jiahe Guo , Haixiao Liu , Biye Li , Yanyan Zhao , Bing Qin , Ting Liu

Explainable recommender systems are designed to elucidate the explanation behind each recommendation, enabling users to comprehend the underlying logic. Previous works perform rating prediction and explanation generation in a multi-task…

Information Retrieval · Computer Science 2025-04-09 Shijie Liu , Ruixing Ding , Weihai Lu , Jun Wang , Mo Yu , Xiaoming Shi , Wei Zhang

Leveraging multiple large language models (LLMs) to build collaborative multi-agentic workflows has demonstrated significant potential. However, most previous studies focus on prompting the out-of-the-box LLMs, relying on their innate…

Artificial Intelligence · Computer Science 2025-07-15 Chanwoo Park , Seungju Han , Xingzhi Guo , Asuman Ozdaglar , Kaiqing Zhang , Joo-Kyung Kim