English
Related papers

Related papers: Harmonizing Large Language Models with Collaborati…

200 papers

Learning from preference feedback is essential for aligning large language models (LLMs) with human values and improving the quality of generated responses. However, existing preference learning methods rely heavily on curated data from…

Computation and Language · Computer Science 2025-06-06 Zhaoxuan Tan , Zheng Li , Tianyi Liu , Haodong Wang , Hyokun Yun , Ming Zeng , Pei Chen , Zhihan Zhang , Yifan Gao , Ruijie Wang , Priyanka Nigam , Bing Yin , Meng Jiang

As users often express their preferences with binary behavior data~(implicit feedback), such as clicking items or buying products, implicit feedback based Collaborative Filtering~(CF) models predict the top ranked items a user might like by…

Information Retrieval · Computer Science 2021-05-27 Lei Chen , Le Wu , Kun Zhang , Richang Hong , Meng Wang

While personalized recommender systems excel at content discovery, they frequently expose users to undesirable or discomforting information, highlighting the critical need for user-centric filtering tools. Current methods leveraging Large…

Information Retrieval · Computer Science 2026-04-21 Chi Zhang , Zhipeng Xu , Jiahao Liu , Dongsheng Li , Hansu Gu , Peng Zhang , Ning Gu , Tun Lu

Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable,…

Information Retrieval · Computer Science 2024-08-06 Wensheng Lu , Jianxun Lian , Wei Zhang , Guanghua Li , Mingyang Zhou , Hao Liao , Xing Xie

Previous work has showcased the intriguing capabilities of Large Language Models (LLMs) in instruction-following and rhetorical fluency. However, systematic exploration of their dual capabilities to autonomously persuade and resist…

Computation and Language · Computer Science 2025-06-10 Tianjie Ju , Yujia Chen , Hao Fei , Mong-Li Lee , Wynne Hsu , Pengzhou Cheng , Zongru Wu , Zhuosheng Zhang , Gongshen Liu

Large Language Models (LLMs) excel in various tasks, including personalized recommendations. Existing evaluation methods often focus on rating prediction, relying on regression errors between actual and predicted ratings. However, user…

Computation and Language · Computer Science 2025-01-24 Zhaoxuan Tan , Zinan Zeng , Qingkai Zeng , Zhenyu Wu , Zheyuan Liu , Fengran Mo , Meng Jiang

Large language models (LLMs) have demonstrated remarkable capabilities in handling complex dialogue tasks without requiring use case-specific fine-tuning. However, analyzing live dialogues in real-time necessitates low-latency processing…

Computation and Language · Computer Science 2025-03-10 Xuanqing Liu , Luyang Kong , Wei Niu , Afshin Khashei , Belinda Zeng , Steve Johnson , Jon Jay , Davor Golac , Matt Pope

A common technique for aligning large language models (LLMs) relies on acquiring human preferences by comparing multiple generations conditioned on a fixed context. This method, however, relies solely on pairwise comparisons, where the…

Computation and Language · Computer Science 2025-01-09 Hritik Bansal , Ashima Suvarna , Gantavya Bhatt , Nanyun Peng , Kai-Wei Chang , Aditya Grover

Reinforcement Learning frameworks, particularly those utilizing human annotations, have become an increasingly popular method for preference fine-tuning, where the outputs of a language model are tuned to match a certain set of behavioral…

Machine Learning · Computer Science 2025-10-21 Archie Chaudhury

Recommender systems are important to help users select relevant and personalised information over massive amounts of data available. We propose an unified framework called Preference Network (PN) that jointly models various types of domain…

Information Retrieval · Computer Science 2014-07-23 Tran The Truyen , Dinh Q. Phung , Svetha Venkatesh

Recommender Systems have proliferated as general-purpose approaches to model a wide variety of consumer interaction data. Specific instances make use of signals ranging from user feedback, item relationships, geographic locality, social…

Information Retrieval · Computer Science 2018-08-31 Wang-Cheng Kang , Mengting Wan , Julian McAuley

Collaborative filtering is the most popular approach for recommender systems. One way to perform collaborative filtering is matrix factorization, which characterizes user preferences and item attributes using latent vectors. These latent…

Information Retrieval · Computer Science 2018-05-15 ThaiBinh Nguyen , Kenro Aihara , Atsuhiro Takasu

Large language model alignment is widely used and studied to avoid LLM producing unhelpful and harmful responses. However, the lengthy training process and predefined preference bias hinder adaptation to online diverse human preferences. To…

Computation and Language · Computer Science 2024-05-02 Guanying Jiang , Lingyong Yan , Haibo Shi , Dawei Yin

Actively inferring user preferences, for example by asking good questions, is important for any human-facing decision-making system. Active inference allows such systems to adapt and personalize themselves to nuanced individual preferences.…

Computation and Language · Computer Science 2024-06-27 Wasu Top Piriyakulkij , Volodymyr Kuleshov , Kevin Ellis

In aligning large language models (LLMs), utilizing feedback from existing advanced AI rather than humans is an important method to scale supervisory signals. However, it is highly challenging for AI to understand human intentions and…

Computation and Language · Computer Science 2024-06-18 Rong Bao , Rui Zheng , Shihan Dou , Xiao Wang , Enyu Zhou , Bo Wang , Qi Zhang , Liang Ding , Dacheng Tao

Traditional survey-based political issue polling is becoming less tractable due to increasing costs and risk of bias associated with growing non-response rates and declining coverage of key demographic groups. With researchers and pollsters…

Computers and Society · Computer Science 2026-03-24 Eric Gong , Nathan E. Sanders , Bruce Schneier

Learning from human preferences is important for language models to match human needs and to align with human and social values. Prior works have achieved remarkable successes by learning from human feedback to understand and follow…

Machine Learning · Computer Science 2023-10-19 Hao Liu , Carmelo Sferrazza , Pieter Abbeel

Real-world recommendation systems commonly offer diverse content scenarios for users to interact with. Considering the enormous number of users in industrial platforms, it is infeasible to utilize a single unified recommendation model to…

Information Retrieval · Computer Science 2024-12-10 Chonggang Song , Chunxu Shen , Hao Gu , Yaoming Wu , Lingling Yi , Jie Wen , Chuan Chen

Latent Factor Model (LFM) is one of the most successful methods for Collaborative filtering (CF) in the recommendation system, in which both users and items are projected into a joint latent factor space. Base on matrix factorization…

Information Retrieval · Computer Science 2021-05-19 Jiansheng Fang , Xiaoqing Zhang , Yan Hu , Yanwu Xu , Ming Yang , Jiang Liu

Current Large Language Models (LLMs) excel in general reasoning yet struggle with specialized tasks requiring proprietary or domain-specific knowledge. Fine-tuning large models for every niche application is often infeasible due to…

Artificial Intelligence · Computer Science 2025-04-23 Yizhu Jiao , Xuchao Zhang , Zhaoyang Wang , Yubo Ma , Zhun Deng , Rujia Wang , Chetan Bansal , Saravan Rajmohan , Jiawei Han , Huaxiu Yao
‹ Prev 1 3 4 5 6 7 10 Next ›