English
Related papers

Related papers: Post-Training Denoising of User Profiles with LLMs…

200 papers

The correct specification of reward models is a well-known challenge in reinforcement learning. Hand-crafted reward functions often lead to inefficient or suboptimal policies and may not be aligned with user values. Reinforcement learning…

Artificial Intelligence · Computer Science 2024-10-24 Muhan Lin , Shuyang Shi , Yue Guo , Behdad Chalaki , Vaishnav Tadiparthi , Ehsan Moradi Pari , Simon Stepputtis , Joseph Campbell , Katia Sycara

Sequential recommender systems (SRSs) aim to suggest next item for a user based on her historical interaction sequences. Recently, many research efforts have been devoted to attenuate the influence of noisy items in sequences by either…

Information Retrieval · Computer Science 2024-06-21 Xiaofei Zhu , Liang Li , Weidong Liu , Xin Luo

Lack of training data presents a grand challenge to scaling out spoken language understanding (SLU) to low-resource languages. Although various data augmentation approaches have been proposed to synthesize training data in low-resource…

Computation and Language · Computer Science 2021-09-06 Yingmei Guo , Linjun Shou , Jian Pei , Ming Gong , Mingxing Xu , Zhiyong Wu , Daxin Jiang

Recent advances in large language models (LLMs) have yielded impressive performance on various tasks, yet they often depend on high-quality feedback that can be costly. Self-refinement methods attempt to leverage LLMs' internal evaluation…

Computation and Language · Computer Science 2025-12-01 Hikaru Asano , Tadashi Kozuno , Yukino Baba

The surge in multimedia content has led to the development of Multi-Modal Recommender Systems (MMRecs), which use diverse modalities such as text, images, videos, and audio for more personalized recommendations. However, MMRecs struggle…

Information Retrieval · Computer Science 2025-04-22 Hongji Li , Hanwen Du , Youhua Li , Junchen Fu , Chunxiao Li , Ziyi Zhuang , Jiakang Li , Yongxin Ni

As powerful tools in Natural Language Processing (NLP), Large Language Models (LLMs) have been leveraged for crafting recommendations to achieve precise alignment with user preferences and elevate the quality of the recommendations. The…

Information Retrieval · Computer Science 2025-10-20 Zhisheng Yang , Xiaofei Xu , Ke Deng , Li Li

The significant advancements in large language models (LLMs) give rise to a promising research direction, i.e., leveraging LLMs as recommenders (LLMRec). The efficacy of LLMRec arises from the open-world knowledge and reasoning capabilities…

Information Retrieval · Computer Science 2024-07-02 Hangyu Wang , Jianghao Lin , Bo Chen , Yang Yang , Ruiming Tang , Weinan Zhang , Yong Yu

For better user satisfaction and business effectiveness, more and more attention has been paid to the sequence-based recommendation system, which is used to infer the evolution of users' dynamic preferences, and recent studies have noticed…

Information Retrieval · Computer Science 2021-07-15 Zhi Bian , Shaojun Zhou , Hao Fu , Qihong Yang , Zhenqi Sun , Junjie Tang , Guiquan Liu , Kaikui Liu , Xiaolong Li

Instruction-following has emerged as a crucial capability for large language models (LLMs). However, existing approaches often rely on pre-existing documents or external resources to synthesize instruction-following data, which limits their…

Computation and Language · Computer Science 2025-06-12 Tingfeng Hui , Pengyu Zhu , Bowen Ping , Ling Tang , Guanting Dong , Yaqi Zhang , Sen Su

Multi-modal recommender systems (MRSs) are pivotal in diverse online web platforms and have garnered considerable attention in recent years. However, previous studies overlook the challenges of (1) noisy multi-modal content, (2) noisy user…

Information Retrieval · Computer Science 2025-04-03 Guipeng Xv , Xinyu Li , Ruobing Xie , Chen Lin , Chong Liu , Feng Xia , Zhanhui Kang , Leyu Lin

Code review is an important practice in software development, yet it is time-consuming and requires substantial effort. While open-source datasets have been used to train neural models for automating code review tasks, including review…

Software Engineering · Computer Science 2025-02-07 Chunhua Liu , Hong Yi Lin , Patanamon Thongtanunam

Mitigating social bias in large language models (LLMs) has become an increasingly important research objective. However, existing debiasing methods often incur high human and computational costs, exhibit limited effectiveness, and struggle…

Computation and Language · Computer Science 2025-06-02 Xiaoqing Cheng , Ruizhe Chen , Hongying Zan , Yuxiang Jia , Min Peng

Understanding what users like is relatively straightforward; understanding what users dislike, however, remains a challenging and underexplored problem. Research into users' negative preferences has gained increasing importance in modern…

Information Retrieval · Computer Science 2026-01-23 Xinda Chen , Jiawei Wu , Yishuang Liu , Jialin Zhu , Shuwen Xiao , Junjun Zheng , Xiangheng Kong , Yuning Jiang

Current techniques for post-training Large Language Models (LLMs) rely either on costly human supervision or on external verifiers to boost performance on tasks such as mathematical reasoning and code generation. However, as LLMs improve…

Computation and Language · Computer Science 2026-01-21 Mukesh Ghimire , Aosong Feng , Liwen You , Youzhi Luo , Fang Liu , Xuan Zhu

The problem of data sparsity has long been a challenge in recommendation systems, and previous studies have attempted to address this issue by incorporating side information. However, this approach often introduces side effects such as…

Information Retrieval · Computer Science 2024-01-09 Wei Wei , Xubin Ren , Jiabin Tang , Qinyong Wang , Lixin Su , Suqi Cheng , Junfeng Wang , Dawei Yin , Chao Huang

Large Language Models (LLMs) have demonstrated remarkable capabilities in open-ended text generation tasks. However, the inherent open-ended nature of these tasks implies that there is always room for improvement in the quality of model…

Computation and Language · Computer Science 2024-09-16 Ziqi Wang , Le Hou , Tianjian Lu , Yuexin Wu , Yunxuan Li , Hongkun Yu , Heng Ji

Recommender systems (RecSys) have become critical tools for enhancing user engagement by delivering personalized content across diverse digital platforms. Recent advancements in large language models (LLMs) demonstrate significant potential…

Information Retrieval · Computer Science 2025-10-16 Yi Zhang , Lili Xie , Ruihong Qiu , Jiajun Liu , Sen Wang

News recommendation is different from movie or e-commercial recommendation as people usually do not grade the news. Therefore, user feedback for news is always implicit (click behavior, reading time, etc). Inevitably, there are noises in…

Information Retrieval · Computer Science 2022-04-12 Yunfan Hu , Zhaopeng Qiu , Xian Wu

A long-standing challenge in developing accurate recommendation models is simulating user behavior, mainly due to the complex and stochastic nature of user interactions. Towards this, one promising line of work has been the use of Large…

Information Retrieval · Computer Science 2025-09-15 Himanshu Thakur , Eshani Agrawal , Smruthi Mukund

As LLMs become more widely deployed, there is increasing interest in directly optimizing for feedback from end users (e.g. thumbs up) in addition to feedback from paid annotators. However, training to maximize human feedback creates a…

Machine Learning · Computer Science 2025-02-25 Marcus Williams , Micah Carroll , Adhyyan Narang , Constantin Weisser , Brendan Murphy , Anca Dragan