中文
相关论文

相关论文: LTP-MMF: Towards Long-term Provider Max-min Fairne…

200 篇论文

Large Language Models (LLMs) increasingly rely on Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF) to align model responses with human preferences. While RLHF employs a reinforcement learning approach with…

人机交互 · 计算机科学 2025-06-05 Alex Sotiropoulos , Sulyab Thottungal Valapu , Linus Lei , Jared Coleman , Bhaskar Krishnamachari

Popularity bias is a well-known phenomenon in recommender systems: popular items are recommended even more frequently than their popularity would warrant, amplifying long-tail effects already present in many recommendation domains. Prior…

信息检索 · 计算机科学 2020-07-27 Himan Abdollahpouri , Masoud Mansoury , Robin Burke , Bamshad Mobasher

In the era of information explosion, numerous items emerge every day, especially in feed scenarios. Due to the limited system display slots and user browsing attention, various recommendation systems are designed not only to satisfy users'…

信息检索 · 计算机科学 2023-07-18 Jiayin Wang , Weizhi Ma , Chumeng Jiang , Min Zhang , Yuan Zhang , Biao Li , Peng Jiang

Reinforcement learning from human feedback (RLHF) has emerged as a powerful technique to make large language models (LLMs) more capable in complex settings. RLHF proceeds as collecting human preference data, training a reward model on said…

机器学习 · 计算机科学 2024-02-05 Nathan Lambert , Roberto Calandra

Recommender systems learn from historical users' feedback that is often non-uniformly distributed across items. As a consequence, these systems may end up suggesting popular items more than niche items progressively, even when the latter…

信息检索 · 计算机科学 2020-10-06 Ludovico Boratto , Gianni Fenu , Mirko Marras

Reinforcement Learning from Human Feedback (RLHF) is a pivotal technique for aligning large language models (LLMs) with human preferences, yet it is susceptible to reward overoptimization, in which policy models overfit to the reward model,…

Typical recommendation and ranking methods aim to optimize the satisfaction of users, but they are often oblivious to their impact on the items (e.g., products, jobs, news, video) and their providers. However, there has been a growing…

信息检索 · 计算机科学 2024-02-23 Riku Togashi , Kenshi Abe , Yuta Saito

Large Language Models (LLMs) are increasingly used for recommendation tasks due to their general-purpose capabilities. While LLMs perform well in rich-context settings, their behavior in cold-start scenarios, where only limited signals such…

信息检索 · 计算机科学 2025-09-09 Alexandre Andre , Gauthier Roy , Eva Dyer , Kai Wang

Reinforcement Learning algorithms that learn from human feedback (RLHF) need to be efficient in terms of statistical complexity, computational complexity, and query complexity. In this work, we consider the RLHF setting where the feedback…

机器学习 · 计算机科学 2024-03-14 Runzhe Wu , Wen Sun

How can we build recommender systems to take into account fairness? Real-world recommender systems are often composed of multiple models, built by multiple teams. However, most research on fairness focuses on improving fairness in a single…

机器学习 · 计算机科学 2021-01-27 Xuezhi Wang , Nithum Thain , Anu Sinha , Flavien Prost , Ed H. Chi , Jilin Chen , Alex Beutel

In classic reinforcement learning (RL) and decision making problems, policies are evaluated with respect to a scalar reward function, and all optimal policies are the same with regards to their expected return. However, many real-world…

机器学习 · 计算机科学 2023-11-02 Han Shao , Lee Cohen , Avrim Blum , Yishay Mansour , Aadirupa Saha , Matthew R. Walter

Dynamic max-min fair allocation (DMMF) is a simple and popular mechanism for the repeated allocation of a shared resource among competing agents: in each round, each agent can choose to request or not for the resource, which is then…

计算机科学与博弈论 · 计算机科学 2025-01-28 Chido Onyeze , Siddhartha Banerjee , Giannis Fikioris , Éva Tardos

Large language models (LLMs) have emerged as a cutting-edge approach in sequential recommendation, leveraging historical interactions to model dynamic user preferences. Current methods mainly focus on learning processed recommendation data…

信息检索 · 计算机科学 2025-07-15 Weicong Qin , Yi Xu , Weijie Yu , Chenglei Shen , Xiao Zhang , Ming He , Jianping Fan , Jun Xu

Personalizing large language models (LLMs) to accommodate diverse user preferences is essential for enhancing alignment and user satisfaction. Traditional reinforcement learning from human feedback (RLHF) approaches often rely on monolithic…

机器学习 · 计算机科学 2025-04-22 Avinandan Bose , Zhihan Xiong , Yuejie Chi , Simon Shaolei Du , Lin Xiao , Maryam Fazel

The rapid expansion of AI research has intensified the Reviewer Gap, threatening the peer-review sustainability and perpetuating a cycle of low-quality evaluations. This position paper critiques existing LLM approaches that automatically…

人工智能 · 计算机科学 2026-01-15 JungMin Yun , JuneHyoung Kwon , MiHyeon Kim , YoungBin Kim

Modern quantitative trading increasingly relies on systematic models to extract predictive signals from large-scale financial data, where alpha factor discovery plays a central role in transforming market observations into tradable signals.…

计算工程、金融与科学 · 计算机科学 2026-05-18 Lingzhe Zhang , Tong Jia , Yunpeng Zhai , Zixuan Xie , Chiming Duan , Minghua He , Philip S. Yu , Ying Li

Federated recommender systems have distinct advantages in terms of privacy protection over traditional recommender systems that are centralized at a data center. However, previous work on federated recommender systems does not fully…

信息检索 · 计算机科学 2023-03-07 Yujie Lin , Pengjie Ren , Zhumin Chen , Zhaochun Ren , Dongxiao Yu , Jun Ma , Maarten de Rijke , Xiuzhen Cheng

Federated recommender system (FRS), which enables many local devices to train a shared model jointly without transmitting local raw data, has become a prevalent recommendation paradigm with privacy-preserving advantages. However, previous…

信息检索 · 计算机科学 2022-12-27 Honglei Zhang , Fangyuan Luo , Jun Wu , Xiangnan He , Yidong Li

Uniform-reward reinforcement learning from human feedback (RLHF), which trains a single reward model to represent the preferences of all annotators, fails to capture the diversity of opinions across sub-populations, inadvertently favoring…

机器学习 · 计算机科学 2025-09-05 Arpan Mukherjee , Marcello Bullo , Deniz Gündüz

There has been significant research in the last five years on ensuring the providers of items in a recommender system are treated fairly, particularly in terms of the exposure the system provides to their work through its results. However,…

信息检索 · 计算机科学 2023-09-20 Amifa Raj , Michael D. Ekstrand