中文
相关论文

相关论文: Response Time Enhances Alignment with Heterogeneou…

200 篇论文

Reinforcement learning with human feedback (RLHF) fine-tunes a pretrained large language model (LLM) using user preference data, enabling it to generate content aligned with human preferences. However, due to privacy concerns, users may be…

计算与语言 · 计算机科学 2025-04-10 Feijie Wu , Xiaoze Liu , Haoyu Wang , Xingchen Wang , Lu Su , Jing Gao

Recent advances in large language models have highlighted their potential for personalized recommendation, where accurately capturing user preferences remains a key challenge. Leveraging their strong reasoning and generalization…

The fluency and creativity of large pre-trained language models (LLMs) have led to their widespread use, sometimes even as a replacement for traditional search engines. Yet language models are prone to making convincing but factually…

计算与语言 · 计算机科学 2023-11-15 Katherine Tian , Eric Mitchell , Huaxiu Yao , Christopher D. Manning , Chelsea Finn

A key challenge in many modern data analysis tasks is that user data are heterogeneous. Different users may possess vastly different numbers of data points. More importantly, it cannot be assumed that all users sample from the same…

密码学与安全 · 计算机科学 2023-08-01 Rachel Cummings , Vitaly Feldman , Audra McMillan , Kunal Talwar

Heterogeneous sequential recommendation (HSR) aims to learn dynamic behavior dependencies from the diverse behaviors of user-item interactions to facilitate precise sequential recommendation. Despite many efforts yielding promising…

信息检索 · 计算机科学 2026-04-17 Jing Xiao , Dongqi Wu , Liwei Pan , Yawen Luo , Weike Pan , Zhong Ming

In the absence of abundant reliable annotations for challenging tasks and contexts, how can we expand the frontier of LLM capabilities with potentially wrong answers? We focus on two research questions: (1) Can LLMs generate reliable…

计算与语言 · 计算机科学 2024-10-16 Jihan Yao , Wenxuan Ding , Shangbin Feng , Lucy Lu Wang , Yulia Tsvetkov

Relevance labels, which indicate whether a search result is valuable to a searcher, are key to evaluating and optimising search systems. The best way to capture the true preferences of users is to ask them for their careful feedback on…

信息检索 · 计算机科学 2024-05-20 Paul Thomas , Seth Spielman , Nick Craswell , Bhaskar Mitra

Evaluating the performance of large language models (LLMs) from human preference data is crucial for obtaining LLM leaderboards. However, many existing approaches either rely on restrictive parametric assumptions or lack valid uncertainty…

机器学习 · 计算机科学 2026-01-30 Dennis Frauen , Athiya Deviyani , Mihaela van der Schaar , Stefan Feuerriegel

The recent advancements in Large Language Models (LLMs) have generated considerable interest in their utilization for sequential recommendation tasks. While collaborative signals from similar users are central to recommendation modeling,…

信息检索 · 计算机科学 2025-04-15 Tong Zhang

Diffusion-based Large Language Models (D-LLMs) represent a promising frontier in generative AI, offering fully parallel token generation that can lead to significant throughput advantages and superior GPU utilization over the traditional…

机器学习 · 计算机科学 2026-05-15 Michael Rottoli , Subhankar Roy , Stefano Paraboschi

Personalizing large language models (LLMs) to accommodate diverse user preferences is essential for enhancing alignment and user satisfaction. Traditional reinforcement learning from human feedback (RLHF) approaches often rely on monolithic…

机器学习 · 计算机科学 2025-04-22 Avinandan Bose , Zhihan Xiong , Yuejie Chi , Simon Shaolei Du , Lin Xiao , Maryam Fazel

Aligning Large Language Models (LLMs) with general human preferences has been proved crucial in improving the interaction quality between LLMs and human. However, human values are inherently diverse among different individuals, making it…

计算与语言 · 计算机科学 2024-12-31 Jianfei Zhang , Jun Bai , Bei Li , Yanmeng Wang , Rumei Li , Chenghua Lin , Wenge Rong

Nationally representative surveys track public opinion, yet they ask only a limited set of questions each year, limiting its potential to capture historical changes. To fill this gap, we develop a large language model (LLM)-based framework…

计算与语言 · 计算机科学 2026-05-21 Junsol Kim , Byungkyu Lee

The emergence of powerful LLMs has led to a paradigm shift in Natural Language Understanding and Natural Language Generation. The properties that make LLMs so valuable for these tasks -- creativity, ability to produce fluent speech, and…

计算与语言 · 计算机科学 2025-03-10 Kelsey Kraus , Margaret Kroll

A common technique for aligning large language models (LLMs) relies on acquiring human preferences by comparing multiple generations conditioned on a fixed context. This method, however, relies solely on pairwise comparisons, where the…

计算与语言 · 计算机科学 2025-01-09 Hritik Bansal , Ashima Suvarna , Gantavya Bhatt , Nanyun Peng , Kai-Wei Chang , Aditya Grover

Current recommender systems exploit user and item similarities by collaborative filtering. Some advanced methods also consider the temporal evolution of item ratings as a global background process. However, all prior methods disregard the…

人工智能 · 计算机科学 2017-05-16 Subhabrata Mukherjee , Hemank Lamba , Gerhard Weikum

Self-Rewarding Language Models propose an architecture in which the Large Language Models(LLMs) both generates responses and evaluates its own outputs via LLM-as-a-Judge prompting, dynamically improving its generative capabilities through…

Learning from human feedback is a prominent technique to align the output of large language models (LLMs) with human expectations. Reinforcement learning from human feedback (RLHF) leverages human preference signals that are in the form of…

计算与语言 · 计算机科学 2023-11-27 Di Jin , Shikib Mehri , Devamanyu Hazarika , Aishwarya Padmakumar , Sungjin Lee , Yang Liu , Mahdi Namazifar

Large language models (LLMs) are employed to simulate human-like responses in social surveys, yet it remains unclear if they develop biases like social desirability response (SDR) bias. To investigate this, GPT-4 was assigned personas from…

人工智能 · 计算机科学 2024-10-22 Sanguk Lee , Kai-Qi Yang , Tai-Quan Peng , Ruth Heo , Hui Liu

Fine-grained control over large language models (LLMs) remains a significant challenge, hindering their adaptability to diverse user needs. While Reinforcement Learning from Human Feedback (RLHF) shows promise in aligning LLMs, its reliance…

机器学习 · 计算机科学 2024-03-07 Haoxiang Wang , Yong Lin , Wei Xiong , Rui Yang , Shizhe Diao , Shuang Qiu , Han Zhao , Tong Zhang