English
Related papers

Related papers: Every Preference Has Its Strength: Injecting Ordin…

200 papers

Large Language Models (LLMs) have demonstrated impressive fluency and task competence in conversational settings. However, their effectiveness in multi-session and long-term interactions is hindered by limited memory persistence. Typical…

Computation and Language · Computer Science 2025-08-19 Maitreyi Chatterjee , Devansh Agarwal

Recent progress in strengthening the capabilities of large language models has stemmed from applying reinforcement learning to domains with automatically verifiable outcomes. A key question is whether we can similarly use RL to optimize for…

Machine Learning · Computer Science 2025-05-27 Eric Zhao , Jessica Dai , Pranjal Awasthi

Predicting affect in unconstrained environments remains a fundamental challenge in human-centered AI. While deep neural embeddings dominate contemporary approaches, they often lack interpretability and limit expert-driven refinement. We…

Computation and Language · Computer Science 2026-04-09 Kosmas Pinitas , Ilias Maglogiannis

Traditional recommender systems leverage users' item preference history to recommend novel content that users may like. However, modern dialog interfaces that allow users to express language-based preferences offer a fundamentally different…

Information Retrieval · Computer Science 2023-07-27 Scott Sanner , Krisztian Balog , Filip Radlinski , Ben Wedin , Lucas Dixon

Embedding-based collaborative filtering, often coupled with nearest neighbor search, is widely deployed in large-scale recommender systems for personalized content selection. Modern systems leverage multiple implicit feedback signals (e.g.,…

Information Retrieval · Computer Science 2025-05-29 Zhongjin Zhang , Yu Liang , Cong Fu , Yuxuan Zhu , Kun Wang , Yabo Ni , Anxiang Zeng , Jiazhi Xia

Aligning language models to human expectations, e.g., being helpful and harmless, has become a pressing challenge for large language models. A typical alignment procedure consists of supervised fine-tuning and preference learning. Most…

Machine Learning · Computer Science 2024-02-27 Tianchi Cai , Xierui Song , Jiyan Jiang , Fei Teng , Jinjie Gu , Guannan Zhang

Click-Through Rate (CTR) prediction holds a paramount position in recommender systems. The prevailing ID-based paradigm underperforms in cold-start scenarios due to the skewed distribution of feature frequency. Additionally, the utilization…

Information Retrieval · Computer Science 2024-11-28 Xingmei Wang , Weiwen Liu , Xiaolong Chen , Qi Liu , Xu Huang , Yichao Wang , Xiangyang Li , Yasheng Wang , Zhenhua Dong , Defu Lian , Ruiming Tang

Preference alignment is an essential step in adapting large language models (LLMs) to human values, but existing approaches typically depend on costly human annotations or large-scale API-based models. We explore whether a weak LLM can…

Computation and Language · Computer Science 2026-03-06 Amirabbas Afzali , Myeongho Jeon , Maria Brbic

Optimizing industrial search ranking models solely for user engagement signals often introduces systematic biases, prioritizing popular or price-anchored items that may not satisfy semantic intent. We present a production-scale multi-task…

Information Retrieval · Computer Science 2026-05-28 Luming Chen , Jiaqi Xi , Raghav Saboo , Kenny Chi , Martin Wang , Sudeep Das , Danny Nightingale , Aditya Dodda , Elyse Winer , Akshad Viswanathan

Agentic systems powered by Large Language Models (LLMs) have shown strong potential in recommender systems but remain hindered by several challenges. Fine-tuning LLMs is parameter-inefficient, and prompt-based agentic reasoning is limited…

Information Retrieval · Computer Science 2026-02-10 Minh-Duc Nguyen , Hai-Dang Kieu , Dung D. Le

The dominant framework for alignment of large language models (LLM), whether through reinforcement learning from human feedback or direct preference optimisation, is to learn from preference data. This involves building datasets where each…

Leveraging Large Language Models as Recommenders (LLMRec) has gained significant attention and introduced fresh perspectives in user preference modeling. Existing LLMRec approaches prioritize text semantics, usually neglecting the valuable…

Information Retrieval · Computer Science 2025-06-17 Yang Zhang , Fuli Feng , Jizhi Zhang , Keqin Bao , Qifan Wang , Xiangnan He

Reinforcement Learning from Human Feedback (RLHF) effectively aligns Large Language Models (LLMs) with aggregate human preferences but often fails to address the diverse and conflicting needs of individual users. To overcome this issue, we…

Machine Learning · Computer Science 2026-05-21 Yinlam Chow , Guy Tennenholtz , Ted Yun , James Harrison , Arthur Gretton , Andre Barreto , Bo Dai

The long-tail recommendation is a challenging task for traditional recommender systems, due to data sparsity and data imbalance issues. The recent development of large language models (LLMs) has shown their abilities in complex reasoning,…

Information Retrieval · Computer Science 2024-03-12 Junda Wu , Cheng-Chun Chang , Tong Yu , Zhankui He , Jianing Wang , Yupeng Hou , Julian McAuley

Large language models (LLMs) have achieved remarkable success, yet aligning their generations with human preferences remains a critical challenge. Existing approaches to preference modeling often rely on an explicit or implicit reward…

Computation and Language · Computer Science 2025-05-09 Zhuocheng Gong , Jian Guan , Wei Wu , Huishuai Zhang , Dongyan Zhao

The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays…

Information Retrieval · Computer Science 2025-01-14 Artun Boz , Wouter Zorgdrager , Zoe Kotti , Jesse Harte , Panos Louridas , Dietmar Jannach , Vassilios Karakoidas , Marios Fragkoulis

Benefiting from the strong reasoning capabilities, Large language models (LLMs) have demonstrated remarkable performance in recommender systems. Various efforts have been made to distill knowledge from LLMs to enhance collaborative models,…

Information Retrieval · Computer Science 2024-12-24 Xihong Yang , Heming Jing , Zixing Zhang , Jindong Wang , Huakang Niu , Shuaiqiang Wang , Yu Lu , Junfeng Wang , Dawei Yin , Xinwang Liu , En Zhu , Defu Lian , Erxue Min

Large language model (LLM) alignment is typically achieved through learning from human preference comparisons, making the quality of preference data critical to its success. Existing studies often pre-process raw training datasets to…

Machine Learning · Computer Science 2026-03-17 Zizhuo Zhang , Qizhou Wang , Shanshan Ye , Jianing Zhu , Jiangchao Yao , Bo Han , Masashi Sugiyama

Large language model (LLM) is an effective approach to addressing data scarcity in low-resource scenarios. Recent existing research designs hand-crafted prompts to guide LLM for data augmentation. We introduce a data augmentation strategy…

Computation and Language · Computer Science 2025-06-10 Yaping Chai , Haoran Xie , Joe S. Qin

Alignment with human preference is a desired property of large language models (LLMs). Currently, the main alignment approach is based on reinforcement learning from human feedback (RLHF). Despite the effectiveness of RLHF, it is intricate…

Computation and Language · Computer Science 2024-04-16 Geyang Guo , Ranchi Zhao , Tianyi Tang , Wayne Xin Zhao , Ji-Rong Wen