English
Related papers

Related papers: Generative Explore-Exploit: Training-free Optimiza…

200 papers

The paper underscores the significance of Large Language Models (LLMs) in reshaping recommender systems, attributing their value to unique reasoning abilities absent in traditional recommenders. Unlike conventional systems lacking direct…

Information Retrieval · Computer Science 2024-03-20 Arpita Vats , Vinija Jain , Rahul Raja , Aman Chadha

Large Language Models (LLMs) offer promising capabilities for tackling complex reasoning tasks, including optimization problems. However, existing methods either rely on prompt engineering, which leads to poor generalization across problem…

Machine Learning · Computer Science 2025-10-23 Dong Li , Xujiang Zhao , Linlin Yu , Yanchi Liu , Wei Cheng , Zhengzhang Chen , Zhong Chen , Feng Chen , Chen Zhao , Haifeng Chen

The paradigm shift from item-centric ranking to answer-centric synthesis is redefining the role of search engines. While recent industrial progress has applied generative techniques to closed-set item ranking in e-commerce, research and…

Computation and Language · Computer Science 2026-03-12 Wei Wu , Peilun Zhou , Liyi Chen , Qimeng Wang , Chengqiang Lu , Yan Gao , Yi Wu , Yao Hu , Hui Xiong

Large language models (LLMs) typically receive diverse natural language (NL) feedback through interaction with the environment. However, current reinforcement learning (RL) algorithms rely solely on scalar rewards, leaving the rich…

Computation and Language · Computer Science 2026-03-06 Lei Huang , Xiang Cheng , Chenxiao Zhao , Guobin Shen , Junjie Yang , Xiaocheng Feng , Yuxuan Gu , Xing Yu , Bing Qin

Large Language Models (LLMs) have demonstrated exceptional performance across diverse natural language processing tasks. However, these models exhibit a critical limitation in output diversity, often generating highly similar content across…

Computation and Language · Computer Science 2025-11-04 Zhiwen Ruan , Yixia Li , Yefeng Liu , Yun Chen , Weihua Luo , Peng Li , Yang Liu , Guanhua Chen

With the accumulation of data at an unprecedented rate, its potential to fuel scientific discovery is growing exponentially. This position paper urges the Machine Learning (ML) community to exploit the capabilities of large generative…

Computation and Language · Computer Science 2024-02-22 Bodhisattwa Prasad Majumder , Harshit Surana , Dhruv Agarwal , Sanchaita Hazra , Ashish Sabharwal , Peter Clark

Reinforcement Learning (RL)-based recommender systems have demonstrated promising performance in meeting user expectations by learning to make accurate next-item recommendations from historical user-item interactions. However, existing…

Information Retrieval · Computer Science 2024-03-26 Jie Wang , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

A burgeoning area within reinforcement learning (RL) is the design of sequential decision-making agents centered around large language models (LLMs). While autonomous decision-making agents powered by modern LLMs could facilitate numerous…

Machine Learning · Computer Science 2026-02-10 Dilip Arumugam , Thomas L. Griffiths

Personalized content-based recommender systems have become indispensable tools for users to navigate through the vast amount of content available on platforms like daily news websites and book recommendation services. However, existing…

Information Retrieval · Computer Science 2023-09-01 Qijiong Liu , Nuo Chen , Tetsuya Sakai , Xiao-Ming Wu

Rich and informative profiling to capture user preferences is essential for improving recommendation quality. However, there is still no consensus on how best to construct and utilize such profiles. To address this, we revisit recent…

Information Retrieval · Computer Science 2026-01-14 Seokho Ahn , Sungbok Shin , Young-Duk Seo

Personalized text generation requires models not only to produce coherent text but also to align with a target user's style, tone, and topical focus. Existing retrieval-augmented approaches such as LaMP and PGraphRAG enrich profiles with…

Computation and Language · Computer Science 2025-10-29 Durga Prasad Maram , Dhruvin Gandhi , Zonghai Yao , Gayathri Akkinapalli , Franck Dernoncourt , Yu Wang , Ryan A. Rossi , Nesreen K. Ahmed

Large language models (LLMs) often struggle with knowledge intensive NLP tasks, such as answering "Who won the latest World Cup?" because the knowledge they learn during training may be insufficient or outdated. Conditioning generation on…

Computation and Language · Computer Science 2025-03-04 Matthew Finlayson , Ilia Kulikov , Daniel M. Bikel , Barlas Oguz , Xilun Chen , Aasish Pappu

Click-Through Rate (CTR) prediction models are integral to a myriad of industrial settings, such as personalized search advertising. Current methods typically involve feature extraction from users' historical behavior sequences combined…

Machine Learning · Computer Science 2025-07-16 Lingwei Kong , Lu Wang , Changping Peng , Zhangang Lin , Ching Law , Jingping Shao

Policy exploration is critical in reinforcement learning (RL), where existing approaches include greedy, Gaussian process, etc. However, these approaches utilize preset stochastic processes and are indiscriminately applied in all kinds of…

Machine Learning · Computer Science 2025-10-24 Qianyue Hao , Yiwen Song , Qingmin Liao , Jian Yuan , Yong Li

While previous chapters focused on recommendation systems (RSs) based on standardized, non-verbal user feedback such as purchases, views, and clicks -- the advent of LLMs has unlocked the use of natural language (NL) interactions for…

Complementary product recommendation, which aims to suggest items that are used together to enhance customer value, is a crucial yet challenging task in e-commerce. While existing graph neural network (GNN) approaches have made significant…

Information Retrieval · Computer Science 2025-12-02 Zekun Xu , Yudi Zhang

To address the challenge of information overload from massive web contents, recommender systems are widely applied to retrieve and present personalized results for users. However, recommendation tasks are inherently constrained to filtering…

Artificial Intelligence · Computer Science 2025-06-04 Jiongnan Liu , Zhicheng Dou , Ning Hu , Chenyan Xiong

Despite the significant progress of large language models (LLMs) in various tasks, they often produce factual errors due to their limited internal knowledge. Retrieval-Augmented Generation (RAG), which enhances LLMs with external knowledge…

Computation and Language · Computer Science 2024-10-10 Yuanjie Lyu , Zihan Niu , Zheyong Xie , Chao Zhang , Tong Xu , Yang Wang , Enhong Chen

Recommender systems are the cornerstone of today's information dissemination, yet a disconnect between offline metrics and online performance greatly hinders their development. Addressing this challenge, we envision a recommendation…

Information Retrieval · Computer Science 2024-11-11 An Zhang , Yuxin Chen , Leheng Sheng , Xiang Wang , Tat-Seng Chua

Despite their success in many domains, large language models (LLMs) remain under-studied in scenarios requiring optimal decision-making under uncertainty. This is crucial as many real-world applications, ranging from personalized…

Machine Learning · Computer Science 2025-07-15 Allen Nie , Yi Su , Bo Chang , Jonathan N. Lee , Ed H. Chi , Quoc V. Le , Minmin Chen