中文
相关论文

相关论文: Beyond Utility: Evaluating LLM as Recommender

200 篇论文

Text-based recommendation holds a wide range of practical applications due to its versatility, as textual descriptions can represent nearly any type of item. However, directly employing the original item descriptions may not yield optimal…

计算与语言 · 计算机科学 2024-04-03 Hanjia Lyu , Song Jiang , Hanqing Zeng , Yinglong Xia , Qifan Wang , Si Zhang , Ren Chen , Christopher Leung , Jiajie Tang , Jiebo Luo

In current benchmarks for evaluating large language models (LLMs), there are issues such as evaluation content restriction, untimely updates, and lack of optimization guidance. In this paper, we propose a new paradigm for the measurement of…

计算与语言 · 计算机科学 2024-07-11 Jin Liu , Qingquan Li , Wenlong Du

Large Language Models (LLMs) have attracted significant attention in recommender systems for their excellent world knowledge capabilities. However, existing methods that rely on Euclidean space struggle to capture the rich hierarchical…

信息检索 · 计算机科学 2025-04-22 Wentao Cheng , Zhida Qin , Zexue Wu , Pengzhan Zhou , Tianyu Huang

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

计算与语言 · 计算机科学 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li

Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the…

计算与语言 · 计算机科学 2024-08-07 Philipp Mondorf , Barbara Plank

Large Language Models (LLMs) are increasingly employed for simulating human behaviors across diverse domains. However, our position is that current LLM-based human simulations remain insufficiently reliable, as evidenced by significant…

计算与语言 · 计算机科学 2025-12-02 Qian Wang , Jiaying Wu , Zichen Jiang , Zhenheng Tang , Bingqiao Luo , Nuo Chen , Wei Chen , Bingsheng He

Large language models (LLMs) have gained much attention in the recommendation community; some studies have observed that LLMs, fine-tuned by the cross-entropy loss with a full softmax, could achieve state-of-the-art performance already.…

信息检索 · 计算机科学 2024-02-23 Cong Xu , Zhangchi Zhu , Jun Wang , Jianyong Wang , Wei Zhang

This paper explores the use of Large Language Models (LLMs) for sequential recommendation, which predicts users' future interactions based on their past behavior. We introduce a new concept, "Integrating Recommendation Systems as a New…

信息检索 · 计算机科学 2024-12-24 Kai Zheng , Qingfeng Sun , Can Xu , Peng Yu , Qingwei Guo

Reranking is a critical component in recommender systems, playing an essential role in refining the output of recommendation algorithms. Traditional reranking models have focused predominantly on accuracy, but modern applications demand…

信息检索 · 计算机科学 2025-02-04 Jingtong Gao , Bo Chen , Weiwen Liu , Xiangyang Li , Yichao Wang , Wanyu Wang , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Improving the multi-step reasoning ability of Large Language Models (LLMs) is a critical yet challenging task. The dominant paradigm, outcome-supervised reinforcement learning (RLVR), rewards only correct final answers, often propagating…

人工智能 · 计算机科学 2025-10-14 Beining Wang , Weihang Su , Hongtao Tian , Tao Yang , Yujia Zhou , Ting Yao , Qingyao Ai , Yiqun Liu

With extensive pre-trained knowledge and high-level general capabilities, large language models (LLMs) emerge as a promising avenue to augment reinforcement learning (RL) in aspects such as multi-task learning, sample efficiency, and…

机器学习 · 计算机科学 2024-11-21 Yuji Cao , Huan Zhao , Yuheng Cheng , Ting Shu , Yue Chen , Guolong Liu , Gaoqi Liang , Junhua Zhao , Jinyue Yan , Yun Li

The remarkable text understanding and generation capabilities of large language models (LLMs) have revitalized the field of general recommendation based on implicit user feedback. Rather than deploying LLMs directly as recommendation…

信息检索 · 计算机科学 2026-04-30 Yi Zhang , Yiwen Zhang , Kai Zheng , Tong Chen , Hongzhi Yin

Automatic evaluation is an integral aspect of dialogue system research. The traditional reference-based NLG metrics are generally found to be unsuitable for dialogue assessment. Consequently, recent studies have suggested various unique,…

计算与语言 · 计算机科学 2024-01-23 Chen Zhang , Luis Fernando D'Haro , Yiming Chen , Malu Zhang , Haizhou Li

Despite making significant progress in multi-modal tasks, current Multi-modal Large Language Models (MLLMs) encounter the significant challenge of hallucinations, which may lead to harmful consequences. Therefore, evaluating MLLMs'…

计算与语言 · 计算机科学 2024-02-26 Junyang Wang , Yuhang Wang , Guohai Xu , Jing Zhang , Yukai Gu , Haitao Jia , Jiaqi Wang , Haiyang Xu , Ming Yan , Ji Zhang , Jitao Sang

The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays…

Large language models (LLMs) are increasingly capable of providing users with advice in a wide range of professional domains, including legal advice. However, relying on LLMs for legal queries raises concerns due to the significant…

计算机与社会 · 计算机科学 2025-06-13 Inyoung Cheong , King Xia , K. J. Kevin Feng , Quan Ze Chen , Amy X. Zhang

Large Language Models (LLMs) have become valuable assets in mental health, showing promise in both classification tasks and counseling applications. This paper offers a perspective on using LLMs in mental health applications. It discusses…

计算与语言 · 计算机科学 2023-12-19 Shaoxiong Ji , Tianlin Zhang , Kailai Yang , Sophia Ananiadou , Erik Cambria

As large language models (LLMs) are increasingly used in human-centered tasks, assessing their psychological traits is crucial for understanding their social impact and ensuring trustworthy AI alignment. While existing reviews have covered…

Current Large Language Models (LLMs) are gradually exploited in practically valuable agentic workflows such as Deep Research, E-commerce recommendation, and job recruitment. In these applications, LLMs need to select some optimal solutions…

计算机与社会 · 计算机科学 2026-03-23 Zichen Tang , Zirui Zhang , Qian Wang , Zhenheng Tang , Bo Li , Xiaowen Chu

Reinforcement Learning (RL) agents often struggle in sparse-reward environments where traditional exploration strategies fail to discover effective action sequences. Large Language Models (LLMs) possess procedural knowledge and reasoning…

机器学习 · 计算机科学 2025-10-13 Vaibhav Jain , Gerrit Grossmann