中文
相关论文

相关论文: Beyond Utility: Evaluating LLM as Recommender

200 篇论文

[Context and Motivation] Online user feedback provides valuable information to support requirements engineering (RE). However, analyzing online user feedback is challenging due to its large volume and noise. Large language models (LLMs)…

软件工程 · 计算机科学 2025-10-28 Manjeshwar Aniruddh Mallya , Alessio Ferrari , Mohammad Amin Zadenoori , Jacek Dąbrowski

Recommendation systems power engagement and monetization across feeds, ads, and short-video platforms, but translating the latest advances in Large Language Models into Recommendation Systems (RecSys) gains remains rare, particularly in…

Large Language Models (LLMs) are increasingly relied upon to evaluate text outputs of other LLMs, thereby influencing leaderboards and development decisions. However, concerns persist over the accuracy of these assessments and the potential…

计算与语言 · 计算机科学 2024-11-27 Sumanth Doddapaneni , Mohammed Safi Ur Rahman Khan , Sshubam Verma , Mitesh M. Khapra

Large language models (LLMs) are increasingly being adopted in educational settings. These applications expand beyond English, though current LLMs remain primarily English-centric. In this work, we ascertain if their use in education…

计算与语言 · 计算机科学 2025-08-06 Vansh Gupta , Sankalan Pal Chowdhury , Vilém Zouhar , Donya Rooein , Mrinmaya Sachan

As large language models (LLMs) evolve from conversational assistants into agents capable of handling complex tasks, they are increasingly deployed in high-risk domains. However, existing benchmarks largely rely on mixed queries and…

计算与语言 · 计算机科学 2026-04-28 Yuhe Wu , Guangyu Wang , Yuran Chen , Jiatong Zhang , Yutong Zhang , Yujie Chen , Jiaming Shang , Guang Zhang , Zhuang Liu

The issue of popularity bias -- where popular items are disproportionately recommended, overshadowing less popular but potentially relevant items -- remains a significant challenge in recommender systems. Recent advancements have seen the…

信息检索 · 计算机科学 2024-06-04 Jan Malte Lichtenberg , Alexander Buchholz , Pola Schwöbel

The rise of large language models (LLMs) has led many researchers to consider their usage for scientific work. Some have found benefits using LLMs to augment or automate aspects of their research pipeline, while others have urged caution…

计算与语言 · 计算机科学 2024-11-11 Zhehui Liao , Maria Antoniak , Inyoung Cheong , Evie Yu-Yen Cheng , Ai-Heng Lee , Kyle Lo , Joseph Chee Chang , Amy X. Zhang

Large language models (LLMs) have achieved superior performance in powering text-based AI agents, endowing them with decision-making and reasoning abilities akin to humans. Concurrently, there is an emerging research trend focused on…

计算机视觉与模式识别 · 计算机科学 2024-02-26 Junlin Xie , Zhihong Chen , Ruifei Zhang , Xiang Wan , Guanbin Li

The planning ability of Large Language Models (LLMs) has garnered increasing attention in recent years due to their remarkable capacity for multi-step reasoning and their ability to generalize across a wide range of domains. While some…

人工智能 · 计算机科学 2025-02-19 Mohamed Aghzal , Erion Plaku , Gregory J. Stein , Ziyu Yao

Large language models (LLMs) increasingly operate in environments where they encounter social information such as other agents' answers, tool outputs, or human recommendations. In humans, such inputs influence judgments in ways that depend…

人工智能 · 计算机科学 2026-02-17 Anooshka Bajaj , Zoran Tiganj

The impressive linguistic abilities of large language models (LLMs) have recommended them as models of human sentence processing, with some conjecturing a positive 'quality-power' relationship (Wilcox et al., 2023), in which language…

计算与语言 · 计算机科学 2025-05-20 Yi-Chien Lin , Hongao Zhu , William Schuler

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

人工智能 · 计算机科学 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Serendipity-oriented recommender systems aim to counteract over-specialization in user preferences. However, evaluating a user's serendipitous response towards a recommended item can be challenging because of its emotional nature. In this…

信息检索 · 计算机科学 2024-12-18 Yu Tokutake , Kazushi Okamoto

When making decisions under uncertainty, individuals often deviate from rational behavior, which can be evaluated across three dimensions: risk preference, probability weighting, and loss aversion. Given the widespread use of large language…

人工智能 · 计算机科学 2024-11-04 Jingru Jia , Zehua Yuan , Junhao Pan , Paul E. McNamara , Deming Chen

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

计算与语言 · 计算机科学 2025-05-29 Avinash Patil , Aryan Jadon

This paper investigates the capabilities of large language models (LLMs) in formulating and solving decision-making problems using mathematical programming. We first conduct a systematic review and meta-analysis of recent literature to…

Large language models (LLMs) are increasingly integral to information retrieval (IR), powering ranking, evaluation, and AI-assisted content creation. This widespread adoption necessitates a critical examination of potential biases arising…

信息检索 · 计算机科学 2025-07-11 Krisztian Balog , Donald Metzler , Zhen Qin

Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains, thereby prompting researchers to explore their potential for use in recommendation systems. Initial attempts have leveraged the exceptional…

信息检索 · 计算机科学 2023-10-18 Keqin Bao , Jizhi Zhang , Yang Zhang , Wenjie Wang , Fuli Feng , Xiangnan He

Recent LLM agents have made great use of chain of thought reasoning and function calling. As their capabilities grow, an important question arises: can this software represent not only a smart problem-solving tool, but an entity in its own…

人工智能 · 计算机科学 2025-10-17 Asen Nachkov , Xi Wang , Luc Van Gool

Large language models (LLMs) have brought breakthroughs in tasks including translation, summarization, information retrieval, and language generation, gaining growing interest in the CHI community. Meanwhile, the literature shows…

人机交互 · 计算机科学 2024-03-05 Lu Wang , Max Song , Rezvaneh Rezapour , Bum Chul Kwon , Jina Huh-Yoo