English
Related papers

Related papers: Evaluating Position Bias in Large Language Model R…

200 papers

This paper aims to address the challenge of sparse and missing data in recommendation systems, a significant hurdle in the age of big data. Traditional imputation methods struggle to capture complex relationships within the data. We propose…

Information Retrieval · Computer Science 2024-08-09 Zhicheng Ding , Jiahao Tian , Zhenkai Wang , Jinman Zhao , Siyang Li

Nowadays, the quality of responses generated by different modern large language models (LLMs) is hard to evaluate and compare automatically. Recent studies suggest and predominantly use LLMs for reference-free evaluation of open-ended…

Computation and Language · Computer Science 2025-01-03 Ruosen Li , Teerth Patel , Xinya Du

The integration of Large Language Models into recommendation frameworks presents key advantages for personalization and adaptability of experiences to the users. Classic methods of recommendations, such as collaborative filtering and…

Information Retrieval · Computer Science 2025-01-20 Peiyang Yu , Zeqiu Xu , Jiani Wang , Xiaochuan Xu

In the past year, Generative Recommendations (GRs) have undergone substantial advancements, especially in leveraging the powerful sequence modeling and reasoning capabilities of Large Language Models (LLMs) to enhance overall recommendation…

Information Retrieval · Computer Science 2025-07-15 Zhen Yang , Haitao Lin , Jiawei xue , Ziji Zhang

Large language models (LLMs), despite their remarkable capabilities, are susceptible to generating biased and discriminatory responses. As LLMs increasingly influence high-stakes decision-making (e.g., hiring and healthcare), mitigating…

Computation and Language · Computer Science 2025-03-04 Jingling Li , Zeyu Tang , Xiaoyu Liu , Peter Spirtes , Kun Zhang , Liu Leqi , Yang Liu

Large language models (LLMs) are now widely used to evaluate the quality of text, a field commonly referred to as LLM-as-a-judge. While prior works mainly focus on point-wise and pair-wise evaluation paradigms. Rubric-based evaluation,…

Computation and Language · Computer Science 2026-02-03 Yuzheng Xu , Tosho Hirasawa , Tadashi Kozuno , Yoshitaka Ushiku

Sequential recommendation problems have received increasing attention in research during the past few years, leading to the inception of a large variety of algorithmic approaches. In this work, we explore how large language models (LLMs),…

Information Retrieval · Computer Science 2023-09-19 Jesse Harte , Wouter Zorgdrager , Panos Louridas , Asterios Katsifodimos , Dietmar Jannach , Marios Fragkoulis

Large Language Models (LLMs) have demonstrated strong performance in information retrieval tasks like passage ranking. Our research examines how instruction-following capabilities in LLMs interact with multi-document comparison tasks,…

Information Retrieval · Computer Science 2025-09-24 Yaoyao Qian , Yifan Zeng , Yuchao Jiang , Chelsi Jain , Huazheng Wang

Travel choice analysis is crucial for understanding individual travel behavior to develop appropriate transport policies and recommendation systems in Intelligent Transportation Systems (ITS). Despite extensive research, this domain faces…

Artificial Intelligence · Computer Science 2024-06-25 Xuehao Zhai , Hanlin Tian , Lintong Li , Tianyu Zhao

Large Language Models (LLMs) are increasingly expected to handle complex decision-making tasks, yet their ability to perform structured resource allocation remains underexplored. Evaluating their reasoning is also difficult due to data…

Artificial Intelligence · Computer Science 2025-08-11 Sankarshan Damle , Boi Faltings

Instruction tuning aligns the response of large language models (LLMs) with human preferences. Despite such efforts in human--LLM alignment, we find that instruction tuning does not always make LLMs human-like from a cognitive modeling…

Computation and Language · Computer Science 2024-04-16 Tatsuki Kuribayashi , Yohei Oseki , Timothy Baldwin

The powerful generative abilities of large language models (LLMs) show potential in generating relevance labels for search applications. Previous work has found that directly asking about relevancy, such as ``How relevant is document A to…

Information Retrieval · Computer Science 2024-04-19 Le Yan , Zhen Qin , Honglei Zhuang , Rolf Jagerman , Xuanhui Wang , Michael Bendersky , Harrie Oosterhuis

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

Computation and Language · Computer Science 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

Large language models (LLMs) have achieved impressive zero-shot performance in various natural language processing (NLP) tasks, demonstrating their capabilities for inference without training examples. Despite their success, no research has…

Information Retrieval · Computer Science 2023-04-07 Lei Wang , Ee-Peng Lim

Recommendation is the task of ranking items (e.g. movies or products) according to individual user needs. Current systems rely on collaborative filtering and content-based techniques, which both require structured training data. We propose…

Computation and Language · Computer Science 2021-12-09 Damien Sileo , Wout Vossen , Robbe Raymaekers

Human relevance assessment is time-consuming and cognitively intensive, limiting the scalability of Information Retrieval evaluation. This has led to growing interest in using large language models (LLMs) as proxies for human judges.…

Information Retrieval · Computer Science 2026-04-28 Chuting Yu , Hang Li , Guido Zuccon , Joel Mackenzie , Teerapong Leelanupab

This paper argues that large language model-based recommenders can displace today's attention-allocation machinery. LLM-based recommenders would ingest open-web content, infer a user's natural-language goals, and present information that…

Computers and Society · Computer Science 2025-07-03 Seth Lazar , Luke Thorburn , Tian Jin , Luca Belli

Material selection is a crucial step in conceptual design due to its significant impact on the functionality, aesthetics, manufacturability, and sustainability impact of the final product. This study investigates the use of Large Language…

Computation and Language · Computer Science 2024-05-08 Daniele Grandi , Yash Patawari Jain , Allin Groom , Brandon Cramer , Christopher McComb

Large language models (LLMs) have recently received significant attention for their exceptional capabilities. Despite extensive efforts in developing general-purpose LLMs that can be utilized in various natural language processing (NLP)…

Information Retrieval · Computer Science 2023-06-08 Fan Yang , Zheng Chen , Ziyan Jiang , Eunah Cho , Xiaojiang Huang , Yanbin Lu

Large Language Models (LLMs) have demonstrated great potential in Conversational Recommender Systems (CRS). However, the application of LLMs to CRS has exposed a notable discrepancy in behavior between LLM-based CRS and human recommenders:…

Information Retrieval · Computer Science 2024-10-21 Dayu Yang , Fumian Chen , Hui Fang