English
Related papers

Related papers: Evaluating Position Bias in Large Language Model R…

200 papers

Large Language Models (LLMs) have recently emerged as promising tools for recommendation thanks to their advanced textual understanding ability and context-awareness. Despite the current practice of training and evaluating LLM-based…

Information Retrieval · Computer Science 2025-06-12 Sein Kim , Hongseok Kang , Kibum Kim , Jiwan Kim , Donghyun Kim , Minchul Yang , Kwangjin Oh , Julian McAuley , Chanyoung Park

Large language models (LLMs) are increasingly used for recommendation reranking, but their listwise predictions can depend on the order in which candidates are presented. This creates a mismatch between the set-based nature of…

Information Retrieval · Computer Science 2026-05-01 Ethan Bito , Yongli Ren , Estrid He

Large Language Models (LLMs) have excelled at language understanding and generating human-level text. However, even with supervised training and human alignment, these LLMs are susceptible to adversarial attacks where malicious users can…

Computation and Language · Computer Science 2024-08-08 Shachi H Kumar , Saurav Sahay , Sahisnu Mazumder , Eda Okur , Ramesh Manuvinakurike , Nicole Beckage , Hsuan Su , Hung-yi Lee , Lama Nachman

Recent studies have demonstrated the great potential of Large Language Models (LLMs) serving as zero-shot relevance rankers. The typical approach involves making comparisons between pairs or lists of documents. Although effective, these…

Information Retrieval · Computer Science 2023-11-06 Weiwei Sun , Zheng Chen , Xinyu Ma , Lingyong Yan , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The…

Offline evaluation of search systems depends on test collections. These benchmarks provide the researchers with a corpus of documents, topics and relevance judgements indicating which documents are relevant for each topic. While test…

Information Retrieval · Computer Science 2025-07-23 David Otero , Javier Parapar , Álvaro Barreiro

We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhancing recommender systems with logical reasoning abilities…

Information Retrieval · Computer Science 2024-08-13 Jiachen Zhu , Jianghao Lin , Xinyi Dai , Bo Chen , Rong Shan , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

In the field of information retrieval, Query Likelihood Models (QLMs) rank documents based on the probability of generating the query given the content of a document. Recently, advanced large language models (LLMs) have emerged as effective…

Information Retrieval · Computer Science 2023-10-23 Shengyao Zhuang , Bing Liu , Bevan Koopman , Guido Zuccon

While large language models (LLMs) demonstrate impressive capabilities across numerous applications, their robustness remains a critical concern. This paper is motivated by a specific vulnerability: the order sensitivity of LLMs. This…

Machine Learning · Computer Science 2025-05-22 Beni Egressy , Jan Stühmer

Music Recommender Systems (MRS) have long relied on an information-retrieval framing, where progress is measured mainly through accuracy on retrieval-oriented subtasks. While effective, this reductionist paradigm struggles to address the…

Information Retrieval · Computer Science 2025-11-21 Elena V. Epure , Yashar Deldjoo , Bruno Sguerra , Markus Schedl , Manuel Moussallam

Large language models (LLMs) have achieved remarkable progress in the field of natural language processing (NLP), demonstrating remarkable abilities in producing text that resembles human language for various tasks. This opens up new…

Information Retrieval · Computer Science 2024-06-05 Jianghao Lin , Xinyi Dai , Rong Shan , Bo Chen , Ruiming Tang , Yong Yu , Weinan Zhang

Recommendation systems are ubiquitous, from Spotify playlist suggestions to Amazon product suggestions. Nevertheless, depending on the methodology or the dataset, these systems typically fail to capture user preferences and generate general…

Information Retrieval · Computer Science 2024-01-15 Angela John , Theophilus Aidoo , Hamayoon Behmanush , Irem B. Gunduz , Hewan Shrestha , Maxx Richard Rahman , Wolfgang Maaß

Large Language Models (LLMs) are often used as automated judges to evaluate text, but their effectiveness can be hindered by various unintentional biases. We propose using linear classifying probes, trained by leveraging differences between…

Computation and Language · Computer Science 2025-03-25 Sharan Maiya , Yinhong Liu , Ramit Debnath , Anna Korhonen

Recent advancements in Large Language Models (LLMs) have attracted considerable interest among researchers to leverage these models to enhance Recommender Systems (RSs). Existing work predominantly utilizes LLMs to generate knowledge-rich…

Information Retrieval · Computer Science 2024-07-25 Zhongxiang Sun , Zihua Si , Xiaoxue Zang , Kai Zheng , Yang Song , Xiao Zhang , Jun Xu

Despite large language models (LLMs) increasingly becoming important components of news recommender systems, employing LLMs in such systems introduces new risks, such as the influence of cognitive biases in LLMs. Cognitive biases refer to…

Information Retrieval · Computer Science 2024-10-07 Yougang Lyu , Xiaoyu Zhang , Zhaochun Ren , Maarten de Rijke

The ability of Large Language Models (LLMs) to extract context from natural language problem descriptions naturally raises questions about their suitability in autonomous decision-making settings. This paper studies the behaviour of these…

Artificial Intelligence · Computer Science 2025-07-22 Xiao Yang , Juxi Leitner , Michael Burke

Large language models (LLMs) are increasingly used in group decision-making, but their influence risks fostering conformity and reducing epistemic vigilance. Drawing on the Argumentative Theory of Reasoning, we argue that confirmation bias,…

Human-Computer Interaction · Computer Science 2025-10-02 Sander de Jong , Rune Møberg Jacobsen , Niels van Berkel

Large language models (LLMs), with advanced linguistic capabilities, have been employed in reranking tasks through a sequence-to-sequence approach. In this paradigm, multiple passages are reranked in a listwise manner and a textual reranked…

Information Retrieval · Computer Science 2024-11-08 Ruiyang Ren , Yuhao Wang , Kun Zhou , Wayne Xin Zhao , Wenjie Wang , Jing Liu , Ji-Rong Wen , Tat-Seng Chua

Benefiting from the strong reasoning capabilities, Large language models (LLMs) have demonstrated remarkable performance in recommender systems. Various efforts have been made to distill knowledge from LLMs to enhance collaborative models,…

Information Retrieval · Computer Science 2024-12-24 Xihong Yang , Heming Jing , Zixing Zhang , Jindong Wang , Huakang Niu , Shuaiqiang Wang , Yu Lu , Junfeng Wang , Dawei Yin , Xinwang Liu , En Zhu , Defu Lian , Erxue Min

We study the potential of large language models (LLMs) as proxies for humans to simplify preference elicitation (PE) in combinatorial assignment. While traditional PE methods rely on iterative queries to capture preferences, LLMs offer a…

Artificial Intelligence · Computer Science 2025-02-17 Ermis Soumalias , Yanchen Jiang , Kehang Zhu , Michael Curry , Sven Seuken , David C. Parkes