English
Related papers

Related papers: LLMs for estimating positional bias in logged inte…

200 papers

We explore how large language models (LLMs) can enhance the proposal selection process at large user facilities, offering a scalable, consistent, and cost-effective alternative to traditional human review. Proposal selection depends on…

Artificial Intelligence · Computer Science 2025-12-12 Lijie Ding , Janell Thomson , Jon Taylor , Changwoo Do

Recommender systems are pivotal in Internet social platforms, yet they often cater to users' historical interests, leading to critical issues like echo chambers. To broaden user horizons, proactive recommender systems aim to guide user…

Information Retrieval · Computer Science 2025-05-02 Mingze Wang , Shuxian Bi , Wenjie Wang , Chongming Gao , Yangyang Li , Fuli Feng

Recommendation systems often suffer from data sparsity caused by limited user-item interactions, which degrade their performance and amplify popularity bias in real-world scenarios. This paper proposes a novel data augmentation framework…

Information Retrieval · Computer Science 2026-04-22 Minh-Anh Nguyen , Bao Nguyen , Ha Lan N. T. , Tuan Anh Hoang , Duc-Trong Le , Dung D. Le

LLM-based listwise passage reranking has attracted attention for its effectiveness in ranking candidate passages. However, these models suffer from positional bias, where passages positioned towards the end of the input are less likely to…

Information Retrieval · Computer Science 2026-04-07 Jingfen Qiao , Jin Huang , Xinyu Ma , Shuaiqiang Wang , Dawei Yin , Evangelos Kanoulas , Andrew Yates

In-context learning enables large language models (LLMs) to perform a variety of tasks, including learning to make reward-maximizing choices in simple bandit tasks. Given their potential use as (autonomous) decision-making agents, it is…

Computation and Language · Computer Science 2024-05-21 William M. Hayes , Nicolas Yax , Stefano Palminteri

Estimating position bias is a well-known challenge in Learning to Rank (L2R). Click data in e-commerce applications, such as targeted advertisements and search engines, provides implicit but abundant feedback to improve personalized…

Information Retrieval · Computer Science 2024-03-13 Shion Ishikawa , Yun Ching Liu , Young-Joo Chung , Yu Hirate

Modern large language models (LLMs) are typically trained and deployed using structured role tags (e.g. system, user, assistant, tool) that explicitly mark the source of each piece of context. While these tags are essential for instruction…

Computation and Language · Computer Science 2026-04-21 Xu Pan , Jingxuan Fan , Zidi Xiong , Ely Hahami , Jorin Overwiening , Ziqian Xie

Recent advances in unbiased learning to rank (LTR) count on Inverse Propensity Scoring (IPS) to eliminate bias in implicit feedback. Though theoretically sound in correcting the bias introduced by treating clicked documents as relevant, IPS…

Information Retrieval · Computer Science 2021-11-16 Nan Wang , Zhen Qin , Xuanhui Wang , Hongning Wang

Recommender systems are tasked to infer users' evolving preferences and rank items aligned with their intents, which calls for in-depth reasoning beyond pattern-based scoring. Recent efforts start to leverage large language models (LLMs)…

Information Retrieval · Computer Science 2026-02-16 Kehan Zheng , Deyao Hong , Qian Li , Jun Zhang , Huan Yu , Jie Jiang , Hongning Wang

This paper aims to address the challenge of sparse and missing data in recommendation systems, a significant hurdle in the age of big data. Traditional imputation methods struggle to capture complex relationships within the data. We propose…

Information Retrieval · Computer Science 2024-08-09 Zhicheng Ding , Jiahao Tian , Zhenkai Wang , Jinman Zhao , Siyang Li

Large Language Models (LLMs) have demonstrated remarkable capabilities and have been extensively deployed across various domains, including recommender systems. Prior research has employed specialized \textit{prompts} to leverage the…

Information Retrieval · Computer Science 2024-04-02 Sichun Luo , Bowei He , Haohan Zhao , Wei Shao , Yanlin Qi , Yinya Huang , Aojun Zhou , Yuxuan Yao , Zongpeng Li , Yuanzhang Xiao , Mingjie Zhan , Linqi Song

Large Language Models (LLMs) often struggle to use information across long inputs effectively. Prior work has identified positional biases, such as the Lost in the Middle (LiM) effect, where models perform better when information appears at…

Computation and Language · Computer Science 2025-08-12 Blerta Veseli , Julian Chibane , Mariya Toneva , Alexander Koller

Large Language Models (LLMs) have demonstrated unprecedented language understanding and reasoning capabilities to capture diverse user preferences and advance personalized recommendations. Despite the growing interest in LLM-based…

Information Retrieval · Computer Science 2025-04-30 Zihuai Zhao , Wenqi Fan , Yao Wu , Qing Li

Talent recruitment is a critical, yet costly process for many industries, with high recruitment costs and long hiring cycles. Existing talent recommendation systems increasingly adopt large language models (LLMs) due to their remarkable…

Computation and Language · Computer Science 2026-04-03 Silin Du , Hongyan Liu

Besides position bias, which has been well-studied, trust bias is another type of bias prevalent in user interactions with rankings: users are more likely to click incorrectly w.r.t. their preferences on highly ranked items because they…

Information Retrieval · Computer Science 2020-09-10 Ali Vardasbi , Harrie Oosterhuis , Maarten de Rijke

Large Language Models (LLMs) have demonstrated remarkable capabilities in various NLP tasks. However, previous works have shown these models are sensitive towards prompt wording, and few-shot demonstrations and their order, posing…

Computation and Language · Computer Science 2023-08-23 Pouya Pezeshkpour , Estevam Hruschka

Warning: This paper contains examples of stereotypes and biases. Large Language Models (LLMs) exhibit considerable social biases, and various studies have tried to evaluate and mitigate these biases accurately. Previous studies use…

Computation and Language · Computer Science 2024-07-04 Rem Hida , Masahiro Kaneko , Naoaki Okazaki

Large language models (LLMs) are increasingly deployed in decision-support systems for high-stakes domains such as hiring and university admissions, where choices often involve selecting among competing alternatives. While prior work has…

Artificial Intelligence · Computer Science 2026-04-15 Haonan Yin , Shai Vardi , Vidyanand Choudhary

As large language models (LLMs) become integral to intelligent user interfaces (IUIs), their role as decision-making agents raises critical concerns about alignment. Although extensive research has addressed issues such as factuality, bias,…

Artificial Intelligence · Computer Science 2025-04-23 Anna Karnysheva , Christian Drescher , Dietrich Klakow

In this paper, we explore the potential of Large Language Models (LLMs) with assertions to mitigate imbalances in educational datasets. Traditional models often fall short in such contexts, particularly due to the complexity and nuanced…

Computers and Society · Computer Science 2024-07-03 Jeanne McClure , Machi Shimmei , Noboru Matsuda , Shiyan Jiang