English
Related papers

Related papers: Evaluating Position Bias in Large Language Model R…

200 papers

Large language models (LLMs) are known to produce varying responses depending on prompt phrasing, indicating that subtle guidance in phrasing can steer their answers. However, the impact of this framing bias on LLM-based evaluation, where…

Computation and Language · Computer Science 2026-01-21 Yerin Hwang , Dongryeol Lee , Taegwan Kang , Minwoo Lee , Kyomin Jung

Large Language Models (LLMs) have demonstrated unprecedented language understanding and reasoning capabilities to capture diverse user preferences and advance personalized recommendations. Despite the growing interest in LLM-based…

Information Retrieval · Computer Science 2025-04-30 Zihuai Zhao , Wenqi Fan , Yao Wu , Qing Li

Recommender systems utilizing explicit feedback have witnessed significant advancements and widespread applications over the past years. However, generating recommendations in few-shot scenarios remains a persistent challenge. Recently,…

Information Retrieval · Computer Science 2023-12-22 Zhoumeng Wang

Stance classification, the task of predicting the viewpoint of an author on a subject of interest, has long been a focal point of research in domains ranging from social science to machine learning. Current stance detection methods rely…

Computation and Language · Computer Science 2024-03-07 Iain J. Cruickshank , Lynnette Hui Xian Ng

Large language models provide rich semantic priors and strong reasoning capabilities, making them promising auxiliary signals for recommendation. However, prevailing approaches either deploy LLMs as standalone recommender or apply global…

Information Retrieval · Computer Science 2025-12-29 Shanglin Yang , Zhan Shi

Large language models (LLMs) can perform recommendation tasks by taking prompts written in natural language as input. Compared to traditional methods such as collaborative filtering, LLM-based recommendation offers advantages in handling…

Information Retrieval · Computer Science 2025-07-21 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

Position bias has proven to be a prevalent issue of modern language models (LMs), where the models prioritize content based on its position within the given context. This bias often leads to unexpected model failures and hurts performance,…

Computation and Language · Computer Science 2025-04-02 Ziqi Wang , Hanlin Zhang , Xiner Li , Kuan-Hao Huang , Chi Han , Shuiwang Ji , Sham M. Kakade , Hao Peng , Heng Ji

Despite growing interest in using Large Language Models (LLMs) for educational assessment, it remains unclear how closely they align with human scoring. We present a systematic evaluation of instruction-tuned LLMs across three open…

Computation and Language · Computer Science 2026-04-02 Filip J. Kucia , Anirban Chakraborty , Anna Wróblewska

Recently, Large Language Models~(LLMs) such as ChatGPT have showcased remarkable abilities in solving general tasks, demonstrating the potential for applications in recommender systems. To assess how effectively LLMs can be used in…

Information Retrieval · Computer Science 2025-01-17 Lanling Xu , Junjie Zhang , Bingqian Li , Jinpeng Wang , Sheng Chen , Wayne Xin Zhao , Ji-Rong Wen

Large Language Model (LLM) has transformative potential in various domains, including recommender systems (RS). There have been a handful of research that focuses on empowering the RS by LLM. However, previous efforts mainly focus on LLM as…

Information Retrieval · Computer Science 2025-03-11 Qidong Liu , Xiangyu Zhao , Yuhao Wang , Yejing Wang , Zijian Zhang , Yuqi Sun , Xiang Li , Maolin Wang , Pengyue Jia , Chong Chen , Wei Huang , Feng Tian

Information technology has profoundly altered the way humans interact with information. The vast amount of content created, shared, and disseminated online has made it increasingly difficult to access relevant information. Over the past two…

Information Retrieval · Computer Science 2025-04-14 Yu Zhang , Shutong Qiao , Jiaqi Zhang , Tzu-Heng Lin , Chen Gao , Yong Li

In the era of information overload, recommendation systems play a pivotal role in filtering data and delivering personalized content. Recent advancements in feature interaction and user behavior modeling have significantly enhanced the…

Information Retrieval · Computer Science 2025-02-20 Hao Wang , Wei Guo , Luankang Zhang , Jin Yao Chin , Yufei Ye , Huifeng Guo , Yong Liu , Defu Lian , Ruiming Tang , Enhong Chen

Recent advances in Large Language Models (LLMs) highlight the need to align their behaviors with human values. A critical, yet understudied, issue is the potential divergence between an LLM's stated preferences (its reported alignment with…

Artificial Intelligence · Computer Science 2025-06-03 Zhuojun Gu , Quan Wang , Shuchu Han

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

Computation and Language · Computer Science 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

Information Retrieval · Computer Science 2025-05-16 Alejo Lopez-Avila , Jinhua Du

The rapid development of Large Language Models (LLMs) creates new opportunities for recommender systems, especially by exploiting the side information (e.g., descriptions and analyses of items) generated by these models. However, aligning…

Information Retrieval · Computer Science 2025-04-14 Guixian Zhang , Guan Yuan , Debo Cheng , Lin Liu , Jiuyong Li , Shichao Zhang

Large language models (LLMs) have demonstrated impressive zero-shot abilities in solving a wide range of general-purpose tasks. However, it is empirically found that LLMs fall short in recognizing and utilizing temporal information,…

Information Retrieval · Computer Science 2024-05-07 Zhendong Chu , Zichao Wang , Ruiyi Zhang , Yangfeng Ji , Hongning Wang , Tong Sun

Large Reasoning Models (LRMs) like DeepSeek-R1 and OpenAI-o1 have demonstrated remarkable reasoning capabilities, raising important questions about their biases in LLM-as-a-judge settings. We present a comprehensive benchmark comparing…

Computers and Society · Computer Science 2025-04-21 Qian Wang , Zhanzhi Lou , Zhenheng Tang , Nuo Chen , Xuandong Zhao , Wenxuan Zhang , Dawn Song , Bingsheng He

Recently, the powerful large language models (LLMs) have been instrumental in propelling the progress of recommender systems (RS). However, while these systems have flourished, their susceptibility to security threats has been largely…

Computation and Language · Computer Science 2024-06-06 Jinghao Zhang , Yuting Liu , Qiang Liu , Shu Wu , Guibing Guo , Liang Wang

As large language models (LLMs) shape AI development, ensuring ethical prompt recommendations is crucial. LLMs offer innovation but risk bias, fairness issues, and accountability concerns. Traditional oversight methods struggle with…

Information Retrieval · Computer Science 2026-01-27 Jordan Nelson , Almas Baimagambetov , Konstantinos Avgerinakis , Nikolaos Polatidis