English
Related papers

Related papers: Whose Facts Win? LLM Source Preferences under Know…

200 papers

Citation practices are crucial in shaping the structure of scientific knowledge, yet they are often influenced by contemporary norms and biases. The emergence of Large Language Models (LLMs) introduces a new dynamic to these practices.…

Digital Libraries · Computer Science 2024-08-27 Andres Algaba , Carmen Mazijn , Vincent Holst , Floriano Tori , Sylvia Wenmackers , Vincent Ginis

Large Language Models (LLMs) have demonstrated strong performance as knowledge repositories, enabling models to understand user queries and generate accurate and context-aware responses. Extensive evaluation setups have corroborated the…

Computation and Language · Computer Science 2024-11-19 Prasoon Bajpai , Sarah Masud , Tanmoy Chakraborty

Large Language Models (LLMs) augmented with retrieval mechanisms have demonstrated significant potential in fact-checking tasks by integrating external knowledge. However, their reliability decreases when confronted with conflicting…

Computation and Language · Computer Science 2025-05-26 Ziyu Ge , Yuhao Wu , Daniel Wai Kit Chin , Roy Ka-Wei Lee , Rui Cao

Recently, the emergence of large language models (LLMs) has revolutionized the paradigm of information retrieval (IR) applications, especially in web search, by generating vast amounts of human-like texts on the Internet. As a result, IR…

Information Retrieval · Computer Science 2024-08-01 Sunhao Dai , Yuqi Zhou , Liang Pang , Weihao Liu , Xiaolin Hu , Yong Liu , Xiao Zhang , Gang Wang , Jun Xu

Large language models (LLMs) can recall a wide range of factual knowledge across languages. However, existing factual recall evaluations primarily assess fact retrieval in isolation, where the queried entity is explicitly named and the fact…

Computation and Language · Computer Science 2026-01-21 Yihong Liu , Bingyu Xiong , Hinrich Schütze

By providing external information to large language models (LLMs), tool augmentation (including retrieval augmentation) has emerged as a promising solution for addressing the limitations of LLMs' static parametric memory. However, how…

Computation and Language · Computer Science 2024-02-28 Jian Xie , Kai Zhang , Jiangjie Chen , Renze Lou , Yu Su

Large Language Models (LLMs) often encounter conflicts between their learned, internal (parametric knowledge, PK) and external knowledge provided during inference (contextual knowledge, CK). Understanding how LLMs models prioritize one…

Computation and Language · Computer Science 2024-11-12 Zineddine Tighidet , Andrea Mogini , Jiali Mei , Benjamin Piwowarski , Patrick Gallinari

Conflicts of interest often arise between data sources and their users regarding how the users' information needs should be interpreted by the data source. For example, an online product search might be biased towards presenting certain…

Databases · Computer Science 2026-03-09 Nischal Aryal , Arash Termehchy , Marianne Winslett

The rise of large language models (LLMs) has significantly influenced the quality of information in decision-making systems, leading to the prevalence of AI-generated content and challenges in detecting misinformation and managing…

Computation and Language · Computer Science 2024-10-08 Cheng Jiayang , Chunkit Chan , Qianqian Zhuang , Lin Qiu , Tianhang Zhang , Tengxiao Liu , Yangqiu Song , Yue Zhang , Pengfei Liu , Zheng Zhang

This paper presents a reproducibility study examining how Large Language Models (LLMs) manage competing factual and counterfactual information, focusing on the role of attention heads in this process. We attempt to reproduce and reconcile…

Computation and Language · Computer Science 2025-07-17 Dante Campregher , Yanxu Chen , Sander Hoffman , Maria Heuss

Previous studies have found that PLM-based retrieval models exhibit a preference for LLM-generated content, assigning higher relevance scores to these documents even when their semantic quality is comparable to human-written ones. This…

Computation and Language · Computer Science 2025-03-12 Haoyu Wang , Sunhao Dai , Haiyuan Zhao , Liang Pang , Xiao Zhang , Gang Wang , Zhenhua Dong , Jun Xu , Ji-Rong Wen

Large language models (LLMs) have shown impressive prowess in solving a wide range of tasks with world knowledge. However, it remains unclear how well LLMs are able to perceive their factual knowledge boundaries, particularly under…

Computation and Language · Computer Science 2024-11-20 Ruiyang Ren , Yuhao Wang , Yingqi Qu , Wayne Xin Zhao , Jing Liu , Hao Tian , Hua Wu , Ji-Rong Wen , Haifeng Wang

I report here a comprehensive analysis about the political preferences embedded in Large Language Models (LLMs). Namely, I administer 11 political orientation tests, designed to identify the political preferences of the test taker, to 24…

Computers and Society · Computer Science 2024-06-04 David Rozado

Large Language Models (LLMs) encode vast world knowledge across multiple languages, yet their internal beliefs are often unevenly distributed across linguistic spaces. When external evidence contradicts these language-dependent memories,…

Computation and Language · Computer Science 2026-01-13 Jiaqi Zhao , Qiang Huang , Haodong Chen , Xiaoxing You , Jun Yu

The proliferation of large language models (LLMs) has significantly advanced intelligent systems. Unfortunately, LLMs often face knowledge conflicts between internal memory and retrieved external information, arising from misinformation,…

Computation and Language · Computer Science 2025-11-18 Jiatai Wang , Zhiwei Xu , Di Jin , Xuewen Yang , Tao Li

Large language models (LLMs) encode parametric knowledge about world facts and have shown remarkable performance in knowledge-driven NLP tasks. However, their reliance on parametric knowledge may cause them to overlook contextual cues,…

Computation and Language · Computer Science 2023-10-24 Wenxuan Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

Large Language Models (LLMs) are transforming writing, reading, teaching, and knowledge retrieval in many academic fields. However, concerns regarding their misuse and erroneous outputs have led to varying degrees of trust in LLMs within…

Computers and Society · Computer Science 2025-02-10 Minseok Jung , Aurora Zhang , May Fung , Junho Lee , Paul Pu Liang

Recent advances in large language models (LLMs) have brought public and scholarly attention to their potential in generating low-quality information. While widely acknowledged as a risk, low-quality information remains a vaguely defined…

Human-Computer Interaction · Computer Science 2025-11-06 Jiawei Zhou , Amy Z. Chen , Darshi Shah , Laura M. Schwab-Reese , Munmun De Choudhury

The proliferation of fake news has had far-reaching implications on politics, the economy, and society at large. While Fake news detection methods have been employed to mitigate this issue, they primarily depend on two essential elements:…

Computation and Language · Computer Science 2024-03-18 Guanghua Li , Wensheng Lu , Wei Zhang , Defu Lian , Kezhong Lu , Rui Mao , Kai Shu , Hao Liao

When we integrate factual knowledge from knowledge graphs (KGs) into large language models (LLMs) to enhance their performance, the cost of injection through training increases with the scale of the models. Consequently, there is…

Computation and Language · Computer Science 2025-01-24 Xinbang Dai , Yuncheng Hua , Tongtong Wu , Yang Sheng , Qiu Ji , Guilin Qi