English
Related papers

Related papers: How Knowledge Popularity Influences and Enhances L…

200 papers

Large Language Models (LLMs) have emerged as highly capable systems and are increasingly being integrated into various uses. However, the rapid pace of their deployment has outpaced a comprehensive understanding of their internal mechanisms…

Computation and Language · Computer Science 2025-10-27 Gabriele Prato , Jerry Huang , Prasanna Parthasarathi , Shagun Sodhani , Sarath Chandar

Language models (LMs) encode world knowledge in their internal parameters through training. However, LMs may learn personal and confidential information from the training data, leading to privacy concerns such as data leakage. Therefore,…

Computation and Language · Computer Science 2024-06-11 Ryosuke Takahashi , Go Kamoda , Benjamin Heinzerling , Keisuke Sakaguchi , Kentaro Inui

If a Large Language Model (LLM) answers "yes" to the question "Are mountains tall?" then does it know what a mountain is? Can you rely on it responding correctly or incorrectly to other questions about mountains? The success of Large…

Computation and Language · Computer Science 2022-10-03 Pritish Sahu , Michael Cogswell , Yunye Gong , Ajay Divakaran

Knowledge augmentation has significantly enhanced the performance of Large Language Models (LLMs) in knowledge-intensive tasks. However, existing methods typically operate on the simplistic premise that model performance equates with…

Computation and Language · Computer Science 2026-02-16 Hao Chen , Ye He , Yuchun Fan , Yukun Yan , Zhenghao Liu , Qingfu Zhu , Maosong Sun , Wanxiang Che

Large Language Models (LLMs) have acquired ubiquitous attention for their performances across diverse domains. Our study here searches through LLMs' cognitive abilities and confidence dynamics. We dive deep into understanding the alignment…

Computation and Language · Computer Science 2023-09-29 Aniket Kumar Singh , Suman Devkota , Bishal Lamichhane , Uttam Dhakal , Chandra Dhakal

Large language models (LLMs) have achieved great success, but their occasional content fabrication, or hallucination, limits their practical application. Hallucination arises because LLMs struggle to admit ignorance due to inadequate…

Computation and Language · Computer Science 2024-06-18 Lida Chen , Zujie Liang , Xintao Wang , Jiaqing Liang , Yanghua Xiao , Feng Wei , Jinglei Chen , Zhenghong Hao , Bing Han , Wei Wang

As large language models (LLMs) are more frequently used in retrieval-augmented generation pipelines, it is increasingly relevant to study their behavior under knowledge conflicts. Thus far, the role of the source of the retrieved…

Computation and Language · Computer Science 2026-04-20 Jakob Schuster , Vagrant Gautam , Katja Markert

Large Language Models (LLMs) have revolutionized numerous applications, making them an integral part of our digital ecosystem. However, their reliability becomes critical, especially when these models are exposed to misinformation. We…

Computation and Language · Computer Science 2024-09-12 Alina Fastowski , Gjergji Kasneci

Large Language Models (LLMs) have gained significant popularity in recent years for their ability to answer questions in various fields. However, these models have a tendency to "hallucinate" their responses, making it challenging to…

Computation and Language · Computer Science 2024-11-25 Elizaveta Reganova , Peter Steinbach

Large Language Models (LLMs) have shown the impressive capability of answering questions in a wide range of scenarios. However, when LLMs face different types of questions, it is worth exploring whether LLMs are aware that some questions…

Computation and Language · Computer Science 2024-10-02 Dongjie Yang , Hai Zhao

The conformity effect describes the tendency of individuals to align their responses with the majority. Studying this bias in large language models (LLMs) is crucial, as LLMs are increasingly used in various information-seeking and…

Computation and Language · Computer Science 2025-05-27 Xiaochen Zhu , Caiqi Zhang , Tom Stafford , Nigel Collier , Andreas Vlachos

Large language models encapsulate knowledge and have demonstrated superior performance on various natural language processing tasks. Recent studies have localized this knowledge to specific model parameters, such as the MLP weights in…

Computation and Language · Computer Science 2024-09-04 Yifan Wei , Xiaoyan Yu , Yixuan Weng , Huanhuan Ma , Yuanzhe Zhang , Jun Zhao , Kang Liu

LLMs and AI chatbots have improved people's efficiency in various fields. However, the necessary knowledge for answering the question may be beyond the models' knowledge boundaries. To mitigate this issue, many researchers try to introduce…

Computation and Language · Computer Science 2023-11-15 Yi Liu , Lianzhe Huang , Shicheng Li , Sishuo Chen , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun

The issue of popularity bias -- where popular items are disproportionately recommended, overshadowing less popular but potentially relevant items -- remains a significant challenge in recommender systems. Recent advancements have seen the…

Information Retrieval · Computer Science 2024-06-04 Jan Malte Lichtenberg , Alexander Buchholz , Pola Schwöbel

Semantic understanding of popularity bias is a crucial yet underexplored challenge in recommender systems, where popular items are often favored at the expense of niche content. Most existing debiasing methods treat the semantic…

Information Retrieval · Computer Science 2026-01-21 Renqiang Luo , Dong Zhang , Yupeng Gao , Wen Shi , Mingliang Hou , Jiaying Liu , Zhe Wang , Shuo Yu

In modern dialogue systems, the use of Large Language Models (LLMs) has grown exponentially due to their capacity to generate diverse, relevant, and creative responses. Despite their strengths, striking a balance between the LLMs'…

Computation and Language · Computer Science 2023-08-01 Chen Zhang

The veracity of a factoid is largely independent of the language it is written in. However, language models are inconsistent in their ability to answer the same factual question across languages. This raises questions about how LLMs…

Computation and Language · Computer Science 2024-08-21 Maxim Ifergan , Leshem Choshen , Roee Aharoni , Idan Szpektor , Omri Abend

Large Language Models (LLMs) have been found to have difficulty knowing they do not possess certain knowledge and tend to provide specious answers in such cases. Retrieval Augmentation (RA) has been extensively studied to mitigate LLMs'…

Computation and Language · Computer Science 2024-06-12 Shiyu Ni , Keping Bi , Jiafeng Guo , Xueqi Cheng

Large language models (LLMs) are widely used in decision-making, but their reliability, especially in critical tasks like healthcare, is not well-established. Therefore, understanding how LLMs reason and make decisions is crucial for their…

Machine Learning · Computer Science 2025-02-25 Ze Yu Zhang , Arun Verma , Finale Doshi-Velez , Bryan Kian Hsiang Low

Question answering models can use rich knowledge sources -- up to one hundred retrieved passages and parametric knowledge in the large-scale language model (LM). Prior work assumes information in such knowledge sources is consistent with…

Computation and Language · Computer Science 2022-10-26 Hung-Ting Chen , Michael J. Q. Zhang , Eunsol Choi