English
Related papers

Related papers: Do Large Language Models Know What They Don't Know…

200 papers

Large language models (LLMs) have demonstrated substantial commonsense understanding through numerous benchmark evaluations. However, their understanding of cultural commonsense remains largely unexamined. In this paper, we conduct a…

Computation and Language · Computer Science 2024-05-09 Siqi Shen , Lajanugen Logeswaran , Moontae Lee , Honglak Lee , Soujanya Poria , Rada Mihalcea

How do large language models (LLMs) know what they know? Answering this question has been difficult because pre-training data is often a "black box" - unknown or inaccessible. The recent release of nanochat - a family of small LLMs with…

Computation and Language · Computer Science 2026-05-01 Lingwei Gu , Nour Jedidi , Jimmy Lin

Large vision-language models (LVLMs) demonstrate strong visual question answering (VQA) capabilities but are shown to hallucinate. A reliable model should perceive its knowledge boundaries-knowing what it knows and what it does not. This…

Computation and Language · Computer Science 2025-08-27 Zhikai Ding , Shiyu Ni , Keping Bi

Large language models (LLMs) have led to a series of breakthroughs in natural language processing (NLP), owing to their excellent understanding and generation abilities. Remarkably, what further sets these models apart is the massive…

Computation and Language · Computer Science 2022-11-10 Daliang Li , Ankit Singh Rawat , Manzil Zaheer , Xin Wang , Michal Lukasik , Andreas Veit , Felix Yu , Sanjiv Kumar

Large language models (LLMs) could be valuable personal AI agents across various domains, provided they can precisely follow user instructions. However, recent studies have shown significant limitations in LLMs' instruction-following…

Artificial Intelligence · Computer Science 2025-03-31 Juyeon Heo , Miao Xiong , Christina Heinze-Deml , Jaya Narain

Large language models (LLMs) have achieved great success, but their occasional content fabrication, or hallucination, limits their practical application. Hallucination arises because LLMs struggle to admit ignorance due to inadequate…

Computation and Language · Computer Science 2024-06-18 Lida Chen , Zujie Liang , Xintao Wang , Jiaqing Liang , Yanghua Xiao , Feng Wei , Jinglei Chen , Zhenghong Hao , Bing Han , Wei Wang

Large language models (LLMs) often encounter knowledge conflicts, scenarios where discrepancy arises between the internal parametric knowledge of LLMs and non-parametric information provided in the prompt context. In this work we ask what…

Computation and Language · Computer Science 2024-10-16 Yike Wang , Shangbin Feng , Heng Wang , Weijia Shi , Vidhisha Balachandran , Tianxing He , Yulia Tsvetkov

Large Language Models (LLMs) are known for their remarkable ability to generate synthesized 'knowledge', such as text documents, music, images, etc. However, there is a huge gap between LLM's and human capabilities for understanding…

Computation and Language · Computer Science 2024-08-14 Vladimir Cherkassky , Eng Hock Lee

Large Language Models are known to capture real-world knowledge, allowing them to excel in many downstream tasks. Despite recent advances, these models are still prone to what are commonly known as hallucinations, causing them to emit…

Computation and Language · Computer Science 2025-05-28 Roi Cohen , Omri Fahn , Gerard de Melo

Previous work has showcased the intriguing capability of large language models (LLMs) in retrieving facts and processing context knowledge. However, only limited research exists on the layer-wise capability of LLMs to encode knowledge,…

Computation and Language · Computer Science 2024-03-05 Tianjie Ju , Weiwei Sun , Wei Du , Xinwei Yuan , Zhaochun Ren , Gongshen Liu

Large language models (LLMs) have revolutionized numerous domains with their impressive performance but still face their challenges. A predominant issue is the propensity for these models to generate non-existent facts, a concern termed…

Computation and Language · Computer Science 2024-06-10 Hanning Zhang , Shizhe Diao , Yong Lin , Yi R. Fung , Qing Lian , Xingyao Wang , Yangyi Chen , Heng Ji , Tong Zhang

Self-recognition is a crucial metacognitive capability for AI systems, relevant not only for psychological analysis but also for safety, particularly in evaluative scenarios. Motivated by contradictory interpretations of whether models…

Artificial Intelligence · Computer Science 2025-10-07 Xiaoyan Bai , Aryan Shrivastava , Ari Holtzman , Chenhao Tan

Knowledge plays a critical role in artificial intelligence. Recently, the extensive success of pre-trained language models (PLMs) has raised significant attention about how knowledge can be acquired, maintained, updated and used by language…

Computation and Language · Computer Science 2024-04-04 Boxi Cao , Hongyu Lin , Xianpei Han , Le Sun

Large Language Models (LLMs) have been transformative. They are pre-trained foundational models that are self-supervised and can be adapted with fine tuning to a wide range of natural language tasks, each of which previously would have…

Computation and Language · Computer Science 2023-02-22 Terrence Sejnowski

Large language models (LLMs) are widely used in decision-making, but their reliability, especially in critical tasks like healthcare, is not well-established. Therefore, understanding how LLMs reason and make decisions is crucial for their…

Machine Learning · Computer Science 2025-02-25 Ze Yu Zhang , Arun Verma , Finale Doshi-Velez , Bryan Kian Hsiang Low

Large pre-trained language models have demonstrated their proficiency in storing factual knowledge within their parameters and achieving remarkable results when fine-tuned for downstream natural language processing tasks. Nonetheless, their…

Computation and Language · Computer Science 2023-09-29 Konstantinos Andriopoulos , Johan Pouwelse

Honesty is a fundamental principle for aligning large language models (LLMs) with human values, requiring these models to recognize what they know and don't know and be able to faithfully express their knowledge. Despite promising, current…

Computation and Language · Computer Science 2024-09-30 Siheng Li , Cheng Yang , Taiqiang Wu , Chufan Shi , Yuji Zhang , Xinyu Zhu , Zesen Cheng , Deng Cai , Mo Yu , Lemao Liu , Jie Zhou , Yujiu Yang , Ngai Wong , Xixin Wu , Wai Lam

Large language models (LLMs) have learned vast amounts of factual knowledge through self-supervised pre-training on large-scale corpora. Meanwhile, LLMs have also demonstrated excellent multilingual capabilities, which can express the…

Computation and Language · Computer Science 2024-11-27 Pengfei Cao , Yuheng Chen , Zhuoran Jin , Yubo Chen , Kang Liu , Jun Zhao

Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing styles, and preferences. Personalized Large Language Models…

Artificial Intelligence · Computer Science 2025-09-23 Jiahong Liu , Zexuan Qiu , Zhongyang Li , Quanyu Dai , Wenhao Yu , Jieming Zhu , Minda Hu , Menglin Yang , Tat-Seng Chua , Irwin King

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen