中文
相关论文

相关论文: Do Large Language Models Know How Much They Know?

200 篇论文

The rapid development of artificial intelligence has led to marked progress in the field. One interesting direction for research is whether Large Language Models (LLMs) can be integrated with structured knowledge-based systems. This…

计算与语言 · 计算机科学 2025-05-02 Wenli Yang , Lilian Some , Michael Bain , Byeong Kang

Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as autonomous agents to do many tasks automatically. Recently,…

计算与语言 · 计算机科学 2024-04-22 Taicheng Guo , Xiuying Chen , Yaqi Wang , Ruidi Chang , Shichao Pei , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

Large language models (LLMs) have been extensively studied for their abilities to generate convincing natural language sequences, however their utility for quantitative information retrieval is less well understood. Here we explore the…

Over time, a growing wave of large language models from various series has been introduced to the community. Researchers are striving to maximize the performance of language models with constrained parameter sizes. However, from a…

计算与语言 · 计算机科学 2025-11-24 Yihuai Hong , Yiran Zhao , Wei Tang , Yang Deng , Yu Rong , Wenxuan Zhang

Although Large Language Models (LLMs) demonstrate strong capabilities across various tasks, they exhibit significant performance discrepancies across languages. While prompting LLMs in English typically yields the highest general…

计算与语言 · 计算机科学 2026-05-26 Andrew Ivan Soegeng , Patrick Sutanto , Tan Sang Nguyen

Building a theoretical understanding of the capabilities of large language models (LLMs) is vital for our ability to predict and explain the behavior of these systems. Here, we investigate the structure of LLM capabilities by extracting…

计算与语言 · 计算机科学 2023-06-21 Ryan Burnell , Han Hao , Andrew R. A. Conway , Jose Hernandez Orallo

Large language models (LLMs) are trained on vast amounts of data to generate natural language, enabling them to perform tasks like text summarization and question answering. These models have become popular in artificial intelligence (AI)…

Large Language Models (LLMs) store and retrieve vast amounts of factual knowledge acquired during pre-training. Prior research has localized and identified mechanisms behind knowledge recall; however, it has only focused on English…

计算与语言 · 计算机科学 2025-06-12 Constanza Fierro , Negar Foroutan , Desmond Elliott , Anders Søgaard

In this study, we delve into the validity of conventional personality questionnaires in capturing the human-like personality traits of Large Language Models (LLMs). Our objective is to assess the congruence between the personality traits…

计算与语言 · 计算机科学 2024-12-11 Yiming Ai , Zhiwei He , Ziyin Zhang , Wenhong Zhu , Hongkun Hao , Kai Yu , Lingjun Chen , Rui Wang

Large language models (LLMs) have recently driven striking performance improvements across a range of natural language processing tasks. The factual knowledge acquired during pretraining and instruction tuning can be useful in various…

计算与语言 · 计算机科学 2023-10-10 Xuming Hu , Junzhe Chen , Xiaochuan Li , Yufei Guo , Lijie Wen , Philip S. Yu , Zhijiang Guo

Despite the impressive performance of Large Language Models (LLM) for various natural language processing tasks, little is known about their comprehension of geographic data and related ability to facilitate informed geospatial…

计算与语言 · 计算机科学 2023-10-23 Prabin Bhandari , Antonios Anastasopoulos , Dieter Pfoser

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

计算与语言 · 计算机科学 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

Large Language Models (LLMs) are leading a new technological revolution as one of the most promising research streams toward artificial general intelligence. The scaling of these models, accomplished by increasing the number of parameters…

机器学习 · 计算机科学 2025-03-17 Leonardo Berti , Flavio Giorgi , Gjergji Kasneci

Large language models (LLMs) have shown remarkable performances across a wide range of tasks. However, the mechanisms by which these models encode tasks of varying complexities remain poorly understood. In this paper, we explore the…

Large language models (LLMs) often encounter knowledge conflicts, scenarios where discrepancy arises between the internal parametric knowledge of LLMs and non-parametric information provided in the prompt context. In this work we ask what…

计算与语言 · 计算机科学 2024-10-16 Yike Wang , Shangbin Feng , Heng Wang , Weijia Shi , Vidhisha Balachandran , Tianxing He , Yulia Tsvetkov

Large Language Models (LLMs) have garnered considerable interest due to their impressive natural language capabilities, which in conjunction with various emergent properties make them versatile tools in workflows ranging from complex code…

材料科学 · 物理学 2024-10-22 Ge Lei , Ronan Docherty , Samuel J. Cooper

There is vivid research on adapting Large Language Models (LLMs) to perform a variety of tasks in high-stakes domains such as healthcare. Despite their popularity, there is a lack of understanding of the extent and contributing factors that…

Driven by vast and diverse textual data, large language models (LLMs) have demonstrated impressive performance across numerous natural language processing (NLP) tasks. Yet, a critical question persists: does their generalization arise from…

计算与语言 · 计算机科学 2025-09-08 Boxiang Ma , Ru Li , Yuanlong Wang , Hongye Tan , Xiaoli Li

Large language models (LLMs) have been found to produce hallucinations when the question exceeds their internal knowledge boundaries. A reliable model should have a clear perception of its knowledge boundaries, providing correct answers…

计算与语言 · 计算机科学 2024-08-20 Shiyu Ni , Keping Bi , Lulu Yu , Jiafeng Guo

Large Language Models (LLMs) are becoming increasingly popular in pervasive computing due to their versatility and strong performance. However, despite their ubiquitous use, the exact mechanisms underlying their outstanding performance…

计算与语言 · 计算机科学 2026-02-02 Alhassan Abdelhalim , Janick Edinger , Sören Laue , Michaela Regneri