中文
相关论文

相关论文: What Do Large Language Models Know? Tacit Knowledg…

200 篇论文

Word co-occurrence patterns in language corpora contain a surprising amount of conceptual knowledge. Large language models (LLMs), trained to predict words in context, leverage these patterns to achieve impressive performance on diverse…

Large language models (LLMs) have a wealth of knowledge that allows them to excel in various Natural Language Processing (NLP) tasks. Current research focuses on enhancing their performance within their existing knowledge. Despite their…

计算与语言 · 计算机科学 2023-05-31 Zhangyue Yin , Qiushi Sun , Qipeng Guo , Jiawen Wu , Xipeng Qiu , Xuanjing Huang

Artificial intelligence (AI) systems hold great promise for advancing various scientific disciplines, and are increasingly used in real-world applications. Despite their remarkable progress, further capabilities are expected in order to…

人工智能 · 计算机科学 2025-12-05 Drago Plecko , Patrik Okanovic , Shreyas Havaldar , Torsten Hoefler , Elias Bareinboim

Are Large language models (LLMs) temporally grounded? Since LLMs cannot perceive and interact with the environment, it is impossible to answer this question directly. Instead, we provide LLMs with textual narratives and probe them with…

计算与语言 · 计算机科学 2023-11-17 Yifu Qiu , Zheng Zhao , Yftah Ziser , Anna Korhonen , Edoardo M. Ponti , Shay B. Cohen

Large language models (LLMs) like ChatGPT have shown significant advancements across diverse natural language understanding (NLU) tasks, including intelligent dialogue and autonomous agents. Yet, lacking widely acknowledged testing…

计算与语言 · 计算机科学 2024-05-10 Jinyang Wu , Feihu Che , Xinxin Zheng , Shuai Zhang , Ruihan Jin , Shuai Nie , Pengpeng Shao , Jianhua Tao

The capabilities of large language models (LLMs) have raised concerns about their potential to create and propagate convincing narratives. Here, we study their performance in detecting convincing arguments to gain insights into LLMs'…

计算与语言 · 计算机科学 2024-10-07 Paula Rescala , Manoel Horta Ribeiro , Tiancheng Hu , Robert West

Large Language Models (LLMs) have been transformative. They are pre-trained foundational models that are self-supervised and can be adapted with fine tuning to a wide range of natural language tasks, each of which previously would have…

计算与语言 · 计算机科学 2023-02-22 Terrence Sejnowski

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

计算与语言 · 计算机科学 2024-04-16 Spencer M. Seals , Valerie L. Shalin

Recent research investigates factual knowledge stored in large pretrained language models (PLMs). Instead of structural knowledge base (KB) queries, masked sentences such as "Paris is the capital of [MASK]" are used as probes. The good…

计算与语言 · 计算机科学 2021-04-16 Philipp Dufter , Nora Kassner , Hinrich Schütze

One of the major aspects contributing to the striking performance of large language models (LLMs) is the vast amount of factual knowledge accumulated during pre-training. Yet, many LLMs suffer from self-inconsistency, which raises doubts…

计算与语言 · 计算机科学 2024-10-07 Anastasiia Sedova , Robert Litschko , Diego Frassinelli , Benjamin Roth , Barbara Plank

Large language models (LLMs) have learned vast amounts of factual knowledge through self-supervised pre-training on large-scale corpora. Meanwhile, LLMs have also demonstrated excellent multilingual capabilities, which can express the…

计算与语言 · 计算机科学 2024-11-27 Pengfei Cao , Yuheng Chen , Zhuoran Jin , Yubo Chen , Kang Liu , Jun Zhao

Large language models (LLMs) have shown remarkable performances across a wide range of tasks. However, the mechanisms by which these models encode tasks of varying complexities remain poorly understood. In this paper, we explore the…

The widespread public deployment of large language models (LLMs) in recent months has prompted a wave of new attention and engagement from advocates, policymakers, and scholars from many fields. This attention is a timely response to the…

计算与语言 · 计算机科学 2023-04-04 Samuel R. Bowman

Large Language Models (LLMs), with their abilities in knowledge acquisition and reasoning, can potentially enhance the various aspects of Self-adaptive Systems (SAS). Yet, the potential of LLMs in SAS remains largely unexplored and…

软件工程 · 计算机科学 2024-01-17 Jialong Li , Mingyue Zhang , Nianyu Li , Danny Weyns , Zhi Jin , Kenji Tei

What can large language models learn? By definition, language models (LM) are distributions over strings. Therefore, an intuitive way of addressing the above question is to formalize it as a matter of learnability of classes of…

Despite the recent observation that large language models (LLMs) can store substantial factual knowledge, there is a limited understanding of the mechanisms of how they acquire factual knowledge through pretraining. This work addresses this…

计算与语言 · 计算机科学 2024-11-13 Hoyeon Chang , Jinho Park , Seonghyeon Ye , Sohee Yang , Youngkyung Seo , Du-Seong Chang , Minjoon Seo

In this work, we evaluate the potential of Large Language Models (LLMs) in building Bayesian Networks (BNs) by approximating domain expert priors. LLMs have demonstrated potential as factual knowledge bases; however, their capability to…

计算与语言 · 计算机科学 2025-08-12 Aliakbar Nafar , Kristen Brent Venable , Zijun Cui , Parisa Kordjamshidi

Large language models (LLMs) are trained on vast amounts of data to generate natural language, enabling them to perform tasks like text summarization and question answering. These models have become popular in artificial intelligence (AI)…

Large language models (LLMs) have multilingual capabilities and can solve tasks across various languages. However, we show that current LLMs make key decisions in a representation space closest to English, regardless of their input and…

计算与语言 · 计算机科学 2025-02-24 Lisa Schut , Yarin Gal , Sebastian Farquhar

The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to infer others' beliefs, intentions, and emotions from text. Given that LLMs are trained on language…

计算与语言 · 计算机科学 2026-03-20 Anna Babarczy , Andras Lukacs , Peter Vedres , Zeteny Bujka