中文
相关论文

相关论文: Head-to-Tail: How Knowledgeable are Large Language…

200 篇论文

Large Language Models (LLMs) have garnered significant attention due to their remarkable ability to process information across various languages. Despite their capabilities, they exhibit inconsistencies in handling identical queries in…

计算与语言 · 计算机科学 2024-06-24 Yue Huang , Chenrui Fan , Yuan Li , Siyuan Wu , Tianyi Zhou , Xiangliang Zhang , Lichao Sun

Large Language Models (LLMs) can make up answers that are not real, and this is known as hallucination. This research aims to see if, how, and to what extent LLMs are aware of hallucination. More specifically, we check whether and how an…

计算与语言 · 计算机科学 2024-02-16 Hanyu Duan , Yi Yang , Kar Yan Tam

Large language models (LLMs) have garnered significant attention for their superior performance in many knowledge-driven applications on the world wide web.These models are designed to train hundreds of millions or more parameters on large…

计算与语言 · 计算机科学 2025-04-09 Bingchen Liu , Yuanyuan Fang , Naixing Xu , Shihao Hou , Xin Li , Qian Li

Large Language Models (LLMs) tend to be unreliable in the factuality of their answers. To address this problem, NLP researchers have proposed a range of techniques to estimate LLM's confidence over facts. However, due to the lack of a…

计算与语言 · 计算机科学 2024-11-28 Matéo Mahaut , Laura Aina , Paula Czarnowska , Momchil Hardalov , Thomas Müller , Lluís Màrquez

Large Language Models (LLMs) have been transformative. They are pre-trained foundational models that are self-supervised and can be adapted with fine tuning to a wide range of natural language tasks, each of which previously would have…

计算与语言 · 计算机科学 2023-02-22 Terrence Sejnowski

Large language models (LLMs) have a wealth of knowledge that allows them to excel in various Natural Language Processing (NLP) tasks. Current research focuses on enhancing their performance within their existing knowledge. Despite their…

计算与语言 · 计算机科学 2023-05-31 Zhangyue Yin , Qiushi Sun , Qipeng Guo , Jiawen Wu , Xipeng Qiu , Xuanjing Huang

Knowledge-enhanced language models (KELMs) have emerged as promising tools to bridge the gap between large-scale language models and domain-specific knowledge. KELMs can achieve higher factual accuracy and mitigate hallucinations by…

计算与语言 · 计算机科学 2024-11-26 Alexander Fichtl , Juraj Vladika , Georg Groh

Entity alignment, which is a prerequisite for creating a more comprehensive Knowledge Graph (KG), involves pinpointing equivalent entities across disparate KGs. Contemporary methods for entity alignment have predominantly utilized knowledge…

计算与语言 · 计算机科学 2024-01-31 Linyao Yang , Hongyang Chen , Xiao Wang , Jing Yang , Fei-Yue Wang , Han Liu

Large language models (LLMs) have demonstrated impressive capabilities in various reasoning tasks but face significant challenges with complex, knowledge-intensive multi-hop queries, particularly those involving new or long-tail knowledge.…

计算与语言 · 计算机科学 2025-08-25 Jie He , Nan Hu , Wanqiu Long , Jiaoyan Chen , Jeff Z. Pan

Large language models (LLMs), while exhibiting exceptional performance, suffer from hallucinations, especially on knowledge-intensive tasks. Existing works propose to augment LLMs with individual text units retrieved from external knowledge…

计算与语言 · 计算机科学 2024-10-04 Bowen Jin , Chulin Xie , Jiawei Zhang , Kashob Kumar Roy , Yu Zhang , Zheng Li , Ruirui Li , Xianfeng Tang , Suhang Wang , Yu Meng , Jiawei Han

Previous literatures show that pre-trained masked language models (MLMs) such as BERT can achieve competitive factual knowledge extraction performance on some datasets, indicating that MLMs can potentially be a reliable knowledge source. In…

计算与语言 · 计算机科学 2021-06-18 Boxi Cao , Hongyu Lin , Xianpei Han , Le Sun , Lingyong Yan , Meng Liao , Tong Xue , Jin Xu

Large Language Models (LLMs) have achieved significant success in open-domain question answering. However, they continue to face challenges such as hallucinations and knowledge cutoffs. These issues can be mitigated through in-context…

计算与语言 · 计算机科学 2025-02-19 Zukang Yang , Zixuan Zhu , Xuan Zhu

With the development of large language models (LLMs) like the GPT series, their widespread use across various application scenarios presents a myriad of challenges. This review initially explores the issue of domain specificity, where LLMs…

计算与语言 · 计算机科学 2023-10-23 Xiaoliang Chen , Liangbin Li , Le Chang , Yunhe Huang , Yuxuan Zhao , Yuxiao Zhang , Dinuo Li

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose structural fidelity…

机器学习 · 计算机科学 2025-05-13 Erica Coppolillo

LLMs' sources of knowledge are data snapshots containing factual information about entities collected at different timestamps and from different media types (e.g. wikis, social media, etc.). Such unstructured knowledge is subject to change…

计算与语言 · 计算机科学 2026-03-18 Seyed Mahed Mousavi , Simone Alghisi , Giuseppe Riccardi

Large language models (LLMs), such as ChatGPT and GPT4, are making new waves in the field of natural language processing and artificial intelligence, due to their emergent ability and generalizability. However, LLMs are black-box models,…

计算与语言 · 计算机科学 2024-01-26 Shirui Pan , Linhao Luo , Yufei Wang , Chen Chen , Jiapu Wang , Xindong Wu

Large Language Models (LLMs) may suffer from hallucinations in real-world applications due to the lack of relevant knowledge. In contrast, knowledge graphs encompass extensive, multi-relational structures that store a vast array of symbolic…

计算与语言 · 计算机科学 2024-09-06 Jie Ma , Zhitao Gao , Qi Chai , Wangchun Sun , Pinghui Wang , Hongbin Pei , Jing Tao , Lingyun Song , Jun Liu , Chen Zhang , Lizhen Cui

Multimodal reasoning with large language models (LLMs) often suffers from hallucinations and the presence of deficient or outdated knowledge within LLMs. Some approaches have sought to mitigate these issues by employing textual knowledge…

计算与语言 · 计算机科学 2024-06-06 Junlin Lee , Yequan Wang , Jing Li , Min Zhang

Large language models (LLMs) tend to generate homogenous texts, which may impact the diversity of knowledge generated across different outputs. Given their potential to replace existing forms of knowledge acquisition, this poses a risk of…

Recent work utilizes Large Language Models (LLMs) for topic modeling, generating comprehensible topic labels for given documents. However, their performance has mainly been evaluated qualitatively, and there remains room for quantitative…

计算与语言 · 计算机科学 2024-06-26 Tomoki Doi , Masaru Isonuma , Hitomi Yanaka