中文
相关论文

相关论文: Double-Calibration: Towards Reliable LLMs via Cali…

200 篇论文

Accurate confidence calibration in Large Language Models (LLMs) is critical for safe use in high-stakes domains, where clear verbalized confidence enhances user trust. Traditional methods that mimic reference confidence expressions often…

计算与语言 · 计算机科学 2025-10-29 Qing Zong , Jiayu Liu , Tianshi Zheng , Chunyang Li , Baixuan Xu , Haochen Shi , Weiqi Wang , Zhaowei Wang , Chunkit Chan , Yangqiu Song

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks in various domains. Despite their impressive performance, they can be unreliable due to factual errors in their generations. Assessing their…

计算与语言 · 计算机科学 2024-03-26 Jiahui Geng , Fengyu Cai , Yuxia Wang , Heinz Koeppl , Preslav Nakov , Iryna Gurevych

Large language models (LLMs) based on generative pre-trained Transformer have achieved remarkable performance on knowledge graph question-answering (KGQA) tasks. However, LLMs often produce ungrounded subgraph planning or reasoning results…

计算与语言 · 计算机科学 2025-03-10 Mufan Xu , Kehai Chen , Xuefeng Bai , Muyun Yang , Tiejun Zhao , Min Zhang

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

计算与语言 · 计算机科学 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

The tool-use ability of Large Language Models (LLMs) has a profound impact on a wide range of industrial applications. However, LLMs' self-control and calibration capability in appropriately using tools remains understudied. The problem is…

机器学习 · 计算机科学 2024-12-18 Yuanhao Shen , Xiaodan Zhu , Lei Chen

Can Large Language Models (LLMs) be trained to avoid hallucinating factual statements, and can Retrieval-Augmented Generation (RAG) be triggered only when necessary to reduce retrieval and computation costs? In this work, we address both…

The integration of Large Language Models (LLMs) into aviation safety decision-making represents a significant technological advancement, yet their standalone application poses critical risks due to inherent limitations such as factual…

软件工程 · 计算机科学 2026-04-16 Anirudh Iyengar , Alisa Tiselska , Dumindu Samaraweera , Hong Liu

Large language models (LLMs) have achieved remarkable performance in natural language understanding and generation tasks. However, they often suffer from limitations such as difficulty in incorporating new knowledge, generating…

人工智能 · 计算机科学 2024-03-05 Yilin Wen , Zifeng Wang , Jimeng Sun

Large Language Models (LLMs) are fluent but prone to hallucinations, producing answers that appear plausible yet are unsupported by available evidence. This failure is especially problematic in high-stakes domains where decisions must be…

计算与语言 · 计算机科学 2026-03-23 J. Ben Tamo , Yuxing Lu , Benoit L. Marteau , Micky C. Nnamdi , May D. Wang

Large language models (LLMs) have exhibited impressive capabilities across a myriad of tasks, yet they occasionally yield undesirable outputs. We posit that these limitations are rooted in the foundational autoregressive architecture of…

计算与语言 · 计算机科学 2025-03-03 Cheng Yang , Chufan Shi , Siheng Li , Bo Shui , Yujiu Yang , Wai Lam

Fine-tuned large language models (LLMs) often exhibit overconfidence, particularly when trained on small datasets, resulting in poor calibration and inaccurate uncertainty estimates. Evidential Deep Learning (EDL), an uncertainty-aware…

机器学习 · 计算机科学 2025-02-12 Yawei Li , David Rügamer , Bernd Bischl , Mina Rezaei

Improving the reasoning abilities of large language models (LLMs) has largely relied on iterative self-training with model-generated data. While effective at boosting accuracy, existing approaches primarily reinforce successful reasoning…

计算与语言 · 计算机科学 2026-01-13 Jewon Yeom , Jaewon Sok , Seonghyeon Park , Jeongjae Park , Taesup Kim

Large Language Models (LLMs) have recently emerged as a powerful paradigm for Knowledge Graph Completion (KGC), offering strong reasoning and generalization capabilities beyond traditional embedding-based approaches. However, existing…

计算与语言 · 计算机科学 2025-10-14 Wenbin Guo , Xin Wang , Jiaoyan Chen , Lingbing Guo , Zhao Li , Zirui Chen

We introduce a novel approach for calibrating uncertainty quantification (UQ) tailored for multi-modal large language models (LLMs). Existing state-of-the-art UQ methods rely on consistency among multiple responses generated by the LLM on…

Large language models (LLMs) continue to struggle with knowledge-intensive questions that require up-to-date information and multi-hop reasoning. Augmenting LLMs with hybrid external knowledge, such as unstructured text and structured…

机器学习 · 计算机科学 2026-02-12 Junhong Lin , Bing Zhang , Song Wang , Ziyan Liu , Dan Gutfreund , Julian Shun , Yada Zhu

Large language models (LLMs) have shown strong potential across a variety of tasks, but their application in the telecom field remains challenging due to domain complexity, evolving standards, and specialized terminology. Therefore,…

人工智能 · 计算机科学 2026-02-20 Dun Yuan , Hao Zhou , Xue Liu , Hao Chen , Yan Xin , Jianzhong , Zhang

Large Language Models (LLMs) have demonstrated exceptional capabilities across various machine learning (ML) tasks. Given the high costs of creating annotated datasets for supervised learning, LLMs offer a valuable alternative by enabling…

计算与语言 · 计算机科学 2024-08-23 Meiyun Wang , Masahiro Suzuki , Hiroki Sakaji , Kiyoshi Izumi

Large Language Models (LLMs) have demonstrated exceptional capabilities, yet selecting the most reliable response from multiple LLMs remains a challenge, particularly in resource-constrained settings. Existing approaches often depend on…

Answering complex queries over incomplete knowledge graphs (KGs) is a challenging job. Most previous works have focused on learning entity/relation embeddings and simulating first-order logic operators with various neural networks. However,…

计算与语言 · 计算机科学 2025-03-04 Tianle Xia , Liang Ding , Guojia Wan , Yibing Zhan , Bo Du , Dacheng Tao

Multiple Choice Question (MCQ) tests are among the most used methods for evaluating large language models (LLMs). Besides checking the correctness of the selected answer, evaluations often consider the model's confidence through the…

计算与语言 · 计算机科学 2026-05-05 Tairan Fu , Javier Conde , Gonzalo Martínez , María Grandury , Pedro Reviriego