中文
相关论文

相关论文: Every Response Counts: Quantifying Uncertainty of …

200 篇论文

We introduce BSDetector, a method for detecting bad and speculative answers from a pretrained Large Language Model by estimating a numeric confidence score for any output it generated. Our uncertainty quantification technique works for any…

计算与语言 · 计算机科学 2023-10-05 Jiuhai Chen , Jonas Mueller

Hallucination continues to pose a major obstacle in the reasoning capabilities of large language models (LLMs). Although the Multi-Agent Debate (MAD) paradigm offers a promising solution by promoting consensus among multiple agents to…

人工智能 · 计算机科学 2025-11-17 Dayong Liang , Xiao-Yong Wei , Changmeng Zheng

Multi-agent autonomous systems (MAS) are better at addressing challenges that spans across multiple domains than singular autonomous agents. This holds true within the field of software engineering (SE) as well. The state-of-the-art…

软件工程 · 计算机科学 2025-05-08 Krishna Ronanki

Multimodal Large Language Models (MLLMs) have notably enhanced the performance of Multimodal Sentiment Analysis (MSA), yet their massive parameter scale leads to excessive resource consumption in training and inference, severely limiting…

计算与语言 · 计算机科学 2026-01-21 Shiqin Han , Manning Gao , Menghua Jiang , Yuncheng Jiang , Haifeng Hu , Sijie Mai

The emergence of Large Language Models (LLMs) like ChatGPT has inspired the development of LLM-based agents capable of addressing complex, real-world tasks. However, these agents often struggle during task execution due to methodological…

计算与语言 · 计算机科学 2025-01-22 Yaoxiang Wang , Zhiyong Wu , Junfeng Yao , Jinsong Su

This study investigates uncertainty quantification in large language models (LLMs) for medical applications, emphasizing both technical innovations and philosophical implications. As LLMs become integral to clinical decision-making,…

Recent advancements in Large Language Models (LLMs) have led to significant breakthroughs in various natural language processing tasks. However, generating factually consistent responses in knowledge-intensive scenarios remains a challenge…

计算与语言 · 计算机科学 2025-01-03 Shengbin Yue , Siyuan Wang , Wei Chen , Xuanjing Huang , Zhongyu Wei

Multi-agent systems (MAS) built on large language models (LLMs) offer a promising path toward solving complex, real-world tasks that single-agent systems often struggle to manage. While recent advancements in test-time scaling (TTS) have…

人工智能 · 计算机科学 2025-08-20 Can Jin , Hongwu Peng , Qixin Zhang , Yujin Tang , Dimitris N. Metaxas , Tong Che

Accurate uncertainty quantification (UQ) in Large Language Models (LLMs) is critical for trustworthy deployment. While real-world language is inherently ambiguous, reflecting aleatoric uncertainty, existing UQ methods are typically…

机器学习 · 计算机科学 2026-01-30 Tim Tomov , Dominik Fuchsgruber , Tom Wollschläger , Stephan Günnemann

Large language models (LLMs) are increasingly deployed in settings where the available context is incomplete or degraded. We argue that an LLM generating answers under incomplete context can be viewed as an implicit imputer, and evaluated…

机器学习 · 统计学 2026-05-14 Stef van Buuren

To facilitate robust and trustworthy deployment of large language models (LLMs), it is essential to quantify the reliability of their generations through uncertainty estimation. While recent efforts have made significant advancements by…

计算与语言 · 计算机科学 2025-07-22 Rui Li , Jing Long , Muge Qi , Heming Xia , Lei Sha , Peiyi Wang , Zhifang Sui

The remarkable performance of large language models (LLMs) in content generation, coding, and common-sense reasoning has spurred widespread integration into many facets of society. However, integration of LLMs raises valid questions on…

计算与语言 · 计算机科学 2025-07-03 Ola Shorinwa , Zhiting Mei , Justin Lidard , Allen Z. Ren , Anirudha Majumdar

LLM-based multi-agent systems (MAS) have shown significant potential in tackling diverse tasks. However, to design effective MAS, existing approaches heavily rely on manual configurations or multiple calls of advanced LLMs, resulting in…

计算与语言 · 计算机科学 2025-03-06 Rui Ye , Shuo Tang , Rui Ge , Yaxin Du , Zhenfei Yin , Siheng Chen , Jing Shao

Large Language Models (LLMs)-based Multi-Agent Systems (MAS) exhibit remarkable problem-solving and task planning capabilities across diverse domains due to their specialized agentic roles and collaborative interactions. However, this also…

多智能体系统 · 计算机科学 2025-05-27 Yifan Zhu , Chao Zhang , Xin Shi , Xueqiao Zhang , Yi Yang , Yawei Luo

LLM-based agents have demonstrated strong potential for autonomous machine learning, yet their applicability to health data remains limited. Existing systems often struggle to generalize across heterogeneous health data modalities, rely…

人工智能 · 计算机科学 2026-02-03 Tong Xia , Weibin Li , Gang Liu , Yong Li

Multi-agent systems (MAS) built on large language models promise improved problem-solving through collaboration, yet they often fail to consistently outperform strong single-agent baselines due to error propagation at inter-agent message…

人工智能 · 计算机科学 2026-01-21 Bohan Lin , Kuo Yang , Zelin Tan , Yingchuan Lai , Chen Zhang , Guibin Zhang , Xinlei Yu , Miao Yu , Xu Wang , Yudong Zhang , Yang Wang

Large Language Models (LLMs) are increasingly used in clinical settings, where sensitivity to linguistic uncertainty can influence diagnostic interpretation and decision-making. Yet little is known about where such epistemic cues are…

计算与语言 · 计算机科学 2025-12-01 Srivarshinee Sridhar , Raghav Kaushik Ravi , Kripabandhu Ghosh

Large sequence model (SM) such as GPT series and BERT has displayed outstanding performance and generalization capabilities on vision, language, and recently reinforcement learning tasks. A natural follow-up question is how to abstract…

多智能体系统 · 计算机科学 2022-10-31 Muning Wen , Jakub Grudzien Kuba , Runji Lin , Weinan Zhang , Ying Wen , Jun Wang , Yaodong Yang

While Multi-Agent Systems (MAS) empower Large Language Models to tackle complex reasoning tasks through collaborative interaction, optimizing their dynamics remains a formidable challenge due to the discrete, non-differentiable nature of…

多智能体系统 · 计算机科学 2026-05-29 Wenwu Li , Yuran Song , Mingze Zhao , Bo Jin , Wenhao Li

Many of us now treat LLMs as modern-day oracles asking it almost any kind of question. However, consulting an LLM does not have to be a single turn activity. But long multi-turn interactions can get tedious if it is simply to clarify…

人工智能 · 计算机科学 2025-07-08 Riya Naik , Ashwin Srinivasan , Swati Agarwal , Estrid He