English
Related papers

Related papers: MARGIN: Runtime Confidence Calibration for Multi-A…

200 papers

In question-answering (QA) systems, Retrieval-Augmented Generation (RAG) has become pivotal in enhancing response accuracy and reducing hallucination issues. The architecture of RAG systems varies significantly, encompassing single-round…

Computation and Language · Computer Science 2025-08-05 Yiqun Chen , Erhan Zhang , Lingyong Yan , Shuaiqiang Wang , Jizhou Huang , Dawei Yin , Jiaxin Mao

Scaling cooperative multi-agent reinforcement learning (MARL) is fundamentally limited by cross-agent noise. When agents share a common reward, each agent's learning signal is computed from a shared return that depends on all agents, so the…

Multiagent Systems · Computer Science 2026-05-06 Shan Yang , Yang Liu

Retrieval-Augmented Generation (RAG) systems leverage Large Language Models (LLMs) to generate accurate and reliable responses that are grounded in retrieved context. However, LLMs often generate inconsistent outputs for semantically…

Computation and Language · Computer Science 2025-10-17 Xujun Peng , Anoop Kumar , Jingyu Wu , Parker Glenn , Daben Liu

In recent years, Model-based Multi-Agent Reinforcement Learning (MARL) has demonstrated significant advantages over model-free methods in terms of sample efficiency by using independent environment dynamics world models for data sample…

Multiagent Systems · Computer Science 2025-01-20 Zifeng Shi , Meiqin Liu , Senlin Zhang , Ronghao Zheng , Shanling Dong , Ping Wei

Traditional retrieval-augmented generation (RAG) benchmarks evaluate systems using heuristic-based metrics, but these require human preferences as the ground truth for reference. In contrast, arena-based benchmarks, where systems compete…

Computation and Language · Computer Science 2025-04-01 Nandan Thakur , Suleman Kazi , Ge Luo , Jimmy Lin , Amin Ahmad

In problems that involve input parameter information gathered from multiple data sources with varying reliability, incorporating decision makers' trust on different sources in optimization models can potentially improve solution…

Optimization and Control · Mathematics 2026-02-27 Yanru Guo , Ruiwei Jiang , Siqian Shen

Jung et al. (2025) introduce a hypothesis testing framework for guaranteeing agreement between large language models (LLMs) and human judgments, relying on the assumption that the model's estimated confidence is monotonic with respect to…

Machine Learning · Computer Science 2026-05-18 Gaojie Jin , Yong Tao , Lijia Yu , Tianjin Huang

Only increasing accuracy without considering uncertainty may negatively impact Deep Neural Network (DNN) decision-making and decrease its reliability. This paper proposes five combined preprocessing and post-processing methods for…

Artificial Intelligence · Computer Science 2022-11-08 Hamed Farkhari , Joseanne Viana , Pedro Sebastiao , Luis Miguel Campos , Luis Bernardo , Rui Dinis , Sarang Kahvazadeh

Cooperative multi-agent reinforcement learning (MARL) commonly adopts centralized training with decentralized execution, where value-factorization methods enforce the individual-global-maximum (IGM) principle so that decentralized greedy…

Artificial Intelligence · Computer Science 2026-02-13 Chengrui Qu , Christopher Yeh , Kishan Panaganti , Eric Mazumdar , Adam Wierman

We are interested in probabilistic prediction in online settings in which data does not follow a probability distribution. Our work seeks to achieve two goals: (1) producing valid probabilities that accurately reflect model confidence; and…

Machine Learning · Computer Science 2024-06-06 Shachi Deshpande , Charles Marx , Volodymyr Kuleshov

Randomized controlled trials (RCTs) are the gold standard for estimating heterogeneous treatment effects, yet they are often underpowered for detecting effect heterogeneity. Large observational studies (OS) can supplement RCTs for…

Machine Learning · Computer Science 2026-04-07 Amir Asiaee , Samhita Pal

Trading off performance guarantees in favor of scalability, the Multi-Agent Path Finding (MAPF) community has recently started to embrace Multi-Agent Reinforcement Learning (MARL), where agents learn to collaboratively generate individual,…

Robotics · Computer Science 2023-09-01 Yutong Wang , Bairan Xiang , Shinan Huang , Guillaume Sartoretti

As LLM-powered agents have been used for high-stakes decision-making, such as clinical diagnosis, it becomes critical to develop reliable verification of their decisions to facilitate trustworthy deployment. Yet, existing verifiers usually…

Artificial Intelligence · Computer Science 2026-03-04 Yichi Zhang , Nabeel Seedat , Yinpeng Dong , Peng Cui , Jun Zhu , Mihaela van de Schaar

The rapid evolution of Retrieval-Augmented Generation (RAG) toward multimodal, high-stakes enterprise applications has outpaced the development of domain specific evaluation benchmarks. Existing datasets often rely on general-domain corpora…

Artificial Intelligence · Computer Science 2026-01-23 Chandan Kumar Sahu , Premith Kumar Chilukuri , Matthew Hetrich

When estimating the relevancy between a query and a document, ranking models largely neglect the mutual information among documents. A common wisdom is that if two documents are similar in terms of the same query, they are more likely to…

Machine Learning · Computer Science 2019-09-17 Shihao Zou , Zhonghua Li , Mohammad Akbari , Jun Wang , Peng Zhang

Accurate multi-sensor calibration is essential for deploying robust perception systems in applications such as autonomous driving and intelligent transportation. Existing LiDAR-camera calibration methods often rely on manually placed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Lei Cheng , Lihao Guo , Tianya Zhang , Tam Bang , Austin Harris , Mustafa Hajij , Mina Sartipi , Siyang Cao

This study investigates how Multi-Agent Reinforcement Learning (MARL) can improve dynamic pricing strategies in supply chains, particularly in contexts where traditional ERP systems rely on static, rule-based approaches that overlook…

Machine Learning · Computer Science 2025-07-04 Thomas Hazenberg , Yao Ma , Seyed Sahand Mohammadi Ziabari , Marijn van Rijswijk

Large language models (LLMs) have recently shown strong progress on scientific reasoning, yet two major bottlenecks remain. First, explicit retrieval fragments reasoning, imposing a hidden "tool tax" of extra tokens and steps. Second,…

LLM-based Multi-Agent Systems have demonstrated remarkable capabilities in addressing complex, agentic tasks, from generating high-quality presentation slides to even conducting sophisticated scientific research. Meanwhile, RL has been…

Multiagent Systems · Computer Science 2025-11-04 Junwei Liao , Muning Wen , Jun Wang , Weinan Zhang

Multi-agent reinforcement learning systems aim to provide interacting agents with the ability to collaboratively learn and adapt to the behaviour of other agents. In many real-world applications, the agents can only acquire a partial view…

Machine Learning · Computer Science 2018-12-04 Ozsel Kilinc , Giovanni Montana