English
Related papers

Related papers: Calibrating Conservatism for Scalable Oversight

200 papers

Modern scientific and engineering design increasingly involves distributed optimization, where agents such as laboratories, simulations, or industrial partners pursue related goals under differing conditions. These agents often face…

Machine Learning · Statistics 2025-10-21 Zihan Wang , Yi-Ping Chen , Tuba Dolar , Wei Chen

Multi-turn GUI agents enable complex task completion through sequential decision-making, but suffer from severe context inflation as interaction history accumulates. Existing strategies either sacrifice long-term context via truncation or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yurun Song , Jiong Yin , Rongjunchen Zhang , Ian G. Harris

Population-based methods can cope with a variety of different problems, including problems of remarkably higher complexity than those traditional methods can handle. The main procedure consists of successively updating a population of…

Neural and Evolutionary Computing · Computer Science 2021-01-27 Mauro S. Innocente , Johann Sienz

Our objective is to construct well-calibrated prediction sets for a time-to-event outcome subject to right-censoring with guaranteed coverage. Inspired by modern conformal inference, our approach avoids the need for a well-specified…

Methodology · Statistics 2026-01-27 Rebecca Farina , Eric J. Tchetgen Tchetgen , Arun Kumar Kuchibhotla

Coupled human-environment systems are increasingly being understood as complex adaptive systems (CAS), in which micro-level interactions between components lead to emergent behavior. Agent-based models (ABMs) hold great promise for…

Applications · Statistics 2026-02-20 Dylan Munson , Arijit Dey , Simon Mak

Accurate prediction of outcomes is crucial for clinical decision-making and personalized patient care. Supervised machine learning algorithms, which are commonly used for outcome prediction in the medical domain, optimize for predictive…

Machine Learning · Computer Science 2026-02-09 Nithya Bhasker , Fiona R. Kolbinger , Susu Hu , Gitta Kutyniok , Stefanie Speidel

Adaptive robust optimization (ARO) extends static robust optimization by allowing decisions to depend on the realized uncertainty - weakly dominating static solutions within the modeled uncertainty set. However, ARO makes previous…

Optimization and Control · Mathematics 2025-11-20 Karl Zhu , Dimitris Bertsimas

Machine learning applications often require calibrated predictions, e.g. a 90\% credible interval should contain the true outcome 90\% of the times. However, typical definitions of calibration only require this to hold on average, and offer…

Machine Learning · Statistics 2020-09-10 Shengjia Zhao , Tengyu Ma , Stefano Ermon

Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable…

Machine Learning · Computer Science 2025-07-01 Haosen Ge , Hamsa Bastani , Osbert Bastani

Offline learning of strategies takes data efficiency to its extreme by restricting algorithms to a fixed dataset of state-action trajectories. We consider the problem in a mixed-motive multiagent setting, where the goal is to solve a game…

Artificial Intelligence · Computer Science 2026-03-03 Austin A. Nguyen , Michael P. Wellman

Reinforcement Learning with Verifiable Rewards (RLVR) is increasingly viewed as a tree pruning mechanism. However, we identify a systemic pathology termed Recursive Space Contraction (RSC), an irreversible collapse driven by the combined…

Artificial Intelligence · Computer Science 2026-02-06 Tianyi Wang , Long Li , Hongcan Guo , Yibiao Chen , Yixia Li , Yong Wang , Yun Chen , Guanhua Chen

While Group Relative Policy Optimization (GRPO) has emerged as a scalable framework for critic-free policy learning, extending it to settings with explicit behavioral constraints remains underexplored. We introduce Constrained GRPO, a…

Machine Learning · Computer Science 2026-02-09 Roger Girgis , Rodrigue de Schaetzen , Luke Rowe , Azalée Robitaille , Christopher Pal , Liam Paull

Reliable probabilities are critical in high-risk applications, yet common calibration criteria (confidence, class-wise) are only necessary for full distributional calibration, and post-hoc methods often lack distribution-free guarantees. We…

Machine Learning · Statistics 2025-10-17 Daniil Kazantsev , Mohsen Guizani , Eric Moulines , Maxim Panov , Nikita Kotelevskii

Calibration has emerged as a foundational goal in ``trustworthy machine learning'', in part because of its strong decision theoretic semantics. Independent of the underlying distribution, and independent of the decision maker's utility…

Machine Learning · Statistics 2025-10-28 Shayan Kiyani , Hamed Hassani , George Pappas , Aaron Roth

A constrained version of the online convex optimization (OCO) problem is considered. With slotted time, for each slot, first an action is chosen. Subsequently the loss function and the constraint violation penalty evaluated at the chosen…

Machine Learning · Computer Science 2023-01-25 Rahul Vaze

We propose a framework for adaptive data-centric collaborative machine learning among self-interested agents, coordinated by an arbiter. Designed to handle the incremental nature of real-world data, the framework operates in an online…

Machine Learning · Computer Science 2025-02-07 Nithia Vijayan , Bryan Kian Hsiang Low

Ensuring that predicted probabilities align with observed frequencies is critical in high-stakes domains such as clinical decision support, autonomous driving and financial risk assessment. Existing calibration methods typically apply a…

Machine Learning · Computer Science 2026-05-26 Tomer Lavi , Bracha Shapira , Nadav Rappoport

Comparison-Based Optimization (CBO) is an optimization paradigm that assumes only very limited access to the objective function f(x). Despite the growing relevance of CBO to real-world applications, this field has received little attention…

Optimization and Control · Mathematics 2023-03-27 Isha Slavin , Daniel McKenzie

Modern computer systems are highly configurable, with hundreds of configuration options that interact, resulting in an enormous configuration space. As a result, optimizing performance goals (e.g., latency) in such systems is challenging…

Performance · Computer Science 2023-10-04 Md Shahriar Iqbal , Ziyuan Zhong , Iftakhar Ahmad , Baishakhi Ray , Pooyan Jamshidi

Inference-time computation is a critical yet challenging paradigm for enhancing the reasoning performance of large language models (LLMs). While existing strategies improve reasoning stability and consistency, they suffer from notable…

Multiagent Systems · Computer Science 2025-10-23 Rui Jerry Huang , Wendy Liu , Anastasia Miin , Lei Ding