English
Related papers

Related papers: Conformal Selective Acting: Anytime-Valid Risk Con…

200 papers

Distributional reinforcement learning (RL) -- in which agents learn about all the possible long-term consequences of their actions, and not just the expected value -- is of great recent interest. One of the most important affordances of a…

Artificial Intelligence · Computer Science 2021-11-15 Chris Gagne , Peter Dayan

Learning reliably safe autonomous control is one of the core problems in trustworthy autonomy. However, training a controller that can be formally verified to be safe remains a major challenge. We introduce a novel approach for learning…

Machine Learning · Computer Science 2024-11-19 Junlin Wu , Huan Zhang , Yevgeniy Vorobeychik

Recent advances in object detectors have led to their adoption for industrial uses. However, their deployment in safety-critical applications is hindered by the inherent lack of reliability of neural networks and the complex structure of…

Machine Learning · Statistics 2025-11-03 Léo andéol , Luca Mossina , Adrien Mazoyer , Sébastien Gerchinovitz

Conformal prediction equips machine learning models with a reasonable notion of uncertainty quantification without making strong distributional assumptions. It wraps around any prediction model and converts point predictions into set…

Machine Learning · Statistics 2025-10-21 Matteo Gasparin , Aaditya Ramdas

Vision-Language-Action (VLA) models, as large foundation models for embodied control, have shown strong performance in manipulation tasks. However, their performance comes at high inference cost. To improve efficiency, recent methods adopt…

Robotics · Computer Science 2026-04-06 Zihua Wang , Zhitao Lin , Ruibo Li , Yu Zhang , Xu Yang , Siya Mi , Xiu-Shen Wei

LLMs' overconfidence, particularly when hallucinating, poses a significant challenge for the deployment of the models in safety-critical settings and makes a reliable estimation of uncertainty necessary. Existing approaches for uncertainty…

Machine Learning · Computer Science 2026-05-26 Hamed Karimi , Vaishali Meyappan , Reza Samavi

We address the problem of conformal selection, where an agent must select a minimal subset of options to ensure that at least one ``success'' is identified with a pre-specified target probability $\phi$. While traditional online conformal…

Machine Learning · Computer Science 2026-05-15 Sreenivas Gollapudi , Kostas Kollias , Kamesh Munagala , Ali Sinop

Adaptive clinical trials rely on interim analyses, flexible stopping, and data-dependent design modifications that complicate statistical guarantees when fixed-horizon test statistics are repeatedly inspected or reused after adaptations.…

Methodology · Statistics 2026-02-09 Alexandra Sokolova , Vadim Sokolov

Vision-Language-Action (VLA) models have demonstrated remarkable capabilities and generalization in embodied manipulation. However, their decision-making relies on a fast, instinctive process that lacks deliberation. This strategy often…

Robotics · Computer Science 2026-05-29 Wenhao Li , Xiu Su , Yichao Cao , Hongyan Xu , Xiaobo Xia , Shan You , Yi Chen , Chang Xu

Optimizing risk measures such as Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR) of a general loss distribution is usually difficult, because 1) the loss function might lack structural properties such as convexity or…

Optimization and Control · Mathematics 2016-08-03 Helin Zhu , Joshua Hale , Enlu Zhou

Quantum key distribution (QKD) security fundamentally relies on the ability to distinguish genuine quantum correlations from classical eavesdropper simulations, yet existing certification methods lack rigorous statistical guarantees under…

Quantum Physics · Physics 2025-12-04 Davut Emre Tasar , Ceren Ocal Tasar

Vision language action models (VLAs) are increasingly used for Physical AI, but deploying a pre-trained VLA model to unseen environments, embodiments, or tasks still requires adaptation. Parameter-efficient fine-tuning (PEFT), especially…

Robotics · Computer Science 2026-03-10 Donghoon Kim , Minji Bae , Unghui Nam , Gyeonghun Kim , Suyun Lee , Kyuhong Shim , Byonghyo Shim

Offline reinforcement learning (RL) is suitable for safety-critical domains where online exploration is too costly or dangerous. In such safety-critical settings, decision-making should take into consideration the risk of catastrophic…

Machine Learning · Computer Science 2023-10-31 Marc Rigter , Bruno Lacerda , Nick Hawes

Safety in reinforcement learning (RL) is a key property in both training and execution in many domains such as autonomous driving or finance. In this paper, we formalize it with a constrained RL formulation in the distributional RL setting.…

Machine Learning · Computer Science 2021-03-01 Jianyi Zhang , Paul Weng

Reinforcement Learning (RL) and continuous nonlinear control have been successfully deployed in multiple domains of complicated sequential decision-making tasks. However, given the exploration nature of the learning process and the presence…

Robotics · Computer Science 2022-08-01 Wenhao Luo , Wen Sun , Ashish Kapoor

Robust estimators for linear regression require non-convex objective functions to shield against adverse affects of outliers. This non-convexity brings challenges, particularly when combined with penalization in high-dimensional settings.…

Computation · Statistics 2025-08-08 David Kepplinger , Siqi Wei

Many systems contain latent variables that make their dynamics partially unidentifiable or cause distribution shifts in the observed statistics between offline and online data. However, existing control techniques often assume access to…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Haoming Jing , Yorie Nakahira

Conformal prediction (CP) is a distribution-free framework for achieving probabilistic guarantees on black-box models. CP is generally applied to a model post-training. Recent research efforts, on the other hand, have focused on optimizing…

Machine Learning · Computer Science 2025-02-11 Sima Noorani , Orlando Romero , Nicolo Dal Fabbro , Hamed Hassani , George J. Pappas

Prior work on safe Reinforcement Learning (RL) has studied risk-aversion to randomness in dynamics (aleatory) and to model uncertainty (epistemic) in isolation. We propose and analyze a new framework to jointly model the risk associated…

Machine Learning · Computer Science 2024-05-15 Jia Lin Hau , Marek Petrik , Mohammad Ghavamzadeh , Reazul Russel

Though deep reinforcement learning (DRL) has obtained substantial success, it may encounter catastrophic failures due to the intrinsic uncertainty of both transition and observation. Most of the existing methods for safe reinforcement…

Machine Learning · Computer Science 2025-05-20 Chengyang Ying , Xinning Zhou , Hang Su , Dong Yan , Ning Chen , Jun Zhu