English
Related papers

Related papers: Informativeness under Model Uncertainty: Shadow Pr…

200 papers

Ultra-fast, precise, and controlled amplitude surrogates are essential for future LHC event generation. First, we investigate the noise reduction and biases of network ensembles and outline a new method to learn well-calibrated systematic…

High Energy Physics - Phenomenology · Physics 2026-04-09 Henning Bahl , Nina Elmer , Tilman Plehn , Ramon Winterhalder

This paper develops new tools to quantify uncertainty in optimal decision making and to gain insight into which variables one should collect information about given the potential cost of measuring a large number of variables. We investigate…

Methodology · Statistics 2021-05-11 Yunan Wu , Lan Wang , Haoda Fu

Regularization is a big issue for training deep neural networks. In this paper, we propose a new information-theory-based regularization scheme named SHADE for SHAnnon DEcay. The originality of the approach is to define a prior based on…

Machine Learning · Statistics 2018-05-16 Michael Blot , Thomas Robert , Nicolas Thome , Matthieu Cord

Robust optimization methods have shown practical advantages in a wide range of decision-making applications under uncertainty. Recently, their efficacy has been extended to multi-period settings. Current approaches model uncertainty either…

Optimization and Control · Mathematics 2022-02-23 Omid Nohadani , Kartikey Sharma

Many smart grid frameworks, such as demand response programs, require accurate information about consumers' parameters (e.g., flexibility) at the aggregator side to optimize grid operations. Existing works typically rely on perfect…

Computer Science and Game Theory · Computer Science 2026-03-05 Hassan Mohamad , Chao Zhang , Samson Lasaulce , Olivier Beaude , Vineeth Satheeskumar Varma , Mounir Ghogho , Vincent Poor

A variety of algorithms have been proposed to address the power system state estimation problem in the presence of uncertainties in the data. However, less emphasis has been given to handling perturbations in the model. In the context of…

Systems and Control · Electrical Eng. & Systems 2025-10-21 Ayan Das , Anushka Sharma , Anamitra Pal

Uncertainty estimation is an essential step in the evaluation of the robustness for deep learning models in computer vision, especially when applied in risk-sensitive areas. However, most state-of-the-art deep learning models either fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Lu Mi , Hao Wang , Yonglong Tian , Hao He , Nir Shavit

Many problems in trustworthy ML can be formulated as minimization of the model error under constraints on the prediction rates of the model for suitably-chosen marginals, including most group fairness constraints (demographic parity,…

Machine Learning · Computer Science 2025-05-30 Mohammad Yaghini , Tudor Cebere , Michael Menart , Aurélien Bellet , Nicolas Papernot

It is critical that the models pay attention not only to accuracy but also to the certainty of prediction. Uncertain predictions of deep models caused by noisy data raise significant concerns in trustworthy AI areas. To explore and handle…

Machine Learning · Computer Science 2023-03-30 Wei Wei , Jiahuan Zhou , Hongze Li , Ying Wu

We perform network analysis of a system described by the master equation to estimate the lower bound of the steady-state current noise, starting from the level 2.5 large deviation function and using the graph theory approach. When the…

Statistical Mechanics · Physics 2024-10-03 Yasuhiro Utsumi

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the utility of the resulting statistical estimators. We prove bounds on information-theoretic…

Statistics Theory · Mathematics 2014-08-28 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

Design under uncertainty is a challenging problem, as a systems performance can be highly sensitive to variations in input parameters and model uncertainty. A conventional approach to addressing such problems is robust optimization, which…

Systems and Control · Electrical Eng. & Systems 2025-09-18 Maryam Ghasemzadeh , H M Dilshad Alam Digonta , Anand Balu Nellippallil , Anton van Beek

This paper provides a unified framework for analyzing tensor estimation problems that allow for nonlinear observations, heteroskedastic noise, and covariate information. We study a general class of high-dimensional models where each…

Information Theory · Computer Science 2025-06-10 Riccardo Rossetti , Galen Reeves

We present a sparse representation of model uncertainty for Deep Neural Networks (DNNs) where the parameter posterior is approximated with an inverse formulation of the Multivariate Normal Distribution (MND), also known as the information…

Machine Learning · Computer Science 2020-06-23 Jongseok Lee , Matthias Humt , Jianxiang Feng , Rudolph Triebel

Shadow estimation is a powerful approach for estimating the expectation values of many observables. Thrifty shadow estimation is a simple variant that is proposed to reduce the experimental overhead by reusing random circuits repeatedly.…

Quantum Physics · Physics 2024-11-01 Datong Chen , Huangjun Zhu

The paper studies information-theoretic opacity, an information-flow privacy property, in a setting involving two agents: A planning agent who controls a stochastic system and an observer who partially observes the system states. The goal…

Systems and Control · Electrical Eng. & Systems 2024-11-20 Chongyang Shi , Yuheng Bu , Jie Fu

Differential privacy (DP) provides robust privacy guarantees for statistical inference, but this can lead to unreliable results and biases in downstream applications. While several noise-aware approaches have been proposed which integrate…

Machine Learning · Statistics 2026-05-29 Talal Alrawajfeh , Joonas Jälkö , Antti Honkela

In this paper, the Kyle model of insider trading is extended by characterizing the trading volume with long memory and allowing the noise trading volatility to follow a general stochastic process. Under this newly revised model, the…

Mathematical Finance · Quantitative Finance 2019-01-08 Ben-zhang Yang , Xinjiang He , Nan-jing Huang

We introduce a flexible framework for high-dimensional matrix estimation to incorporate side information for both rows and columns. Existing approaches, such as inductive matrix completion, often impose restrictive structure-for example, an…

Methodology · Statistics 2026-03-27 Anish Agarwal , Jungjun Choi , Ming Yuan

We study optimal monopoly pricing over consumer networks governed by general nonlinear utilities. In our framework, a consumer's utility is jointly determined by an individualized price and the consumption choices of their peers, propagated…

Statistics Theory · Mathematics 2026-05-15 Daniele Bracale , George Michailidis