English
Related papers

Related papers: Bias- and Variance-Aware Probabilistic Rounding Er…

200 papers

Probably Approximately Correct (PAC) bounds are widely used to derive probabilistic guarantees for the generalisation of machine learning models. They highlight the components of the model which contribute to its generalisation capacity.…

Machine Learning · Computer Science 2024-07-30 Thomas Walker , Alessio Lomuscio

Inverse Ising inference allows pairwise interactions of complex binary systems to be reconstructed from empirical correlations. Typical estimators used for this inference, such as Pseudo-likelihood maximization (PLM), are biased. Using the…

Disordered Systems and Neural Networks · Physics 2023-07-19 Maximilian Benedikt Kloucek , Thomas Machon , Shogo Kajimura , C. Patrick Royall , Naoki Masuda , Francesco Turci

While the {estimation} of risk is an important question in the daily business of banking and insurance, many existing plug-in estimation procedures suffer from an unnecessary bias. This often leads to the underestimation of risk and…

Risk Management · Quantitative Finance 2022-02-04 Marcin Pitera , Thorsten Schmidt

Adversarial examples pose a security threat to many critical systems built on neural networks. Given that deterministic robustness often comes with significantly reduced accuracy, probabilistic robustness (i.e., the probability of having…

Machine Learning · Computer Science 2024-05-27 Ruihan Zhang , Jun Sun

This paper discusses regularized estimators in the multivariate statistical model as tools naturally arising within a Bayesian framework. First, a link is established between Bayesian estimation and inference under parameter rounding…

Methodology · Statistics 2025-09-15 Jan Kalina

We present a general approach to deriving bounds on the generalization error of randomized learning algorithms. Our approach can be used to obtain bounds on the average generalization error as well as bounds on its tail probabilities, both…

Information Theory · Computer Science 2020-09-10 Fredrik Hellström , Giuseppe Durisi

When exposed to human-generated data, language models are known to learn and amplify societal biases. While previous works introduced benchmarks that can be used to assess the bias in these models, they rely on assumptions that may not be…

Computation and Language · Computer Science 2025-10-16 Angana Borah , Aparna Garimella , Rada Mihalcea

While learning the maximum likelihood value of parameters of an undirected graphical model is hard, modelling the posterior distribution over parameters given data is harder. Yet, undirected models are ubiquitous in computer vision and text…

Machine Learning · Computer Science 2012-07-02 Max Welling , Sridevi Parise

This paper is concerned with the recovery of (approximate) solutions to parabolic problems from incomplete and possibly inconsistent observational data, given on a time-space cylinder that is a strict subset of the computational domain…

Numerical Analysis · Mathematics 2021-07-13 Wolfgang Dahmen , Rob Stevenson , Jan Westerdiep

Generalization error bounds are critical to understanding the performance of machine learning models. In this work, building upon a new bound of the expected value of an arbitrary function of the population and empirical risk of a learning…

Information Theory · Computer Science 2021-05-07 Gholamali Aminian , Laura Toni , Miguel R. D. Rodrigues

This work derives a residual-based a posteriori error estimator for reduced models learned with non-intrusive model reduction from data of high-dimensional systems governed by linear parabolic partial differential equations with control…

Numerical Analysis · Mathematics 2020-05-13 Wayne Isaac Tan Uy , Benjamin Peherstorfer

In application areas where data generation is expensive, Gaussian processes are a preferred supervised learning model due to their high data-efficiency. Particularly in model-based control, Gaussian processes allow the derivation of…

Machine Learning · Computer Science 2021-01-15 Armin Lederer , Jonas Umlauft , Sandra Hirche

Data-driven models are subject to model errors due to limited and noisy training data. Key to the application of such models in safety-critical domains is the quantification of their model error. Gaussian processes provide such a measure…

Machine Learning · Computer Science 2024-09-23 Armin Lederer , Jonas Umlauft , Sandra Hirche

Decisions about health interventions are often made using limited evidence. Mathematical models used to inform such decisions often include uncertainty analysis to account for the effect of uncertainty in the current evidence base on…

Applications · Statistics 2021-11-30 Rowan Iskandar

The polynomial NARMAX (Nonlinear AutoRegressive Moving Average model with eXogenous input) is a model that represents the dynamics of physical systems. This polynomial contains information from the past of the inputs and outputs of the…

Signal Processing · Electrical Eng. & Systems 2017-11-22 Priscila F. S. Guedes , M. L. C. Peixoto , A. M. Barbosa , S. A. M. Martins , E. G. Nepomuceno

In a general setting, we study a posteriori estimates used in finite element analysis to measure the error between a solution and its approximation. The latter is not necessarily generated by a finite element method. We show that the error…

Numerical Analysis · Mathematics 2025-07-09 Thomas Führer , Sergio Rojas

Prediction via deterministic continuous-time models will always be subject to model error, for example due to unexplainable phenomena, uncertainties in any data driving the model, or discretisation/resolution issues. In this paper, we build…

Dynamical Systems · Mathematics 2025-06-30 Liam Blake , John Maclean , Sanjeeva Balasuriya

Policymakers in resource-constrained settings require experimental designs that satisfy strict budget limits while ensuring precise estimation of treatment effects. We propose a framework that applies a dependent randomized rounding…

Machine Learning · Statistics 2025-06-17 Khurram Yamin , Edward Kennedy , Bryan Wilder

Large-scale numerical computations make increasing use of low-precision (LP) floating point formats and mixed precision arithmetic, which can be enhanced by the technique of stochastic rounding (SR), that is, rounding an intermediate…

Numerical Analysis · Mathematics 2025-04-30 Andrew Fitzgibbon , Stephen Felix

Capturing aleatoric uncertainty is a critical part of many machine learning systems. In deep learning, a common approach to this end is to train a neural network to estimate the parameters of a heteroscedastic Gaussian distribution by…

Machine Learning · Computer Science 2022-04-04 Maximilian Seitzer , Arash Tavakoli , Dimitrije Antic , Georg Martius