English
Related papers

Related papers: Probabilistic Error Analysis for Inner Products

200 papers

The main objective of this work is to investigate non-linear errors and pairwise summation using stochastic rounding (SR) in variance computation algorithms. We estimate the forward error of computations under SR through two methods: the…

Numerical Analysis · Mathematics 2024-10-17 El-Mehdi El Arar , Devan Sohier , Pablo de Oliveira Castro , Eric Petit

Recent research has made significant progress on the problem of bounding log partition functions for exponential family graphical models. Such bounds have associated dual parameters that are often used as heuristic estimates of the marginal…

Machine Learning · Computer Science 2012-07-19 Pradeep Ravikumar , John Lafferty

We prove sharp, computable error estimates for the propagation of errors in the numerical solution of ordinary differential equations. The new estimates extend previous estimates of the influence of data errors and discretisation errors…

Numerical Analysis · Mathematics 2015-04-28 Benjamin Kehlet , Anders Logg

We present a model of roundoff error analysis that combines simplicity with predictive power. Though not considering all sources of roundoff within an algorithm, the model is related to a recursive roundoff error analysis and therefore…

Numerical Analysis · Mathematics 2010-06-01 Folkmar Bornemann

We consider the problem of approximating the product of $n$ expectations with respect to a common probability distribution $\mu$. Such products routinely arise in statistics as values of the likelihood in latent variable models. Motivated…

Computation · Statistics 2017-09-05 Anthony Lee , Simone Tiberi , Giacomo Zanella

Modern computer architectures support low-precision arithmetic, which present opportunities for the adoption of mixed-precision algorithms to achieve high computational throughput and reduce energy consumption. As a growing number of…

Computation · Statistics 2024-12-02 Sahil Bhola , Karthik Duraisamy

Analyzing probabilistic programs and randomized algorithms are classical problems in computer science. The first basic problem in the analysis of stochastic processes is to consider the expectation or mean, and another basic problem is to…

Programming Languages · Computer Science 2020-08-13 Jinyi Wang , Yican Sun , Hongfei Fu , Mingzhang Huang , Amir Kafshdar Goharshady , Krishnendu Chatterjee

Finite precision computations using digital computers involve the following inherent errors: (1) Round-off error of finite precision computations (2) Binary computer arithmetic precludes exact number representation of traditional decimal…

Computational Physics · Physics 2007-05-23 Suvarna Fadnavis

Variational inference has become one of the most widely used methods in latent variable modeling. In its basic form, variational inference employs a fully factorized variational distribution and minimizes its KL divergence to the posterior.…

Machine Learning · Statistics 2020-01-29 Robert Bamler , Cheng Zhang , Manfred Opper , Stephan Mandt

We study the problem of estimating the diagonal of an implicitly given matrix $A$. For such a matrix we have access to an oracle that allows us to evaluate the matrix vector product $Av$. For random variable $v$ drawn from an appropriate…

Data Structures and Algorithms · Computer Science 2022-01-27 Robert A. Baston , Yuji Nakatsukasa

Evaluating joint probabilities of potential outcomes and observed variables, and their linear combinations, is a fundamental challenge in causal inference. This paper addresses the bounding and identification of these probabilities in…

Machine Learning · Statistics 2026-02-24 Naoya Hashimoto , Yuta Kawakami , Jin Tian

In this paper, we discuss the ambiguous chance constrained based portfolio optimization problems, in which the perturbations associated with the input parameters are stochastic in nature, but their distributions are not known precisely. We…

Optimization and Control · Mathematics 2023-11-09 Pulak Swain , Akshay Kumar Ojha

We consider second-order PDE problems set in unbounded domains and discretized by Lagrange finite elements on a finite mesh, thus introducing an artificial boundary in the discretization. Specifically, we consider the reaction diffusion…

Numerical Analysis · Mathematics 2025-03-31 T. Chaumont-Frelet

The DUCK-calculus presented here is a recent approach to cope with probabilistic uncertainty in a sound and efficient way. Uncertain rules with bounds for probabilities and explicit conditional independences can be maintained incrementally.…

Artificial Intelligence · Computer Science 2013-03-25 Helmut Thone , Ulrich Guntzer , Werner Kiessling

Classical probabilistic rounding error analysis is particularly well suited to stochastic rounding (SR), and it yields strong results when dealing with floating-point algorithms that rely heavily on summation. For many numerical linear…

Numerical Analysis · Mathematics 2025-02-26 El-Mehdi El Arar , Massimiliano Fasi , Silviu-Ioan Filip , Mantas Mikaitis

Motivated by the problem of filtering candidate pairs in inner product similarity joins we study the following inner product estimation problem: Given parameters $d\in {\bf N}$, $\alpha>\beta\geq 0$ and unit vectors $x,y\in {\bf R}^{d}$…

Data Structures and Algorithms · Computer Science 2020-01-14 Rasmus Pagh , Johan Sivertsen

Probabilistic numerics casts numerical tasks, such the numerical solution of differential equations, as inference problems to be solved. One approach is to model the unknown quantity of interest as a random variable, and to constrain this…

Numerical Analysis · Mathematics 2021-10-29 Onur Teymur , Christopher N. Foley , Philip G. Breen , Toni Karvonen , Chris. J. Oates

We study the problem of bounding the posterior distribution of discrete probabilistic programs with unbounded support, loops, and conditioning. Loops pose the main difficulty in this setting: even if exact Bayesian inference is possible,…

Programming Languages · Computer Science 2024-12-06 Fabian Zaiser , Andrzej S. Murawski , C. -H. Luke Ong

Robust Bayesian inference is the calculation of posterior probability bounds given perturbations in a probabilistic model. This paper focuses on perturbations that can be expressed locally in Bayesian networks through convex sets of…

Artificial Intelligence · Computer Science 2013-02-08 Fabio Gagliardi Cozman

Projection-based model order reduction of dynamical systems usually introduces an error between the high-fidelity model and its counterpart of lower dimension. This unknown error can be bounded by residual-based methods, which are typically…

Numerical Analysis · Mathematics 2023-03-31 Johannes Rettberg , Dominik Wittwar , Patrick Buchfink , Robin Herkert , Jörg Fehr , Bernard Haasdonk