English
Related papers

Related papers: Certified Roundoff Error Bounds using Bernstein Ex…

200 papers

Finding optimal policies for Partially Observable Markov Decision Processes (POMDPs) is challenging due to their uncountable state spaces when transformed into fully observable Markov Decision Processes (MDPs) using belief states.…

Optimization and Control · Mathematics 2024-09-09 Yunus Emre Demirci , Ali Devran Kara , Serdar Yüksel

This paper considers a probabilistic model for floating-point computation in which the roundoff errors are represented by bounded random variables with mean zero. Using this model, a probabilistic bound is derived for the forward error of…

Numerical Analysis · Mathematics 2021-04-15 Eric Hallman

Probabilistic model checking computes probabilities and expected values related to designated behaviours of interest in Markov models. As a formal verification approach, it is applied to critical systems; thus we trust that probabilistic…

Logic in Computer Science · Computer Science 2021-10-19 Arnd Hartmanns

It is well known that the computation of accurate trajectories of the Lorenz system is a difficult problem. Computed solutions are very sensitive to the discretization error determined by the time step size and polynomial order of the…

Numerical Analysis · Mathematics 2013-06-13 Benjamin Kehlet , Anders Logg

This paper presents preliminary work on computing upper bounds on the estimation error covariance in the framework of the extended Kalman filter. The approach taken is using quadratic constraints to bound the dynamic nonlinearities and use…

Optimization and Control · Mathematics 2024-10-14 Sze Kwan Cheah , Yingjie Hu

Precision tuning or customized precision number representations is emerging, in these recent years, as one of the most promising techniques that has a positive impact on the footprint of programs concerning energy consumption, bandwidth…

Software Engineering · Computer Science 2022-03-16 Dorra Ben Khalifa , Matthieu Martel

In finite element methods (FEMs), the accuracy of the solution cannot increase indefinitely because the round-off error increases when the number of degrees of freedom (DoFs) is large enough. This means that the accuracy that can be reached…

Numerical Analysis · Mathematics 2019-12-18 Jie Liu , Matthias Möller , Henk M. Schuttelaars

Finite-precision arithmetic computations face an inherent tradeoff between accuracy and efficiency. The points in this tradeoff space are determined, among other factors, by different data types but also evaluation orders. To put it simply,…

Programming Languages · Computer Science 2017-07-10 Eva Darulova , Einar Horn , Saksham Sharma

We reconsider randomized algorithms for the low-rank approximation of symmetric positive semi-definite (SPSD) matrices such as Laplacian and kernel matrices that arise in data analysis and machine learning applications. Our main results…

Machine Learning · Computer Science 2013-06-05 Alex Gittens , Michael W. Mahoney

We propose an implementation of symplectic implicit Runge-Kutta schemes for highly accurate numerical integration of non-stiff Hamiltonian systems based on fixed point iteration. Provided that the computations are done in a given floating…

Numerical Analysis · Mathematics 2017-02-14 Mikel Antoñana , Joseba Makazaga , Ander Murua

Stochastic iterative algorithms, including stochastic gradient descent (SGD) and stochastic gradient Langevin dynamics (SGLD), are widely utilized for optimization and sampling in large-scale and high-dimensional problems in machine…

Machine Learning · Statistics 2025-01-22 Xiaoyu Wang , Mikolaj J. Kasprzak , Jeffrey Negrea , Solesne Bourguin , Jonathan H. Huggins

Graph sparsification is a well-established technique for accelerating graph-based learning algorithms, which uses edge sampling to approximate dense graphs with sparse ones. Because the sparsification error is random and unknown, users must…

Machine Learning · Computer Science 2025-03-12 Siyao Wang , Miles E. Lopes

Randomized matrix sparsification has proven to be a fruitful technique for producing faster algorithms in applications ranging from graph partitioning to semidefinite programming. In the decade or so of research into this technique, the…

Numerical Analysis · Mathematics 2009-11-23 Alex Gittens , Joel A. Tropp

In this paper, we present BERN-NN as an efficient tool to perform bound propagation of Neural Networks (NNs). Bound propagation is a critical step in wide range of NN model checkers and reachability analysis tools. Given a bounded input…

Machine Learning · Computer Science 2022-11-29 Wael Fatnassi , Haitham Khedr , Valen Yamamoto , Yasser Shoukry

The conventional rounding error analysis provides worst-case bounds with an associated failure probability and ignores the statistical property of the rounding errors. In this paper, we develop a new statistical rounding error analysis for…

Numerical Analysis · Mathematics 2025-11-04 Yiming Fang , Li Chen

Many of today's probabilistic programming languages (PPLs) have brittle inference performance: the performance of the underlying inference algorithm is very sensitive to the precise way in which the probabilistic program is written. A…

Artificial Intelligence · Computer Science 2023-02-22 Ellie Y. Cheng , Todd Millstein , Guy Van den Broeck , Steven Holtzen

Random Fourier Features (RFF) is among the most popular and broadly applicable approaches for scaling up kernel methods. In essence, RFF allows the user to avoid costly computations on a large kernel matrix via a fast randomized…

Machine Learning · Statistics 2023-02-23 Junwen Yao , N. Benjamin Erichson , Miles E. Lopes

Error bounds have been studied for more than seventy years, beginning with the seminal result of Hoffman (1952) [{\it J. Res. Natl. Bur. Standards}, 49 (1952), 263--265], which establishes an upper bound for the distance from an arbitrary…

Optimization and Control · Mathematics 2026-05-25 Zhou Wei , Michel Thera , Jen-Chih Yao

Algorithms operating on real numbers are implemented as floating-point computations in practice, but floating-point operations introduce roundoff errors that can degrade the accuracy of the result. We propose $\Lambda_{num}$, a functional…

Programming Languages · Computer Science 2025-04-10 Ariel E. Kellison , Justin Hsu

Rank-constrained matrix problems appear frequently across science and engineering. The convergence analysis of iterative algorithms developed for these problems often hinges on local error bounds, which correlate the distance to the…

Optimization and Control · Mathematics 2025-10-03 Ruoning Chen , Defeng Sun , Liping Zhang