English
Related papers

Related papers: Certified Roundoff Error Bounds using Bernstein Ex…

200 papers

With the rise of smartphones and the internet-of-things, data is increasingly getting generated at the edge on local, personal devices. For privacy, latency and energy saving reasons, this shift is causing machine learning algorithms to…

Machine Learning · Computer Science 2021-04-29 Jiaqi Li , Ross Drummond , Stephen R. Duncan

Bounding the best achievable error probability for binary classification problems is relevant to many applications including machine learning, signal processing, and information theory. Many bounds on the Bayes binary classification error…

Information Theory · Computer Science 2018-10-03 Salimeh Yasaei Sekeh , Morteza Noshad , Kevin R. Moon , Alfred O. Hero

The use of neural networks to solve differential equations, as an alternative to traditional numerical solvers, has increased recently. However, error bounds for the obtained solutions have only been developed for certain equations. In this…

Machine Learning · Computer Science 2024-11-22 Augusto T. Chantada , Pavlos Protopapas , Luca Gomez Bachar , Susana J. Landau , Claudia G. Scóccola

We analyse the forward error in the floating point summation of real numbers, from algorithms that do not require recourse to higher precision or better hardware. We derive informative explicit expressions, and new deterministic and…

Numerical Analysis · Mathematics 2021-07-06 Eric Hallman , Ilse C. F. Ipsen

Kernel methods are applied to many problems in pattern recognition, including subspace clustering (SC). That way, nonlinear problems in the input data space become linear in mapped high-dimensional feature space. Thereby, computationally…

Machine Learning · Computer Science 2024-01-31 Ivica Kopriva

Advanced super-resolution imaging techniques require specific approaches for accurate and consistent estimation of the achievable spatial resolution. Fisher information supplied to Cramer-Rao bound (CRB) has proved to be a powerful and…

Prediction error quantification in machine learning has been left out of most methodological investigations of neural networks, for both purely data-driven and physics-informed approaches. Beyond statistical investigations and generic…

Machine Learning · Computer Science 2024-06-19 Birgit Hillebrecht , Benjamin Unger

Computation of the large sparse matrix exponential has been an important topic in many fields, such as network and finite-element analysis. The existing scaling and squaring algorithm (SSA) is not suitable for the computation of the large…

Numerical Analysis · Mathematics 2021-10-12 Feng Wu , Kailing Zhang , Li Zhu , Jiayao Hu

We consider linear inverse problems where the solution is assumed to have a sparse expansion on an arbitrary pre-assigned orthonormal basis. We prove that replacing the usual quadratic regularizing penalties by weighted l^p-penalties on the…

Functional Analysis · Mathematics 2025-10-20 Ingrid Daubechies , Michel Defrise , Christine De Mol

We provide lower error bounds for randomized algorithms that approximate integrals of functions depending on an unrestricted or even infinite number of variables. More precisely, we consider the infinite-dimensional integration problem on…

Numerical Analysis · Mathematics 2021-02-09 Michael Gnewuch

We develop a Frank-Wolfe algorithm with corrective steps, generalizing previous algorithms including blended conditional gradients, blended pairwise conditional gradients, and fully-corrective Frank-Wolfe. For this, we prove tight…

Optimization and Control · Mathematics 2026-05-21 Jannis Halbey , Seta Rakotomandimby , Mathieu Besançon , Sébastien Designolle , Sebastian Pokutta

In this work, we propose a mean-squared error-based risk that enables the comparison and optimization of estimators of squared calibration errors in practical settings. Improving the calibration of classifiers is crucial for enhancing the…

Machine Learning · Computer Science 2025-02-24 Sebastian G. Gruber , Francis Bach

Orthogonality constraints naturally appear in many machine learning problems, from principal component analysis to robust neural network training. They are usually solved using Riemannian optimization algorithms, which minimize the…

Machine Learning · Statistics 2025-08-08 Pierre Ablin , Simon Vary , Bin Gao , P. -A. Absil

We study reinforcement learning in non-episodic factored Markov decision processes (FMDPs). We propose two near-optimal and oracle-efficient algorithms for FMDPs. Assuming oracle access to an FMDP planner, they enjoy a Bayesian and a…

Machine Learning · Statistics 2020-06-09 Ziping Xu , Ambuj Tewari

This article studies a combination of the two state-of-the-art algorithms for the exact solution of linear programs (LPs) over the rational numbers, i.e., without any roundoff errors or numerical tolerances. By integrating the method of…

Optimization and Control · Mathematics 2023-11-15 Leon Eifler , Jules Nicolas-Thouvenin , Ambros Gleixner

Practical model building processes are often time-consuming because many different models must be trained and validated. In this paper, we introduce a novel algorithm that can be used for computing the lower and the upper bounds of model…

Machine Learning · Statistics 2014-02-11 Yoshiki Suzuki , Kohei Ogawa , Yuki Shinmura , Ichiro Takeuchi

We introduce LiPopt, a polynomial optimization framework for computing increasingly tighter upper bounds on the Lipschitz constant of neural networks. The underlying optimization problems boil down to either linear (LP) or semidefinite…

Machine Learning · Computer Science 2020-04-21 Fabian Latorre , Paul Rolland , Volkan Cevher

We consider linear programming (LP) problems in infinite dimensional spaces that are in general computationally intractable. Under suitable assumptions, we develop an approximation bridge from the infinite-dimensional LP to tractable finite…

Optimization and Control · Mathematics 2017-02-22 Peyman Mohajerin Esfahani , Tobias Sutter , Daniel Kuhn , John Lygeros

Identifying breakpoints in piecewise regression is critical in enhancing the reliability and interpretability of data fitting. In this paper, we propose novel algorithms based on the greedy algorithm to accurately and efficiently identify…

Machine Learning · Statistics 2026-04-14 Taehyeong Kim , Hyungu Lee , Myungjin Kim , Hayoung Choi

Quantum error mitigation is a promising route to achieving quantum utility, and potentially quantum advantage in the near-term. Many state-of-the-art error mitigation schemes use knowledge of the errors in the quantum processor, which opens…