English
Related papers

Related papers: On the error in Laplace approximations of high-dim…

200 papers

For time series with high temporal correlation, the empirical process converges rather slowly to its limiting distribution. Many statistics in change-point analysis, goodness-of-fit testing and uncertainty quantification admit a…

Statistics Theory · Mathematics 2025-05-26 Annika Betken , Marie-Christine Düker

The Laplace approximation has been one of the workhorses of Bayesian inference. It often delivers good approximations in practice despite the fact that it does not strictly take into account where the volume of posterior density lies.…

Machine Learning · Statistics 2022-03-02 Nikolaos Gianniotis

Modern applications require methods that are computationally feasible on large datasets but also preserve statistical efficiency. Frequently, these two concerns are seen as contradictory: approximation methods that enable computation are…

Methodology · Statistics 2021-06-11 Darren Homrighausen , Daniel J. McDonald

Coherent lower previsions are general probabilistic models allowing incompletely specified probability distributions. However, for complete description of a coherent lower prevision -- even on finite underlying sample spaces -- an infinite…

Probability · Mathematics 2022-09-29 Damjan Škulj

The purpose of this note is to compare various approximation methods as applied to the inverse of the Bessel function of the first kind, in a given domain of the complex plane.

Numerical Analysis · Mathematics 2018-01-11 D. S. Karachalios , I. V. Gosea , Q. Zhang , A. C. Antoulas

Laplace approximations are classic, computationally lightweight means for constructing Bayesian neural networks (BNNs). As in other approximate BNNs, one cannot necessarily expect the induced predictive uncertainty to be calibrated. Here we…

Machine Learning · Computer Science 2021-06-08 Agustinus Kristiadi , Matthias Hein , Philipp Hennig

We derive an extended empirical likelihood for parameters defined by estimating equations which generalizes the original empirical likelihood for such parameters to the full parameter space. Under mild conditions, the extended empirical…

Statistics Theory · Mathematics 2013-06-07 Min Tsao , Fan Wu

We explore unique considerations involved in fitting ML models to data with very high precision, as is often required for science applications. We empirically compare various function approximation methods and study how they scale with…

Machine Learning · Computer Science 2023-02-01 Eric J. Michaud , Ziming Liu , Max Tegmark

The first order loss function and its complementary function are extensively used in practical settings. When the random variable of interest is normally distributed, the first order loss function can be easily expressed in terms of the…

Optimization and Control · Mathematics 2014-09-09 Roberto Rossi , S. Armagan Tarim , Steven Prestwich , Brahim Hnich

A fast method of an arbitrary high order for approximating volume potentials is proposed, which is effective also in high dimensional cases. Basis functions introduced in the theory of approximate approximations are used. Results of…

Numerical Analysis · Mathematics 2009-11-04 Flavia Lanzara , Vladimir Maz'ya , Gunther Schmidt

Linear mixed models (LMMs) are used extensively to model dependecies of observations in linear regression and are used extensively in many application areas. Parameter estimation for LMMs can be computationally prohibitive on big data.…

Machine Learning · Statistics 2019-03-08 Zilong Tan , Kimberly Roche , Xiang Zhou , Sayan Mukherjee

We prove extension-dimensional versions of finite dimensional selection and approximation theorems. As applications, we obtain several results on extension dimension.

General Topology · Mathematics 2007-05-23 N. Brodsky , A. Chigogidze , A. Karasev

Two approximations of the integral of a class of sinusoidal composite functions, for which an explicit form does not exist, are derived. Numerical experiments show that the proposed approximations yield an error that does not depend on the…

Numerical Analysis · Mathematics 2024-01-17 Alberto Costa

Approximations of optimization problems arise in computational procedures and sensitivity analysis. The resulting effect on solutions can be significant, with even small approximations of components of a problem translating into large…

Optimization and Control · Mathematics 2022-08-10 Johannes O. Royset

The initial remarks in this technical report are primarily for those not familiar with the properties of L1 approximation, but the remainder of the report should also interest readers who are already acquainted with the inner workings of L1…

Machine Learning · Computer Science 2020-01-06 Ian Barrodale

This paper introduces a Laplace approximation to Bayesian inference in Dirichlet regression models, which can be used to analyze a set of variables on a simplex exhibiting skewness and heteroscedasticity, without having to transform the…

In this chapter, we discuss recent work on learning sparse approximations to high-dimensional functions on data, where the target functions may be scalar-, vector- or even Hilbert space-valued. Our main objective is to study how the…

Numerical Analysis · Mathematics 2022-02-08 Ben Adcock , Juan M. Cardenas , Nick Dexter , Sebastian Moraga

As data volume grows extensively, data profiling helps to extract metadata of large-scale data. However, one kind of metadata, order statistics, is difficult to be computed because they are not mergeable or incremental. Thus, the limitation…

Data Structures and Algorithms · Computer Science 2020-06-29 Zhiwei Chen , Aoqian Zhang

Spatial approximations have been traditionally used in spatial databases to accelerate the processing of complex geometric operations. However, approximations are typically only used in a first filtering step to determine a set of candidate…

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright
‹ Prev 1 3 4 5 6 7 10 Next ›