English
Related papers

Related papers: A probabilistic framework for approximating functi…

200 papers

The motivation of this paper is the development of an optimisation method for solving optimisation problems appearing in Chebyshev rational and generalised rational approximation problems, where the approximations are constructed as ratios…

Optimization and Control · Mathematics 2020-11-06 R. Díaz Millán , Nadezda Sukhorukova , Julien Ugon

We propose a novel sampling framework for inference in probabilistic models: an active learning approach that converges more quickly (in wall-clock time) than Markov chain Monte Carlo (MCMC) benchmarks. The central challenge in…

Machine Learning · Statistics 2014-11-04 Tom Gunter , Michael A. Osborne , Roman Garnett , Philipp Hennig , Stephen J. Roberts

Inferential models (IMs) offer prior-free, Bayesian-like posterior degrees of belief designed for statistical inference, which feature a frequentist-like calibration property that ensures reliability of said inferences. The catch is that…

Computation · Statistics 2025-07-09 Ryan Martin

Approximate Bayesian computation (ABC) is a popular likelihood-free inference method for models with intractable likelihood functions. As ABC methods usually rely on comparing summary statistics of observed and simulated data, the choice of…

Machine Learning · Statistics 2022-06-22 Ayush Bharti , Louis Filstroff , Samuel Kaski

The performance of the Monte Carlo sampling methods relies on the crucial choice of a proposal density. The notion of optimality is fundamental to design suitable adaptive procedures of the proposal density within Monte Carlo schemes. This…

Computation · Statistics 2026-02-24 Fernando Llorente , Luca Martino

In this paper we present an efficient active-set method for the solution of convex quadratic programming problems with general piecewise-linear terms in the objective, with applications to sparse approximations and risk-minimization. The…

Optimization and Control · Mathematics 2023-03-01 Spyridon Pougkakiotis , Jacek Gondzio , Dionysios S. Kalogerias

We demonstrate a data-driven method to solve for the invariant probability density function of a randomly perturbed dynamical system. The key idea is to replace the boundary condition of numerical schemes by a least squares problem…

Numerical Analysis · Mathematics 2019-03-27 Yao Li

Active inference has emerged as an alternative approach to control problems given its intuitive (probabilistic) formalism. However, despite its theoretical utility, computational implementations have largely been restricted to…

Machine Learning · Computer Science 2022-03-01 Aswin Paul , Noor Sajid , Manoj Gopalkrishnan , Adeel Razi

We study the approximation of functions which are invariant with respect to certain permutations of the input indices using flow maps of dynamical systems. Such invariant functions includes the much studied translation-invariant ones…

Machine Learning · Computer Science 2022-08-19 Qianxiao Li , Ting Lin , Zuowei Shen

Intelligent systems sometimes need to infer the probable goals of people, cars, and robots, based on partial observations of their motion. This paper introduces a class of probabilistic programs for formulating and solving these problems.…

Artificial Intelligence · Computer Science 2017-04-19 Marco F. Cusumano-Towner , Alexey Radul , David Wingate , Vikash K. Mansinghka

In computational practice, most attention is paid to rational approximations of functions and approximations by the sum of exponents. We consider a wide enough class of nonlinear approximations characterized by a set of two required…

Numerical Analysis · Mathematics 2023-01-18 Petr N. Vabishchevich

Space filling designs are central to studying complex systems in various areas of science. They are used for obtaining an overall understanding of the behaviour of the response over the input space, model construction and uncertainty…

Methodology · Statistics 2016-08-10 Shirin Golchi , Jason L. Loeppky

This paper proposes Monte Carlo Action Programming, a programming language framework for autonomous systems that act in large probabilistic state spaces with high branching factors. It comprises formal syntax and semantics of a…

Artificial Intelligence · Computer Science 2017-03-01 Lenz Belzner

In this paper, we propose an incremental abstraction method for dynamically over-approximating nonlinear systems in a bounded domain by solving a sequence of linear programs, resulting in a sequence of affine upper and lower hyperplanes…

Optimization and Control · Mathematics 2020-04-06 Syed M. Hassaan , Mohammad Khajenejad , Spencer Jensen , Qiang Shen , Sze Zheng Yong

We introduce a new class of Frank-Wolfe algorithms for minimizing differentiable functionals over probability measures. This framework can be shown to encompass a diverse range of tasks in areas such as artificial intelligence,…

Computation · Statistics 2021-05-13 Carson Kent , Jose Blanchet , Peter Glynn

Tensor methods are among the most prominent tools for the numerical solution of high-dimensional problems where functions of multiple variables have to be approximated. These methods exploit the tensor structure of function spaces and apply…

Numerical Analysis · Mathematics 2021-02-01 Anthony Nouy

Model reduction is an active research field to construct low-dimensional surrogate models of high fidelity to accelerate engineering design cycles. In this work, we investigate model reduction for linear structured systems using dominant…

Machine Learning · Statistics 2024-09-09 Celine Reddig , Pawan Goyal , Igor Pontes Duff , Peter Benner

In this paper, we introduce a method for approximating the solution to inference and optimization tasks in uncertain and deterministic reasoning. Such tasks are in general intractable for exact algorithms because of the large number of…

Artificial Intelligence · Computer Science 2012-12-12 David Ephraim Larkin

In classification tasks, softmax functions are ubiquitously used as output activations to produce predictive probabilities. Such outputs only capture aleatoric uncertainty. To capture epistemic uncertainty, approximate Gaussian inference…

Machine Learning · Computer Science 2026-02-12 Bálint Mucsányi , Nathaël Da Costa , Philipp Hennig

Classical algorithms in numerical analysis for numerical integration (quadrature/cubature) follow the principle of approximate and integrate: the integrand is approximated by a simple function (e.g. a polynomial), which is then integrated…

Numerical Analysis · Mathematics 2018-06-15 Yuji Nakatsukasa