English
Related papers

Related papers: The $f$-Divergence Expectation Iteration Scheme

200 papers

Estimation of the $\phi$-divergence between two unknown probability distributions using empirical data is a fundamental problem in information theory and statistical learning. We consider a multi-variate generalization of the data dependent…

Probability · Mathematics 2018-01-04 Fengqiao Luo , Sanjay Mehrotra

Automated Feature Engineering (AFE) refers to automatically generate and select optimal feature sets for downstream tasks, which has achieved great success in real-world applications. Current AFE methods mainly focus on improving the…

Machine Learning · Computer Science 2022-12-27 Kafeng Wang , Pengyang Wang , Chengzhong xu

We study the convergence rates of empirical Bayes posterior distributions for nonparametric and high-dimensional inference. We show that as long as the hyperparameter set is discrete, the empirical Bayes posterior distribution induced by…

Statistics Theory · Mathematics 2020-09-10 Fengshuo Zhang , Chao Gao

In this paper we present a novel approach towards variance reduction for discretised diffusion processes. The proposed approach involves specially constructed control variates and allows for a significant reduction in the variance for the…

Probability · Mathematics 2017-12-05 Denis Belomestny , Stefan Häfner , Mikhail Urusov

This paper introduces the Bayesian Inference Engine (BIE), a general parallel, optimised software package for parameter inference and model selection. This package is motivated by the analysis needs of modern astronomical surveys and the…

Instrumentation and Methods for Astrophysics · Physics 2015-06-04 Martin D. Weinberg

Likelihood-based inference in stochastic non-linear dynamical systems, such as those found in chemical reaction networks and biological clock systems, is inherently complex and has largely been limited to small and unrealistically simple…

Computation · Statistics 2024-07-08 Ben Swallow , David A. Rand , Giorgos Minas

Iterated function systems (IFS) can be a surprisingly useful tool for studying structure in data. Here we present results stemming from a 2013 computational study by the author using IFS. The results include fractal patterns that reveal…

Number Theory · Mathematics 2017-01-04 Harlan J. Brothers

The analysis of data from multiple experiments, such as observations of several individuals, is commonly approached using mixed-effects models, which account for variation between individuals through hierarchical representations. This makes…

Computation · Statistics 2026-03-05 Henrik Häggström , Sebastian Persson , Marija Cvijovic , Umberto Picchini

A common problem in Machine Learning and statistics consists in detecting whether the current sample in a stream of data belongs to the same distribution as previous ones, is an isolated outlier or inaugurates a new distribution of data. We…

Machine Learning · Statistics 2018-05-16 Vincent Moens

This presentation describes the Bayesian Block algorithm in the context of its application to analysis of time series data from the Fermi Gamma Ray Space Telescope. More generally this algorithm performs optimal segmentation analysis on…

Instrumentation and Methods for Astrophysics · Physics 2013-05-28 Jeffrey D. Scargle , Jay P. Norris , Brad Jackson , James Chiang

Many problems in robotics involve both continuous and discrete components, and modeling them together for estimation tasks has been a long standing and difficult problem. Hybrid Factor Graphs give us a mathematical framework to model these…

Robotics · Computer Science 2026-05-04 Varun Agrawal , Frank Dellaert

Despite the success of large-scale empirical risk minimization (ERM) at achieving high accuracy across a variety of machine learning tasks, fair ERM is hindered by the incompatibility of fairness constraints with stochastic optimization. We…

Machine Learning · Computer Science 2023-01-13 Andrew Lowy , Sina Baharlouei , Rakesh Pavan , Meisam Razaviyayn , Ahmad Beirami

The efficient importance sampling (EIS) method is a general principle for the numerical evaluation of high-dimensional integrals that uses the sequential structure of target integrands to build variance minimising importance samplers.…

Computation · Statistics 2013-09-27 Marcel Scharth , Robert Kohn

There has recently been considerable interest in addressing the problem of unifying distributed statistical analyses into a single coherent inference. This problem naturally arises in a number of situations, including in big-data settings,…

Methodology · Statistics 2021-02-04 Hongsheng Dai , Murray Pollock , Gareth Roberts

We propose a new regularisation strategy for the classical ensemble Kalman inversion (EKI) framework. The strategy consists of: (i) an adaptive choice for the regularisation parameter in the update formula in EKI, and (ii) criteria for the…

Numerical Analysis · Mathematics 2020-09-24 Marco Iglesias , Yuchen Yang

$f$-divergences are a general class of divergences between probability measures which include as special cases many commonly used divergences in probability, mathematical statistics and information theory such as Kullback-Leibler…

Statistics Theory · Mathematics 2013-10-16 Adityanand Guntuboyina , Sujayam Saha , Geoffrey Schiebinger

This paper presents a communication efficient distributed algorithm, $\mathcal{CIRFE}$ of the \emph{consensus}+\emph{innovations} type, to estimate a high-dimensional parameter in a multi-agent network, in which each agent is interested in…

Optimization and Control · Mathematics 2018-10-17 Anit Kumar Sahu , Dusan Jakovetic , Soummya Kar

This article deals with the computation of guaranteed lower bounds of the error in the framework of finite element (FE) and domain decomposition (DD) methods. In addition to a fully parallel computation, the proposed lower bounds separate…

Numerical Analysis · Mathematics 2016-06-22 Valentine Rey , Pierre Gosselet , Christian Rey

Machine learning algorithms are becoming integrated into more and more high-stakes decision-making processes, such as in social welfare issues. Due to the need of mitigating the potentially disparate impacts from algorithmic predictions,…

Machine Learning · Statistics 2024-02-07 Xianli Zeng , Edgar Dobriban , Guang Cheng

We study invariant sets and measures generated by iterated function systems defined on countable discrete spaces that are uniform grids of a finite dimension. The discrete spaces of this type can be considered as models of spaces in which…

Dynamical Systems · Mathematics 2024-10-22 Tomasz Martyn