English
Related papers

Related papers: Kernel Recursive ABC: Point Estimation with Intrac…

200 papers

Kernel embeddings have emerged as a powerful tool for representing probability measures in a variety of statistical inference problems. By mapping probability measures into a reproducing kernel Hilbert space (RKHS), kernel embeddings enable…

Machine Learning · Statistics 2024-10-31 Dino Sejdinovic

This paper derives error bounds for regression in continuous time over subsets of certain types of Riemannian manifolds.The regression problem is typically driven by a nonlinear evolution law taking values on the manifold, and it is cast as…

Dynamical Systems · Mathematics 2022-09-09 Nathan Powell , Jia Guo , Sai Tej Parachuri , John Burns , Boone Estes , Andrew Kurdila

We develop algorithms with low regret for learning episodic Markov decision processes based on kernel approximation techniques. The algorithms are based on both the Upper Confidence Bound (UCB) as well as Posterior or Thompson Sampling…

Machine Learning · Computer Science 2019-11-06 Sayak Ray Chowdhury , Aditya Gopalan

Although the Bayesian paradigm offers a formal framework for estimating the entire probability distribution over uncertain parameters, its online implementation can be challenging due to high computational costs. We suggest the Adaptive…

Machine Learning · Computer Science 2023-10-23 Pedram Agand , Mo Chen , Hamid D. Taghirad

In this article, we present a novel inference framework for estimating the parameters of Continuous-State Branching Processes (CSBPs). We do so by leveraging their subordinator representation. Our method reformulates the estimation problem…

Scaling analysis, in which one infers scaling exponents and a scaling function in a scaling law from given data, is a powerful tool for determining universal properties of critical phenomena in many fields of science. However, there are…

Statistical Mechanics · Physics 2015-07-08 Kenji Harada

Additive principal components (APCs for short) are a nonlinear generalization of linear principal components. We focus on smallest APCs to describe additive nonlinear constraints that are approximately satisfied by the data. Thus APCs fit…

Methodology · Statistics 2015-11-24 Xin Lu Tan , Andreas Buja , Zongming Ma

In recent years dynamical modelling has been provided with a range of breakthrough methods to perform exact Bayesian inference. However it is often computationally unfeasible to apply exact statistical methodologies in the context of large…

Computation · Statistics 2014-12-24 Umberto Picchini , Julie Lyng Forman

No matter the nature of the response and/or explanatory variables in a regression model, some basic issues such as the existence of an effect of the predictor on the response, or the assessment of a common shape across groups of…

Applications · Statistics 2020-09-01 María Alonso-Pena , Jose Ameijeiras-Alonso , Rosa M. Crujeiras

A common problem in natural sciences is the comparison of competing models in the light of observed data. Bayesian model comparison provides a statistically sound framework for this comparison based on the evidence each model provides for…

Machine Learning · Statistics 2022-03-23 Jan Boelts

Computing the expectation of kernel functions is a ubiquitous task in machine learning, with applications from classical support vector machines to exploiting kernel embeddings of distributions in probabilistic modeling, statistical…

Machine Learning · Computer Science 2021-07-23 Wenzhe Li , Zhe Zeng , Antonio Vergari , Guy Van den Broeck

Many recent statistical applications involve inference under complex models, where it is computationally prohibitive to calculate likelihoods but possible to simulate data. Approximate Bayesian Computation (ABC) is devoted to these complex…

Populations and Evolution · Quantitative Biology 2011-06-15 Katalin Csilléry , Olivier François , Michael GB Blum

In this paper for the first time the nonparametric autoregression estimation problem for the quadratic risks is considered. To this end we develop a new adaptive sequential model selection method based on the efficient sequential kernel…

Statistics Theory · Mathematics 2018-09-10 Ouerdia Arkoun , Jean-Yves Brua , Serguei Pergamenshchikov

In this paper, we present a study of a kernel-based consensual aggregation on randomly projected high-dimensional features of predictions for regression. The aggregation scheme is composed of two steps: the high-dimensional features of…

Machine Learning · Statistics 2022-04-07 Sothea Has

This paper considers the problem of kernel regression and classification with possibly unobservable response variables in the data, where the mechanism that causes the absence of information is unknown and can depend on both predictors and…

Statistics Theory · Mathematics 2022-12-07 Majid Mojirsheibani , William Pouliot , Andre Shakhbandaryan

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

We study additive function-on-function regression where the mean response at a particular time point depends on the time point itself as well as the entire covariate trajectory. We develop a computationally efficient estimation methodology…

Methodology · Statistics 2016-12-15 Janet S. Kim , Ana-Maria Staicu , Arnab Maity , Raymond J. Carroll , David Ruppert

We present a method that allows efficient and safe approximation of model predictive controllers using kernel interpolation. Since the computational complexity of the approximating function scales linearly with the number of data points, we…

Systems and Control · Electrical Eng. & Systems 2025-07-22 Alexander Rose , Philipp Schaub , Rolf Findeisen

Many real-life problems are represented as a black-box, i.e., the internal workings are inaccessible or a closed-form mathematical expression of the likelihood function cannot be defined. For continuous random variables likelihood-free…

Machine Learning · Statistics 2020-10-21 Ilze Amanda Auzina , Jakub M. Tomczak

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury