English
Related papers

Related papers: The Kernel Mixture Network: A Nonparametric Method…

200 papers

Nonparametric density estimation is of great importance when econometricians want to model the probabilistic or stochastic structure of a data set. This comprehensive review summarizes the most important theoretical aspects of kernel…

Methodology · Statistics 2012-12-13 Adriano Zanin Zambom , Ronaldo Dias

In this paper, we propose a special fusion method for combining ensembles of base classifiers utilizing new neural networks in order to improve overall efficiency of classification. While ensembles are designed such that each classifier is…

Machine Learning · Computer Science 2009-12-08 Mehdi Salkhordeh Haghighi , Hadi Sadoghi Yazdi , Abedin Vahedian , Hamed Modaghegh

A density estimation method in a Bayesian nonparametric framework is presented when recorded data are not coming directly from the distribution of interest, but from a length biased version. From a Bayesian perspective, efforts to…

Statistics Theory · Mathematics 2015-10-23 Spyridon J. Hatjispyros , Theodoros Nicoleris , Stephen G. Walker

A nonparametric kernel density estimator for directional-linear data is introduced. The proposal is based on a product kernel accounting for the different nature of both (directional and linear) components of the random vector. Expressions…

Structural kernels are a flexible learning paradigm that has been widely used in Natural Language Processing. However, the problem of model selection in kernel-based methods is usually overlooked. Previous approaches mostly rely on setting…

Computation and Language · Computer Science 2015-08-11 Daniel Beck , Trevor Cohn , Christian Hardmeier , Lucia Specia

Parametric factor copula models typically work well in modeling multivariate dependencies due to their flexibility and ability to capture complex dependency structures. However, accurately estimating the linking copulas within these models…

Methodology · Statistics 2025-10-22 Bahareh Ghanbari , Pavel Krupskiy , Laleh Tafakori , Yan Wang

Stochastic gradient descent algorithms for training linear and kernel predictors are gaining more and more importance, thanks to their scalability. While various methods have been proposed to speed up their convergence, the model selection…

Machine Learning · Computer Science 2014-06-17 Francesco Orabona

In this paper we introduce a method for nonparametric density estimation on geometric networks. We define fused density estimators as solutions to a total variation regularized maximum-likelihood density estimation problem. We provide…

Methodology · Statistics 2018-12-06 Robert Bassett , James Sharpnack

This paper addresses the problem of unsupervised soft bit error rate (BER) estimation for any communications system, where no prior knowledge either about transmitted information bits, or the transceiver scheme is available. We show that…

Information Theory · Computer Science 2013-09-26 Samir Saoudi , Tarik Ait-Idir , Yukou Mochida

We study nonparametric estimation of density functions for undirected dyadic random variables (i.e., random variables defined for all n\overset{def}{\equiv}\tbinom{N}{2} unordered pairs of agents/nodes in a weighted network of order N).…

Statistics Theory · Mathematics 2019-08-01 Bryan S. Graham , Fengshi Niu , James L. Powell

This study proposes multivariate kernel density estimation by stagewise minimization algorithm based on $U$-divergence and a simple dictionary. The dictionary consists of an appropriate scalar bandwidth matrix and a part of the original…

Machine Learning · Statistics 2021-08-11 Kiheiji Nishida , Kanta Naito

We propose a data-driven approach to quantify the uncertainty of models constructed by kernel methods. Our approach minimizes the needed distributional assumptions, hence, instead of working with, for example, Gaussian processes or…

Machine Learning · Computer Science 2019-08-06 Balázs Csanád Csáji , Krisztián Balázs Kis

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

Machine Learning · Statistics 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He

Online change detection involves monitoring a stream of data for changes in the statistical properties of incoming observations. A good change detector will detect any changes shortly after they occur, while raising few false alarms.…

Statistics Theory · Mathematics 2020-03-03 Thomas Flynn , Shinjae Yoo

Recent research has established sufficient conditions for finite mixture models to be identifiable from grouped observations. These conditions allow the mixture components to be nonparametric and have substantial (or even total) overlap.…

Machine Learning · Statistics 2020-06-16 Alexander Ritchie , Robert A. Vandermeulen , Clayton Scott

Compared to point estimates calculated by standard neural networks, Bayesian neural networks (BNN) provide probability distributions over the output predictions and model parameters, i.e., the weights. Training the weight distribution of a…

Machine Learning · Computer Science 2022-12-01 Philipp Wagner , Xinyang Wu , Marco F. Huber

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

Mixing (or prior) density estimation is an important problem in machine learning and statistics, especially in empirical Bayes $g$-modeling where accurately estimating the prior is necessary for making good posterior inferences. In this…

Machine Learning · Statistics 2024-06-11 Shijie Wang , Saptarshi Chakraborty , Qian Qin , Ray Bai

The recent development of multi-agent simulations brings about a need for population synthesis. It is a task of reconstructing the entire population from a sampling survey of limited size (1% or so), supplying the initial conditions from…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Naoki Hamada , Katsumi Homma , Hiroyuki Higuchi , Hideyuki Kikuchi

Robust statistical data modelling under potential model mis-specification often requires leaving the parametric world for the nonparametric. In the latter, parameters are infinite dimensional objects such as functions, probability…