English
Related papers

Related papers: Application of Quantum Theory to Super-parametric …

200 papers

This article examines density estimation by combining a parametric approach with a nonparametric factor. The plug-in parametric estimator is seen as a crude estimator of the true density and is adjusted by a nonparametric factor. The…

Statistics Theory · Mathematics 2007-06-13 Kanta Naito

This paper tackles the issue of real-time parametric estimation of a wide class of probability density functions from limited datasets. This type of estimation addresses recent applications that require joint sensing and actuation. The…

Information Theory · Computer Science 2022-03-21 Ahmad A. Masoud

Several disciplines, like the social sciences, epidemiology, sentiment analysis, or market research, are interested in knowing the distribution of the classes in a population rather than the individual labels of the members thereof.…

Machine Learning · Computer Science 2024-01-04 Alejandro Moreo , Pablo González , Juan José del Coz

We study mixture of linear regression (random coefficient) models, which capture population heterogeneity by allowing the regression coefficients to follow an unknown distribution $G^*$. In contrast to common parametric methods that fix the…

Methodology · Statistics 2025-07-01 Hansheng Jiang , Adityanand Guntuboyina

The purpose of this article is to develop a general parametric estimation theory that allows the derivation of the limit distribution of estimators in non-regular models where the true parameter value may lie on the boundary of the…

Statistics Theory · Mathematics 2022-11-28 Junichiro Yoshida , Nakahiro Yoshida

Bayesian field theory denotes a nonparametric Bayesian approach for learning functions from observational data. Based on the principles of Bayesian statistics, a particular Bayesian field theory is defined by combining two models: a…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. C. Lemm

We introduce a nonparametric way to estimate the global probability density function for a random persistence diagram. Precisely, a kernel density function centered at a given persistence diagram and a given bandwidth is constructed. Our…

Statistics Theory · Mathematics 2018-03-14 Joshua Lee Mike , Vasileios Maroulas

Nonparametric density estimation is an unsupervised learning problem. In this work we propose a two-step procedure that casts the density estimation problem in the first step into a supervised regression problem. The advantage is that we…

Statistics Theory · Mathematics 2024-06-04 Thijs Bos , Johannes Schmidt-Hieber

This article proposes a novel density estimation based algorithm for carrying out supervised machine learning. The proposed algorithm features O(n) time complexity for generating a classifier, where n is the number of sampling instances in…

Machine Learning · Statistics 2007-11-06 Yen-Jen Oyang , Chien-Yu Chen , Darby Tien-Hao Chang , Chih-Peng Wu

We propose a novel approach for density estimation with exponential families for the case when the true density may not fall within the chosen family. Our approach augments the sufficient statistics with features designed to accumulate…

Machine Learning · Statistics 2012-09-07 Lin Yuan , Sergey Kirshner , Robert Givan

We investigate statistical properties of a likelihood approach to nonparametric estimation of a singular distribution using deep generative models. More specifically, a deep generative model is used to model high-dimensional data that are…

Machine Learning · Statistics 2023-03-29 Minwoo Chae , Dongha Kim , Yongdai Kim , Lizhen Lin

Transformer-based large language models (LLMs) are comprised of billions of parameters arranged in deep and wide computational graphs. Several studies on LLM efficiency optimization argue that it is possible to prune a significant portion…

Computation and Language · Computer Science 2026-04-16 Corentin Kervadec , Iuliia Lysova , Marco Baroni , Gemma Boleda

Estimation of probability density function from samples is one of the central problems in statistics and machine learning. Modern neural network-based models can learn high dimensional distributions but have problems with hyperparameter…

Machine Learning · Computer Science 2022-02-28 Georgii S. Novikov , Maxim E. Panov , Ivan V. Oseledets

With the recent growth in data availability and complexity, and the associated outburst of elaborate modelling approaches, model selection tools have become a lifeline, providing objective criteria to deal with this increasingly challenging…

Methodology · Statistics 2020-10-08 Alessandro Casa , Luca Scrucca , Giovanna Menardi

In this paper we study the problem of pointwise density estimation from observations with multiplicative measurement errors. We elucidate the main feature of this problem: the influence of the estimation point on the estimation accuracy. In…

Methodology · Statistics 2018-07-13 Denis Belomestny , Alexander Goldenshluger

There is an intense and partly recent literature focussing on the problem of selecting the bandwidth parameter for kernel density estimators. Available methods are largely `very nonparametric', in the sense of not requiring any knowledge…

Methodology · Statistics 2026-02-17 Nils Lid Hjort

Nonparametric density estimation is of great importance when econometricians want to model the probabilistic or stochastic structure of a data set. This comprehensive review summarizes the most important theoretical aspects of kernel…

Methodology · Statistics 2012-12-13 Adriano Zanin Zambom , Ronaldo Dias

The paper exposes a non-parametric approach to latent and co-latent modeling of bivariate data, based upon alternating minimization of the Kullback-Leibler divergence (EM algorithm) for complete log-linear models. For categorical data, the…

Methodology · Statistics 2016-03-10 François Bavaud

State estimation is a classical problem in quantum information. In optimization of estimation scheme, to find a lower bound to the error of the estimator is a very important step. So far, all the proposed tractable lower bounds use…

Quantum Physics · Physics 2007-05-23 Yoshiyuki Tsuda , Keiji Matsumoto

We propose a way of transforming the problem of conditional density estimation into a single nonparametric regression task via the introduction of auxiliary samples. This allows leveraging regression methods that work well in high…

Machine Learning · Statistics 2025-11-25 Alexander G. Reisach , Olivier Collier , Alex Luedtke , Antoine Chambaz