English
Related papers

Related papers: Optimal Bayes Classifiers for Functional Data and …

200 papers

Suppose $X_1,\dots, X_n$ is a random sample from a bounded and decreasing density $f_0$ on $[0,\infty)$. We are interested in estimating such $f_0$, with special interest in $f_0(0)$. This problem is encountered in various statistical…

Statistics Theory · Mathematics 2020-09-14 Geurt Jongbloed , Frank van der Meulen , Lixue Pang

This paper is concerned with forecasting probability density functions. Density functions are nonnegative and have a constrained integral; thus, they do not constitute a vector space. Implementing unconstrained functional time-series…

Methodology · Statistics 2025-10-14 Frédéric Ferraty , Han Lin Shang

We consider a nonparametric Bayesian approach to estimation and testing for a multivariate monotone density. Instead of following the conventional Bayesian route of putting a prior distribution complying with the monotonicity restriction,…

Statistics Theory · Mathematics 2023-06-09 Kang Wang , Subhashis Ghosal

We consider optimization of composite objective functions, i.e., of the form $f(x)=g(h(x))$, where $h$ is a black-box derivative-free expensive-to-evaluate function with vector-valued outputs, and $g$ is a cheap-to-evaluate real-valued…

Machine Learning · Statistics 2019-06-05 Raul Astudillo , Peter I. Frazier

When do nonparametric Bayesian procedures ``overfit''? To shed light on this question, we consider a binary regression problem in detail and establish frequentist consistency for a certain class of Bayes procedures based on hierarchical…

Statistics Theory · Mathematics 2007-06-13 Marc Coram , Steven P. Lalley

Naive Bayes estimator is widely used in text classification problems. However, it doesn't perform well with small-size training dataset. We propose a new method based on Naive Bayes estimator to solve this problem. A correlation factor is…

Information Retrieval · Computer Science 2019-05-16 Jiangning Chen , Zhibo Dai , Juntao Duan , Heinrich Matzinger , Ionel Popescu

We develop a fully Bayesian framework for function-on-scalars regression with many predictors. The functional data response is modeled nonparametrically using unknown basis functions, which produces a flexible and data-adaptive functional…

Methodology · Statistics 2018-10-25 Daniel R. Kowal , Daniel C. Bourgeois

In density estimation, the mean integrated squared error (MISE) is commonly used as a measure of performance. In that setting, the cross-validation criterion provides an unbiased estimator of the MISE minus the integral of the squared…

Methodology · Statistics 2024-07-30 José E. Chacón , Carlos Tenreiro

The estimation of the ratio of two density probability functions is of great interest in many statistics fields, including causal inference. In this study, we develop an ensemble estimator of density ratios with a novel loss function based…

Machine Learning · Statistics 2024-08-12 Wencheng Wu , David Benkeser

Meta learning uses information from base learners (e.g. classifiers or estimators) as well as information about the learning problem to improve upon the performance of a single base learner. For example, the Bayes error rate of a given…

Machine Learning · Computer Science 2016-03-11 Kevin R. Moon , Veronique Delouille , Alfred O. Hero

Recently quantum prediction problem was proposed in the Bayesian framework. It is shown that Bayesian predictive density operators are the best predictive density operators when we evaluate them by using the average relative entropy based…

Quantum Physics · Physics 2007-05-23 F. Tanaka , F. Komaki

We propose a Bayesian approach to learn discriminative dictionaries for sparse representation of data. The proposed approach infers probability distributions over the atoms of a discriminative dictionary using a Beta Process. It also…

Computer Vision and Pattern Recognition · Computer Science 2015-03-30 Naveed Akhtar , Faisal Shafait , Ajmal Mian

Grouped data are commonly encountered in applications. The Bernstein polynomial model is proposed as an approximate model in this paper for estimating a univariate density function based on grouped data. The coefficients of the Bernstein…

Methodology · Statistics 2015-07-21 Zhong Guan

Some scientific research questions ask to guide decisions and others do not. By their nature frequentist hypothesis-tests yield a dichotomous test decision as result, rendering them rather inappropriate for latter types of research…

Methodology · Statistics 2021-10-20 Patrick Schwaferts , Thomas Augustin

We propose an algorithm for a family of optimization problems where the objective can be decomposed as a sum of functions with monotonicity properties. The motivating problem is optimization of hyperparameters of machine learning…

Machine Learning · Computer Science 2018-02-20 Wenyi Wang , William J. Welch

Multivariate functional data arise in a wide range of applications. One fundamental task is to understand the causal relationships among these functional objects of interest, which has not yet been fully explored. In this article, we…

Methodology · Statistics 2022-10-25 Fangting Zhou , Kejun He , Kunbo Wang , Yanxun Xu , Yang Ni

In this article, we propose and develop a novel Bayesian algorithm for optimization of functions whose first and second partial derivatives are known. The basic premise is the Gaussian process representation of the function which induces a…

Optimization and Control · Mathematics 2020-10-27 Sucharita Roy , Sourabh Bhattacharya

In crowd counting datasets, each person is annotated by a point, which is usually the center of the head. And the task is to estimate the total count in a crowd scene. Most of the state-of-the-art methods are based on density map…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Zhiheng Ma , Xing Wei , Xiaopeng Hong , Yihong Gong

In a previous article, a least square regression estimation procedure was proposed: first, we condiser a family of functions and study the properties of an estimator in every unidimensionnal model defined by one of these functions; we then…

Statistics Theory · Mathematics 2007-06-13 Pierre Alquier

Bayesian methods are useful for statistical inference. However, real-world problems can be challenging using Bayesian methods when the data analyst has only limited prior knowledge. In this paper we consider a class of problems, called…

Methodology · Statistics 2019-11-20 Yixuan Qiu , Lingsong Zhang , Chuanhai Liu