English
Related papers

Related papers: Estimation in Functional Regression for General Ex…

200 papers

Given a gamma population with known shape parameter $\alpha$, we develop a general theory for estimating a function $g(\cdot)$ of the scale parameter $\beta$ with bounded variance. We begin by defining a sequential sampling procedure with…

Methodology · Statistics 2024-07-09 Jun Hu , Ibtihal Alanazi , Zhe Wang

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

Asymptotic theory for approximate martingale estimating functions is generalised to diffusions with finite-activity jumps, when the sampling frequency and terminal sampling time go to infinity. Rate optimality and efficiency are of…

Methodology · Statistics 2018-09-05 Nina Munkholt Jakobsen , Michael Sørensen

Although persistent excitation is often acknowledged as a sufficient condition to exponentially converge in the field of adaptive parameter estimation, it must be noted that in practical applications this may be unguaranteed. Recently, more…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Siyu Chen , Jing Na , Yingbo Huang

We consider the problem of decision-making with side information and unbounded loss functions. Inspired by probably approximately correct learning model, we use a slightly different model that incorporates the notion of side information in…

Machine Learning · Computer Science 2007-07-13 Majid Fozunbal , Ton Kalker

The assumption of normality in data has been considered in the field of statistical analysis for a long time. However, in many practical situations, this assumption is clearly unrealistic. It has recently been suggested that the use of…

Computation · Statistics 2016-11-25 Reinaldo B. Arellano-Valle , Javier E. Contreras-Reyes

We study optimal estimation when the likelihood may be misspecified. Building on tools from the theory of decision-making under uncertainty, we analyze a class of axiomatically grounded optimality criteria which nests several existing…

Econometrics · Economics 2026-04-28 Isaiah Andrews , Ricky Li , Yucheng Shang

Finite mixtures of regression models offer a flexible framework for investigating heterogeneity in data with functional dependencies. These models can be conveniently used for unsupervised learning on data with clear regression…

Methodology · Statistics 2013-12-03 Utkarsh J. Dang , Paul D. McNicholas

In this paper we propose a family of multivariate asymmetric distributions over an arbitrary subset of set of real numbers which is defined in terms of the well-known elliptically symmetric distributions. We explore essential properties,…

Methodology · Statistics 2024-09-02 Roberto Vila , Helton Saulo , Leonardo Santos , João Monteiros , Felipe Quintino

In nonparametric statistics an optimality criterion for estimation procedures is provided by the minimax rate of convergence. However this classical point of view is subject to controversy as it requires to look for the worst behaviour…

Statistics Theory · Mathematics 2009-02-20 A. Fraysse

We consider a general nonparametric regression model called the compound model. It includes, as special cases, sparse additive regression and nonparametric (or linear) regression with many covariates but possibly a small number of relevant…

Statistics Theory · Mathematics 2013-01-04 Arnak Dalalyan , Yuri Ingster , Alexandre Tsybakov

Subsampling is an efficient method to deal with massive data. In this paper, we investigate the optimal subsampling for linear quantile regression when the covariates are functions. The asymptotic distribution of the subsampling estimator…

Numerical Analysis · Mathematics 2022-05-06 Qian Yan , Hanyu Li , Chengmei Niu

Statistical inference may follow a frequentist approach or it may follow a Bayesian approach or it may use the minimum description length principle (MDL). Our goal is to identify situations in which these different approaches to statistical…

Statistics Theory · Mathematics 2018-05-08 Peter Harremoës

We consider the problem of constructing nonparametric undirected graphical models for high-dimensional functional data. Most existing statistical methods in this context assume either a Gaussian distribution on the vertices or linear…

Statistics Theory · Mathematics 2021-03-22 Eftychia Solea , Holger Dette

This paper deals with some nonlinear problems which exponential and biexponential decays are involved in. A proof of the quasiconvexity of the error function in some of these problems of optimization is presented. This proof is restricted…

We propose a general method for optimization with semi-infinite constraints that involve a linear combination of functions, focusing on the case of the exponential function. Each function is lower and upper bounded on sub-intervals by…

Optimization and Control · Mathematics 2014-01-13 Bogdan Dumitrescu , Bogdan C. Sicleru , Florin Avram

Prompted by an observation about the integral of exponential functions of the form $f(x)=\lambda e^{\alpha x}$, we investigate the possibility to exactly integrate families of functions generated from a given function by scaling or by…

Numerical Analysis · Mathematics 2026-05-14 Georg M. von Hippel

It is often of interest to assess whether a function-valued statistical parameter, such as a density function or a mean regression function, is equal to any function in a class of candidate null parameters. This can be framed as a…

Methodology · Statistics 2023-06-14 Aaron Hudson

Exponential families form the backbone of modern statistics and machine learning, but textbooks seldom derive them from first principles in an accessible way. Although minimal sufficiency and the principle of maximum entropy, originating in…

Methodology · Statistics 2026-04-27 Korbinian Strimmer

Using gradient descent (GD) with fixed or decaying step-size is a standard practice in unconstrained optimization problems. However, when the loss function is only locally convex, such a step-size schedule artificially slows GD down as it…

Machine Learning · Statistics 2023-02-03 Nhat Ho , Tongzheng Ren , Sujay Sanghavi , Purnamrita Sarkar , Rachel Ward