中文
相关论文

相关论文: On-line tracking of a smooth regression function

200 篇论文

We study the parameter estimation method for linear regression models with possibly skewed stable distributed errors. Our estimation procedure consists of two stages: first, for the regression coefficients, the Cauchy quasi-maximum…

统计理论 · 数学 2025-06-25 Eitaro Kawamo , Hiroki Masuda

In this paper, we provide near-optimal accelerated first-order methods for minimizing a broad class of smooth nonconvex functions that are strictly unimodal on all lines through a minimizer. This function class, which we call the class of…

最优化与控制 · 数学 2023-02-27 Oliver Hinder , Aaron Sidford , Nimit S. Sohoni

Implicit models, which allow for the generation of samples but not for point-wise evaluation of probabilities, are omnipresent in real-world problems tackled by machine learning and a hot topic of current research. Some examples include…

机器学习 · 统计学 2018-04-27 Yingzhen Li , Richard E. Turner

We consider the nonparametric estimation of an S-shaped regression function. The least squares estimator provides a very natural, tuning-free approach, but results in a non-convex optimisation problem, since the inflection point is unknown.…

统计方法学 · 统计学 2024-12-17 Oliver Y. Feng , Yining Chen , Qiyang Han , Raymond J. Carroll , Richard J. Samworth

We propose Stein-type estimators for zero-inflated Bell regression models by incorporating information on model parameters. These estimators combine the advantages of unrestricted and restricted estimators. We derive the asymptotic…

统计计算 · 统计学 2024-03-04 Solmaz Seifollahi , Hossein Bevrani , Zakariya Yahya Algamal

Neural estimators are simulation-based estimators for the parameters of a family of statistical models, which build a direct mapping from the sample to the parameter vector. They benefit from the versatility of available network…

机器学习 · 统计学 2025-06-24 Almut Rödder , Manuel Hentschel , Sebastian Engelke

The problem of adaptive multivariate function estimation in the single-index regression model with random design and weak assumptions on the noise is investigated. A novel estimation procedure that adapts simultaneously to the unknown index…

统计理论 · 数学 2014-01-29 Oleg Lepski , Nora Serdyukova

This paper studies a \textit{partial functional partially linear single-index model} that consists of a functional linear component as well as a linear single-index component. This model generalizes many well-known existing models and is…

统计理论 · 数学 2017-03-09 Qingguo Tang , Linglong Kong , David Ruppert , Rohana J. Karunamuni

Despite the risk of misspecification they are tied to, parametric models continue to be used in statistical practice because they are accessible to all. In particular, efficient estimation procedures in parametric models are simple to…

统计理论 · 数学 2016-09-01 Marco Carone , Alexander R. Luedtke , Mark J. van der Laan

We solve the problem of estimating the distribution of presumed i.i.d. observations for the total variation loss. Our approach is based on density models and is versatile enough to cope with many different ones, including some density…

统计理论 · 数学 2024-01-05 Y. Baraud , H. Halconruy , G. Maillard

In the last decades, due to the huge technological growth observed, it has become increasingly common that a collection of temporal data rapidly accumulates in vast amounts. This provides an opportunity for extracting valuable information…

机器学习 · 计算机科学 2023-02-22 Felipe Elorrieta , Lucas Osses , Matias Cáceres , Susana Eyheramendy , Wilfredo Palma

We study the asymptotics for jump-penalized least squares regression aiming at approximating a regression function by piecewise constant functions. Besides conventional consistency and convergence rates of the estimates in $L^2([0,1))$ our…

统计理论 · 数学 2009-03-02 Leif Boysen , Angela Kempe , Volkmar Liebscher , Axel Munk , Olaf Wittich

The semivarying coefficient models are widely used in the application of finance, economics, medical science and many other areas. The functional coefficients are commonly estimated by local smoothing methods, e.g. local linear estimator.…

统计方法学 · 统计学 2020-01-01 Heng Peng , Chuanlong Xie , Jingxin Zhao

In this work, we study a natural nonparametric estimator of the transition probability matrices of a finite controlled Markov chain. We consider an offline setting with a fixed dataset, collected using a so-called logging policy. We develop…

机器学习 · 统计学 2026-03-17 Imon Banerjee , Harsha Honnappa , Vinayak Rao

The spectral risk has wide applications in machine learning, especially in real-world decision-making, where people are not only concerned with models' average performance. By assigning different weights to the losses of different sample…

最优化与控制 · 数学 2024-07-23 Yuze Ge , Rujun Jiang

This paper deals with a nonparametric shape respecting estimation method for U-shaped or unimodal functions. A general upper bound for the nonasymptotic L_1-risk of the estimator is given. The method is applied to the shape respecting…

统计理论 · 数学 2007-06-13 L. Reboul

In this paper, we study the problem of distributed multi-agent optimization over a network, where each agent possesses a local cost function that is smooth and strongly convex. The global objective is to find a common solution that…

最优化与控制 · 数学 2019-08-02 Shi Pu , Angelia Nedić

In this paper, in a multivariate setting we derive near optimal rates of convergence in the minimax sense for estimating partial derivatives of the mean function for functional data observed under a fixed synchronous design over H\"older…

统计理论 · 数学 2025-08-25 Max Berger , Hajo Holzmann

We propose novel smooth approximations to the classical rounding function, suitable for differentiable optimization and machine learning applications. Our constructions are based on two approaches: (1) localized sigmoid window functions…

机器学习 · 计算机科学 2025-04-29 Stanislav Semenov

Distributionally-robust optimization is often studied for a fixed set of distributions rather than time-varying distributions that can drift significantly over time (which is, for instance, the case in finance and sociology due to…

最优化与控制 · 数学 2020-10-01 Iman Shames , Farhad Farokhi