English
Related papers

Related papers: A Simple Engineering Technique to Estimate the Fir…

200 papers

In this paper, we study the estimation of the derivative of a regression function in a standard univariate regression model. The estimators are defined either by derivating nonparametric least-squares estimators of the regression function…

Statistics Theory · Mathematics 2023-11-13 Fabienne Comte , Nicolas Marie

Despite the risk of misspecification they are tied to, parametric models continue to be used in statistical practice because they are accessible to all. In particular, efficient estimation procedures in parametric models are simple to…

Statistics Theory · Mathematics 2016-09-01 Marco Carone , Alexander R. Luedtke , Mark J. van der Laan

Functional data are typically modeled as sample paths of smooth stochastic processes in order to mitigate the fact that they are often observed discretely and noisily, occasionally irregularly and sparsely. The smoothness assumption is…

Methodology · Statistics 2021-12-23 Neda Mohammadi , Victor M. Panaretos

The functional linear model is an important extension of the classical regression model allowing for scalar responses to be modeled as functions of stochastic processes. Yet, despite the usefulness and popularity of the functional linear…

Methodology · Statistics 2025-11-27 Ioannis Kalogridis , Stanislav Nagy

Computational methods for fractional differential equations exhibit essential instability. Even a minor modification of the coefficients or other entry data may switch good results to the divergent. The goal of this paper is to suggest the…

Numerical Analysis · Mathematics 2021-12-20 P. B. Dubovski , J. A. Slepoi

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

Existing approaches for derivative estimation are restricted to univariate functional data. We propose two methods to estimate the principal components and scores for the derivatives of multivariate functional data. As a result, the…

Methodology · Statistics 2024-11-28 Yueyun Zhu , Steven Golovkine , Norma Bargary , Andrew J. Simpkin

Mathematical modeling of many physical processes such as diffusion, viscosity of fluids and combustion involves differential equations with small coefficients of higher derivatives. These may be small diffusion coefficients for modeling the…

Numerical Analysis · Mathematics 2010-02-16 Liudmila Rozanova

We study the problem of parameter estimation for a univariate discretely observed ergodic diffusion process given as a solution to a stochastic differential equation. The estimation procedure we propose consists of two steps. In the first…

Statistics Theory · Mathematics 2018-04-17 Shota Gugushvili , Peter Spreij

We propose an estimation procedure for linear functionals based on Gaussian model selection techniques. We show that the procedure is adaptive, and we give a non asymptotic oracle inequality for the risk of the selected estimator with…

Statistics Theory · Mathematics 2008-10-27 Béatrice Laurent , Carenne Ludeña , Clémentine Prieur

The numerical simulation of complex physical processes requires the use of economical discrete models. This lecture presents a general paradigm of deriving a posteriori error estimates for the Galerkin finite element approximation of…

Numerical Analysis · Mathematics 2025-10-20 Rolf Rannacher

We address numerical differentiation under coarse, non-uniform sampling and Gaussian noise. A maximum-likelihood estimator with $L_2$-norm constraint on a higher-order derivative is obtained, yielding spline-based solution. We introduce a…

Methodology · Statistics 2025-07-31 Konstantin E. Avrachenkov , Leonid B. Freidovich

Many practical problems are related to the pointwise estimation of dis- tribution functions when data contains measurement errors. Motivation for these problems comes from diverse fields such as astronomy, reliability, quality control,…

Methodology · Statistics 2012-02-21 I. Dattner , B. Reiser

Dynamic factor models are often estimated by point-estimation methods, disregarding parameter uncertainty. We propose a method accounting for parameter uncertainty by means of posterior approximation, using variational inference. Our…

Methodology · Statistics 2022-10-14 Erik Spånberg

Computational modeling of the manufacturing process of Lithium-Ion Battery (LIB) composite electrodes based on mechanistic approaches, allows predicting the influence of manufacturing parameters on electrode properties. However, ensuring…

We aim at computing the derivative of the solution to a parametric optimization problem with respect to the involved parameters. For a class broader than that of strongly convex functions, this can be achieved by automatic differentiation…

Optimization and Control · Mathematics 2019-10-15 Sheheryar Mehmood , Peter Ochs

A default assumption in many machine learning scenarios is that the training and test samples are drawn from the same probability distribution. However, such an assumption is often violated in the real world due to non-stationarity of the…

Machine Learning · Computer Science 2021-05-04 Tianyi Zhang , Ikko Yamane , Nan Lu , Masashi Sugiyama

In this paper, we analyze several methods for approximating gradients of noisy functions using only function values. These methods include finite differences, linear interpolation, Gaussian smoothing and smoothing on a sphere. The methods…

Optimization and Control · Mathematics 2021-03-29 Albert S. Berahas , Liyuan Cao , Krzysztof Choromanski , Katya Scheinberg

There are many functions which are continuous everywhere but not differentiable at some points, like in physical systems of ECG, EEG plots, and cracks pattern and for several other phenomena. Using classical calculus those functions cannot…

Classical Analysis and ODEs · Mathematics 2015-05-26 Uttam Ghosh , Srijan Sengupta , Susmita Sarkar , Shantanu Das

A study is conducted to evaluate four derivative estimation methods when solving a large sparse nonlinear programming problem that arises from the approximation of an optimal control problem using a direct collocation method. In particular,…

Optimization and Control · Mathematics 2020-05-29 Yunus M. Agamawi , Anil V. Rao