English
Related papers

Related papers: Optimal estimators of cross-partial derivatives an…

200 papers

Accurate simulations of the oceans are crucial in understanding the Earth system. Despite their efficiency, simulations at lower resolutions must rely on various uncertain parameterizations to account for unresolved processes. However,…

Within the framework of smoothing spline ANOVA, we propose a plug-in kernel ridge regression estimator to estimate the derivatives of the underlying multivariate regression function. We first establish an $L_\infty$ convergence rate of the…

Methodology · Statistics 2026-03-03 Ruiqi Liu , Kexuan Li , Meng Li

Global optimization of expensive functions has important applications in physical and computer experiments. It is a challenging problem to develop efficient optimization scheme, because each function evaluation can be costly and the…

Machine Learning · Statistics 2020-01-22 Ray-Bing Chen , Yuan Wang , C. F. Jeff Wu

Additive regression models have a long history in multivariate nonparametric regression. They provide a model in which each regression function depends only on a single explanatory variable allowing to obtain estimators at the optimal…

Methodology · Statistics 2015-09-16 Graciela Boente , Alejandra Martinez

We present a framework for automatically structuring and training fast, approximate, deep neural surrogates of stochastic simulators. Unlike traditional approaches to surrogate modeling, our surrogates retain the interpretable structure and…

In this paper, we study the estimation of the derivative of a regression function in a standard univariate regression model. The estimators are defined either by derivating nonparametric least-squares estimators of the regression function…

Statistics Theory · Mathematics 2023-11-13 Fabienne Comte , Nicolas Marie

Surrogate models are used to alleviate the computational burden in engineering tasks, which require the repeated evaluation of computationally demanding models of physical systems, such as the efficient propagation of uncertainties. For…

Machine Learning · Statistics 2022-09-28 Felix Schneider , Iason Papaioannou , Gerhard Müller

Measurement-constrained datasets, often encountered in semi-supervised learning, arise when data labeling is costly, time-intensive, or hindered by confidentiality or ethical concerns, resulting in a scarcity of labeled data. In certain…

Methodology · Statistics 2025-01-15 Yixin Shen , Yang Ning

We study the problem of estimating the derivatives of a regression function, which has a wide range of applications as a key nonparametric functional of unknown functions. Standard analysis may be tailored to specific derivative orders, and…

Machine Learning · Statistics 2023-08-29 Zejian Liu , Meng Li

Metamodeling of complex numerical systems has recently attracted the interest of the mathematical programming community. Despite the progress in high performance computing, simulations remain costly, as a matter of fact, the assessment of…

Other Statistics · Statistics 2018-11-13 Soumaya Azzi , Yuanyuan Huang , Bruno Sudret , Joe Wiart

Estimating function inference is indispensable for many common point process models where the joint intensities are tractable while the likelihood function is not. In this paper we establish asymptotic normality of estimating function…

Statistics Theory · Mathematics 2019-11-18 Frédéric Lavancier , Arnaud Poinas , Rasmus Waagepetersen

The functional linear model is an important extension of the classical regression model allowing for scalar responses to be modeled as functions of stochastic processes. Yet, despite the usefulness and popularity of the functional linear…

Methodology · Statistics 2025-11-27 Ioannis Kalogridis , Stanislav Nagy

In real case applications within the virtual prototyping process, it is not always possible to reduce the complexity of the physical models and to obtain numerical models which can be solved quickly. Usually, every single numerical…

Methodology · Statistics 2024-08-08 Thomas Most , Johannes Will

We consider the problem of estimating an unknown function f* and its partial derivatives from a noisy data set of n observations, where we make no assumptions about f* except that it is smooth in the sense that it has square integrable…

Machine Learning · Statistics 2024-05-17 Eunji Lim

Developing surrogates for computer models has become increasingly important for addressing complex problems in science and engineering. This article introduces an artificial intelligent (AI) surrogate, referred to as the DeepSurrogate, for…

Surrogate endpoints are used in place of long-term outcomes in randomized experiments when observing the real outcome for a large enough cohort is prohibitively expensive or impractical. A short-term surrogate is good if the result of an…

Over the past few years, robotics simulators have largely improved in efficiency and scalability, enabling them to generate years of simulated data in a few hours. Yet, efficiently and accurately computing the simulation derivatives remains…

Robotics · Computer Science 2025-05-21 Quentin Le Lidec , Louis Montaut , Yann de Mont-Marin , Fabian Schramm , Justin Carpentier

We consider the problem of deriving from experimental data an approximation of an unknown function, whose derivatives also approximate the unknown function derivatives. Solving this problem is useful, for instance, in the context of…

Systems and Control · Electrical Eng. & Systems 2019-11-11 Carlo Novara , Angelo Nicolì , Giuseppe C. Calafiore

This paper aims to understand whether machine learning models should be trained using cost-sensitive surrogates or cost-agnostic ones (e.g., cross-entropy). Analyzing this question through the lens of $\mathcal{H}$-calibration, we find that…

Machine Learning · Computer Science 2025-02-28 Sanket Shah , Milind Tambe , Jessie Finocchiaro

We develop a general approach to estimating the derivative of a function-valued parameter $\theta_o(u)$ that is identified for every value of $u$ as the solution to a moment condition. This setup in particular covers many interesting models…

Methodology · Statistics 2016-10-31 Christoph Rothe , Dominik Wied