English
Related papers

Related papers: The adaptive Wynn-algorithm in generalized linear …

200 papers

This article deals with adaptive nonparametric estimation for L\'evy processes observed at low frequency. For general linear functionals of the L\'evy measure, we construct kernel estimators, provide upper risk bounds and derive rates of…

Statistics Theory · Mathematics 2014-07-15 Johanna Kappus

Adaptivity is an important feature of data analysis---the choice of questions to ask about a dataset often depends on previous interactions with the same dataset. However, statistical validity is typically studied in a nonadaptive model,…

Machine Learning · Computer Science 2015-11-10 Raef Bassily , Kobbi Nissim , Adam Smith , Thomas Steinke , Uri Stemmer , Jonathan Ullman

In this paper we extend the results of Radloff and Schwabe (2018), which could be applied for example to Poisson regression, negative binomial regression and proportional hazard models with censoring, to a wider class of non-linear multiple…

Methodology · Statistics 2021-04-07 Martin Radloff , Rainer Schwabe

In this article we study the asymptotic predictive optimality of a model selection criterion based on the cross-validatory predictive density, already available in the literature. For a dependent variable and associated explanatory…

Statistics Theory · Mathematics 2008-12-18 Arijit Chakrabarti , Tapas Samanta

The expressiveness of neural networks highly depends on the nature of the activation function, although these are usually assumed predefined and fixed during the training stage. Under a signal processing perspective, in this paper we…

Signal Processing · Electrical Eng. & Systems 2024-05-28 Marc Martinez-Gost , Ana Pérez-Neira , Miguel Ángel Lagunas

Cumulative link models have been widely used for ordered categorical responses. Uniform allocation of experimental units is commonly used in practice, but often suffers from a lack of efficiency. We consider D-optimal designs with ordered…

Statistics Theory · Mathematics 2017-11-09 Jie Yang , Liping Tong , Abhyuday Mandal

Despite remarkable improvements in speed and accuracy, convolutional neural networks (CNNs) still typically operate as monolithic entities at inference time. This poses a challenge for resource-constrained practical applications, where both…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Thanh Vu , Marc Eder , True Price , Jan-Michael Frahm

The choices of hyperparameters have critical effects on the performance of machine learning models. In this paper, we present a general framework that is able to construct an adaptive optimizer, which automatically adjust the appropriate…

Machine Learning · Computer Science 2022-01-31 Huayuan Sun

The local regularity of functional time series is studied under $L^p-m-$appro\-ximability assumptions. The sample paths are observed with error at possibly random design points. Non-asymptotic concentration bounds of the regularity…

Statistics Theory · Mathematics 2024-03-21 Hassan Maissoro , Valentin Patilea , Myriam Vimond

Designing efficient experiments under practical constraints is critical in both scientific research and industrial practice. Focusing on minimizing the average variance of the parameter estimates, A-optimal designs show advantages in…

Methodology · Statistics 2026-03-20 Yingying Yang , Xiaotian Chen , Jie Yang

General regression and classification models are constructed as linear combinations of simple rules derived from the data. Each rule consists of a conjunction of a small number of simple statements concerning the values of individual input…

Applications · Statistics 2008-11-12 Jerome H. Friedman , Bogdan E. Popescu

We propose an adaptive sampling method for the training of Physics Informed Neural Networks (PINNs) which allows for sampling based on an arbitrary problem-specific heuristic which may depend on the network and its gradients. In particular…

Numerical Analysis · Mathematics 2026-04-08 Kevin Buck , Woojeong Kim

Datasets are often reused to perform multiple statistical analyses in an adaptive way, in which each analysis may depend on the outcomes of previous analyses on the same dataset. Standard statistical guarantees do not account for these…

Machine Learning · Computer Science 2017-06-19 Vitaly Feldman , Thomas Steinke

A design-based individual prediction approach is developed based on the expected cross-validation results, given the sampling design and the sample-splitting design for cross-validation. Whether the predictor is selected from an ensemble of…

Machine Learning · Statistics 2023-01-24 Li-Chun Zhang , Danhyang Lee

We study adaptive estimation and inference in ill-posed linear inverse problems defined by conditional moment restrictions. Existing regularized estimators such as Regularized DeepIV (RDIV) require prior knowledge of the smoothness of the…

Machine Learning · Statistics 2026-03-03 Jiyuan Tan , Vasilis Syrgkanis

Latent variable models have been widely applied in different fields of research in which the constructs of interest are not directly observable, so that one or more latent variables are required to reduce the complexity of the data. In…

Statistics Theory · Mathematics 2014-07-07 Silvia Bianconcini

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

The Na\"ive Mean Field (NMF) approximation is widely employed in modern Machine Learning due to the huge computational gains it bestows on the statistician. Despite its popularity in practice, theoretical guarantees for high-dimensional…

Statistics Theory · Mathematics 2023-10-17 Jiaze Qiu

In this paper we develop the James - Stein improved estimation method for a nonparametric periodic function observed with the Levy noises in continuous time. An adaptive model selection procedure based on the improved weighted least square…

Statistics Theory · Mathematics 2019-09-17 Evgeny Pchelintsev , Valerii Pchelintsev , Serguei Pergamenshchikov

This work considers the trade-off between accuracy and test-time computational cost of deep neural networks (DNNs) via \emph{anytime} predictions from auxiliary predictions. Specifically, we optimize auxiliary losses jointly in an…

Machine Learning · Computer Science 2018-05-28 Hanzhang Hu , Debadeepta Dey , Martial Hebert , J. Andrew Bagnell