English
Related papers

Related papers: Efficiency of Z-estimators indexed by the objectiv…

200 papers

Statistical inference, a central tool of science, revolves around the study and the usage of statistical estimators: functions that map finite samples to predictions about unknown distribution parameters. In the frequentist framework,…

Machine Learning · Computer Science 2025-12-15 Maxime Peyrard , Kyunghyun Cho

The primary objective in this paper is to give an answer to an open question posed by J. A. Barcel\'o, J. M. Bennett, A. Carbery, A. Ruiz and M. C. Vilela concerning the problem of determining the optimal range on $s\geq0$ and $p\geq1$ for…

Analysis of PDEs · Mathematics 2019-07-24 Youngwoo Koh , Ihyeok Seo

Active Test-Time Adaptation (ATTA) improves model robustness under domain shift by selectively querying human annotations at deployment, but existing methods use heuristic uncertainty measures and suffer from low data selection efficiency,…

Machine Learning · Computer Science 2025-10-01 Tingyu Shi , Fan Lyu , Shaoliang Peng

In the framework of an abstract statistical model we discuss how to use the solution of one estimation problem ({\it Problem A}) in order to construct an estimator in another, completely different, {\it Problem B}. As a solution of {\it…

Statistics Theory · Mathematics 2016-03-15 Oleg Lepski

Deep learning has achieved notable success in various fields, including image and speech recognition. One of the factors in the successful performance of deep learning is its high feature extraction ability. In this study, we focus on the…

Machine Learning · Statistics 2021-04-01 Kazuma Tsuji , Taiji Suzuki

We investigate an algorithm named histogram transform ensembles (HTE) density estimator whose effectiveness is supported by both solid theoretical analysis and significant experimental performance. On the theoretical side, by decomposing…

Statistics Theory · Mathematics 2019-11-27 Hanyuan Hang

We present an elementary mathematical method to find the minimax estimator of the Bernoulli proportion $\theta$ under the squared error loss when $\theta$ belongs to the restricted parameter space of the form $\Omega = [0, \eta]$ for some…

Statistics Theory · Mathematics 2021-11-30 Heejune Sheen , Yajun Mei

This study develops a higher-order asymptotic framework for test-time adaptation (TTA) of Batch Normalization (BN) statistics under distribution shift by integrating classical Edgeworth expansion and saddlepoint approximation techniques…

Machine Learning · Statistics 2025-05-23 Masanari Kimura

Motivated by a probabilistic analysis of a simple game (itself inspired by a problem in computational learning theory) we introduce the \emph{moment zeta function} of a probability distribution, and study in depth some asymptotic properties…

Number Theory · Mathematics 2007-05-23 Igor Rivin

Regression models, in which the observed features $X \in \R^p$ and the response $Y \in \R$ depend, jointly, on a lower dimensional, unobserved, latent vector $Z \in \R^K$, with $K< p$, are popular in a large array of applications, and…

Methodology · Statistics 2021-03-04 Xin Bing , Florentina Bunea , Marten Wegkamp

We consider the recursive estimation of a regression functional where the explanatory variables take values in some functional space. We prove the almost sure convergence of such estimates for dependent functional data. Also we derive the…

Statistics Theory · Mathematics 2013-04-19 Aboubacar Amiri , Baba Thiam

We consider a class of inverse problems defined by a nonlinear map from parameter or model functions to the data. We assume that solutions exist. The space of model functions is a Banach space which is smooth and uniformly convex; however,…

Functional Analysis · Mathematics 2015-05-30 Maarten V. de Hoop , Lingyun Qiu , Otmar Scherzer

The optimal learning rate for adaptive gradient methods applied to {\lambda}-strongly convex functions relies on the parameters {\lambda} and learning rate {\eta}. In this paper, we adapt a universal algorithm along the lines of Metagrad,…

Machine Learning · Computer Science 2023-07-18 Deepak Gouda , Hassan Naveed , Salil Kamath

Using analytic torsion associated to stable bundles, we introduce zeta functions for compact Riemann surfaces. To justify the well-definedness, we analyze the degenerations of analytic torsions at the boundaries of the moduli spaces, the…

Algebraic Geometry · Mathematics 2012-09-21 Lin Weng

We study the distribution of hard-, soft-, and adaptive soft-thresholding estimators within a linear regression model where the number of parameters k can depend on sample size n and may diverge with n. In addition to the case of known…

Statistics Theory · Mathematics 2012-01-04 Benedikt M. Pötscher , Ulrike Schneider

Human Activity Recognition (HAR) models often suffer from performance degradation in real-world applications due to distribution shifts in activity patterns across individuals. Test-Time Adaptation (TTA) is an emerging learning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Shuoyuan Wang , Jindong Wang , HuaJun Xi , Bob Zhang , Lei Zhang , Hongxin Wei

We consider Tikhonov-type variational regularization of ill-posed linear operator equations in Banach spaces with general convex penalty functionals. Upper bounds for certain error measures expressing the distance between exact and…

Numerical Analysis · Mathematics 2017-12-06 Jens Flemming

Given a large number of covariates $Z$, we consider the estimation of a high-dimensional parameter $\theta$ in an individualized linear threshold $\theta^T Z$ for a continuous variable $X$, which minimizes the disagreement between…

Statistics Theory · Mathematics 2019-05-28 Huijie Feng , Yang Ning , Jiwei Zhao

We obtain order estimates of approximation of classes $B^{\Omega}_{p,\theta}$ of periodic functions of many variables in the space $L_q$ by using operators of orthogonal projection as well as linear operators subjected to some conditions.

Functional Analysis · Mathematics 2012-12-04 A. F. Konogray

In the regression model with errors in variables, we observe $n$ i.i.d. copies of $(Y,Z)$ satisfying $Y=f_{\theta^0}(X)+\xi$ and $Z=X+\epsilon$ involving independent and unobserved random variables $X,\xi,\epsilon$ plus a regression…

Statistics Theory · Mathematics 2009-09-29 Cristina Butucea , Marie-Luce Taupin