English
Related papers

Related papers: Oracle inequalities for square root analysis estim…

200 papers

We study methods for aggregating pairwise comparison data in order to estimate outcome probabilities for future comparisons among a collection of n items. Working within a flexible framework that imposes only a form of strong stochastic…

Machine Learning · Computer Science 2016-03-23 Nihar B. Shah , Sivaraman Balakrishnan , Martin J. Wainwright

We point out some pitfalls related to the concept of an oracle property as used in Fan and Li (2001, 2002, 2004) which are reminiscent of the well-known pitfalls related to Hodges' estimator. The oracle property is often a consequence of…

Statistics Theory · Mathematics 2007-11-08 Hannes Leeb , Benedikt M. Poetscher

Variational inequalities are a universal optimization paradigm that is interesting in itself, but also incorporates classical minimization and saddle point problems. Modern realities encourage to consider stochastic formulations of…

Optimization and Control · Mathematics 2024-03-27 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Alexander Gasnikov

In this paper, we consider smooth convex optimization problems with simple constraints and inexactness in the oracle information such as value, partial or directional derivatives of the objective function. We introduce a unifying framework,…

Optimization and Control · Mathematics 2020-12-17 Pavel Dvurechensky , Alexander Gasnikov , Alexander Tiurin , Vladimir Zholobov

Assume one observes independent categorical variables or, equivalently, one observes the corresponding multinomial variables. Estimating the distribution of the observed sequence amounts to estimating the expectation of the multinomial…

Statistics Theory · Mathematics 2009-06-15 C. Durot , E. Lebarbier , A. -S. Tocquet

We construct data structures for extremal and pairwise distances in directed graphs in the presence of transient edge failures. Henzinger et al. [ITCS 2017] initiated the study of fault-tolerant (sensitivity) oracles for the diameter and…

Data Structures and Algorithms · Computer Science 2022-04-25 Davide Bilò , Keerti Choudhary , Sarel Cohen , Tobias Friedrich , Martin Schirneck

In this paper, we construct an estimator of an errors-in-variables linear regression model. The regression model leads to a constrained total least squares problems with row and column constraints. Although this problem can be numerically…

Numerical Analysis · Mathematics 2026-02-11 Kensuke Aishima

We develop a theoretical framework for the analysis of oblique decision trees, where the splits at each decision node occur at linear combinations of the covariates (as opposed to conventional tree constructions that force axis-aligned…

Statistics Theory · Mathematics 2023-09-01 Matias D. Cattaneo , Rajita Chandak , Jason M. Klusowski

We establish some properties of \'etoiles and associated valuations over complex analytic spaces, showing that Abhyankar's inequality holds. We give some examples of pathological behavior of these valuations. We prove a regularization…

Algebraic Geometry · Mathematics 2016-12-05 Steven Dale Cutkosky

Explainability and fairness have mainly been considered separately, with recent exceptions trying the explain the sources of unfairness. This paper shows that the Shapley value can be used to both define and explain unfairness, under…

Machine Learning · Computer Science 2026-03-31 Fadoua Amri-Jouidel , Emmanuel Kemel , Stéphane Mussard

High-dimensional data analysis has motivated a spectrum of regularization methods for variable selection and sparse modeling, with two popular classes of convex ones and concave ones. A long debate has been on whether one class dominates…

Methodology · Statistics 2016-05-12 Yingying Fan , Jinchi Lv

The Average Oracle, a simple and very fast covariance filtering method, is shown to yield superior Sharpe ratios than the current state-of-the-art (and complex) methods, Dynamic Conditional Covariance coupled to Non-Linear Shrinkage…

Statistical Finance · Quantitative Finance 2023-10-02 Christian Bongiorno , Damien Challet

The explicit regularization and optimality of deep neural networks estimators from independent data have made considerable progress recently. The study of such properties on dependent data is still a challenge. In this paper, we carry out…

Machine Learning · Statistics 2025-07-09 William Kengne , Modou Wade

We estimate numerically the regularities of a family of Strange Non--Chaotic Attractors related with one of the models studied in C. Grebogy et al. (1984) (see also G. Keller (1996)). To estimate these regularities we use wavelet analysis…

Dynamical Systems · Mathematics 2016-04-28 Lluís Alsedà , Josep Maria Mondelo , David Romero i Sànchez

In two landmark papers, Akaike introduced the AIC and FPE, demonstrating their significant usefulness for prediction. In subsequent seminal works, Shibata developed a notion of asymptotic efficiency and showed that both AIC and FPE are…

Statistics Theory · Mathematics 2024-06-21 Moritz Jirak , Georg Köstenberger

In this note, we make some observations about the equivalences between regularized estimating equations, fixed-point problems and variational inequalities. A summary of our findings is given below: (a) A regularized estimating equation is…

Methodology · Statistics 2021-11-03 Yi Yang , Yuwen Gu , Yue Zhao , Jun Fan

This paper focuses on exploring the sparsity of the inverse covariance matrix $\bSigma^{-1}$, or the precision matrix. We form blocks of parameters based on each off-diagonal band of the Cholesky factor from its modified Cholesky…

Methodology · Statistics 2008-05-27 Clifford Lam

Generalized linear models are flexible tools for the analysis of diverse datasets, but the classical formulation requires that the parametric component is correctly specified and the data contain no atypical observations. To address these…

Methodology · Statistics 2023-04-21 Ioannis Kalogridis , Gerda Claeskens , Stefan Van Aelst

Spectral singularities at non-zero frequencies play an important role in investigating cyclic or seasonal time series. The publication [2] introduced the generalized filtered method-of-moments approach to simultaneously estimate singularity…

Statistics Theory · Mathematics 2020-11-13 Antoine Ayache , Myriam Fradon , Ravindi Nanayakkara , Andriy Olenko

We provide new general kernel selection rules thanks to penalized least-squares criteria. We derive optimal oracle inequalities using adequate concentration tools. We also investigate the problem of minimal penalty as described in [BM07].

Statistics Theory · Mathematics 2015-11-09 M Lerasle , N Magalhães , P Reynaud-Bouret