English
Related papers

Related papers: Inference on Functionals under First Order Degener…

200 papers

We consider the problem of binary classification with abstention in the relatively less studied \emph{bounded-rate} setting. We begin by obtaining a characterization of the Bayes optimal classifier for an arbitrary input-label distribution…

Machine Learning · Computer Science 2019-05-24 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi

We address the problem of Bayesian structure learning for domains with hundreds of variables by employing non-parametric bootstrap, recursively. We propose a method that covers both model averaging and model selection in the same framework.…

Machine Learning · Statistics 2018-09-14 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Guy Koren , Gal Novik

We develop a categorical foundation for belief propagation on factor graphs. We construct the free hypergraph category \(\Syn_\Sigma\) on a typed signature and prove its universal property, yielding compositional semantics via a unique…

Artificial Intelligence · Computer Science 2026-01-09 Enrique ter Horst , Sridhar Mahadevan , Juan Diego Zambrano

This paper develops valid bootstrap inference methods for the dynamic short panel threshold regression. We show that the standard nonparametric bootstrap is inconsistent for the first-differenced generalized method of moments (GMM)…

Econometrics · Economics 2025-11-18 Woosik Gong , Myung Hwan Seo

Inference and prediction under the sparsity assumption have been a hot research topic in recent years. However, in practice, the sparsity assumption is difficult to test, and more importantly can usually be violated. In this paper, to study…

Statistics Theory · Mathematics 2022-10-18 Yanmei Shi , Zhiruo Li , Qi Zhang

The partially linear binary choice model can be used for estimating structural equations where nonlinearity may appear due to diminishing marginal returns, different life cycle regimes, or hectic physical phenomena. The inference procedure…

Econometrics · Economics 2023-12-01 Wenzheng Gao , Zhenting Sun

Feature importance (FI) measures are widely used to assess the contributions of predictors to an outcome, but they may target different notions of relevance. When predictors are correlated, traditional statistical FI methods are often…

Machine Learning · Statistics 2026-03-17 Jin-Hong Du , Kathryn Roeder , Larry Wasserman

We study the phase transition of a real scalar phi^4 theory in the two-loop Phi-derivable approximation using the imaginary time formalism, extending our previous (analytical) discussion of the Hartree approximation. We combine Fast Fourier…

High Energy Physics - Phenomenology · Physics 2015-06-05 Gergely Markó , Urko Reinosa , Zsolt Szép

In this work we derive a second-order approach to bilevel optimization, a type of mathematical programming in which the solution to a parameterized optimization problem (the "lower" problem) is itself to be optimized (in the "upper"…

Optimization and Control · Mathematics 2022-05-06 Robert Dyro , Edward Schmerling , Nikos Arechiga , Marco Pavone

The paper proposes a new bootstrap approach to the Pesaran, Shin and Smith's bound tests in a conditional equilibrium correction model with the aim to overcome some typical drawbacks of the latter, such as inconclusive inference and…

Econometrics · Economics 2022-04-12 Stefano Bertelli , Gianmarco Vacca , Maria Grazia Zoia

Standard gradient descent methods yield point estimates with no measure of confidence. This limitation is acute in overparameterized and low-data regimes, where models have many parameters relative to available data and can easily overfit.…

Machine Learning · Computer Science 2025-08-22 Carlos Stein Brito

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

We consider the performance of the bootstrap in high-dimensions for the setting of linear regression, where $p<n$ but $p/n$ is not close to zero. We consider ordinary least-squares as well as robust regression methods and adopt a minimalist…

Methodology · Statistics 2016-08-03 Noureddine El Karoui , Elizabeth Purdom

Functional times series have become an integral part of both functional data and time series analysis. This paper deals with the functional autoregressive model of order 1 and the autoregression bootstrap for smooth functions. The…

Statistics Theory · Mathematics 2018-11-16 Johannes T. N. Krebs , Jürgen E. Franke

We develop non-asymptotically justified methods for hypothesis testing about the $p-$dimensional coefficients $\theta^{*}$ in (possibly nonlinear) regression models. Given a function $h:\,\mathbb{R}^{p}\mapsto\mathbb{R}^{m}$, we consider…

Statistics Theory · Mathematics 2019-07-01 Ying Zhu

We consider the residual-based or naive bootstrap for functional autoregressions of order 1 and prove that it is asymptotically valid for, e.g., the sample mean and for empirical covariance operator estimates. As a crucial auxiliary result,…

Statistics Theory · Mathematics 2019-05-21 Jürgen Franke , Euna Gesare Nyarige

This paper proposes a homogeneous second-order descent framework (HSODF) for nonconvex and convex optimization based on the generalized homogeneous model (GHM). In comparison to the Newton steps, the GHM can be solved by extremal symmetric…

Optimization and Control · Mathematics 2025-05-13 Chang He , Yuntian Jiang , Chuwen Zhang , Dongdong Ge , Bo Jiang , Yinyu Ye

Classical Fisher-information asymptotics describe the covariance of regular efficient estimators through the local quadratic approximation of the log-likelihood, and thus capture first-order geometry only. In curved models, including…

Statistics Theory · Mathematics 2026-04-15 Malik Amir , Sourangshu Ghosh

The correct inferential object in claims reserving is the conditional predictive distribution $p(R \mid \mathcal{D}, \hat\theta)$, where $\mathcal{D}$ is the observed triangle held fixed. We refer to this as the conditioning principle. All…

Methodology · Statistics 2026-05-18 Robin Van Oirbeek , Tim Verdonck

It is known that first-order logic with some counting extensions can be efficiently evaluated on graph classes with bounded expansion, where depth-$r$ minors have constant density. More precisely, the formulas are $\exists x_1 ... x_k \#y…

Logic in Computer Science · Computer Science 2023-07-06 Jan Dreier , Daniel Mock , Peter Rossmanith