English
Related papers

Related papers: Asymptotic Theory and Phase Transitions for Variab…

200 papers

One advantage of decision tree based methods like random forests is their ability to natively handle categorical predictors without having to first transform them (e.g., by using feature engineering techniques). However, in this paper, we…

Machine Learning · Statistics 2018-10-30 Timothy C. Au

Estimating a causal effect from observational data can be biased if we do not control for self-selection. This selection is based on confounding variables that affect the treatment assignment and the outcome. Propensity score methods aim to…

Econometrics · Economics 2021-09-10 Daniel Jacob

Random Forest is a machine learning method that offers many advantages, including the ability to easily measure variable importance. Class balancing technique is a well-known solution to deal with class imbalance problem. However, it has…

Machine Learning · Statistics 2023-12-19 Yunbi Nam , Sunwoo Han

We study parametric inference for diffusion processes when observations occur nonsynchronously and are contaminated by market microstructure noise. We construct a quasi-likelihood function and study asymptotic mixed normality of…

Statistics Theory · Mathematics 2015-12-29 Teppei Ogihara

This work develops formal statistical inference procedures for machine learning ensemble methods. Ensemble methods based on bootstrapping, such as bagging and random forests, have improved the predictive accuracy of individual trees, but…

Machine Learning · Statistics 2015-09-11 Lucas Mentch , Giles Hooker

We reconsider the random bond antiferromagnetic spin-1/2 chain for weak disorder and demonstrate the existence of crossover length scale x_W that diverges with decreasing strength of the disorder. Recent DMRG calculations [Phys. Rev. Lett.…

Disordered Systems and Neural Networks · Physics 2009-11-07 N. Laflorencie , H. Rieger

Interpretability and uncertainty quantification in machine learning can provide justification for decisions, promote scientific discovery and lead to a better understanding of model behavior. Symbolic regression provides inherently…

Neural and Evolutionary Computing · Computer Science 2022-11-23 G. F. Bomarito , P. E. Leser , N. C. M Strauss , K. M. Garbrecht , J. D. Hochhalter

We study theoretical limits of \emph{descending} phase retrieval algorithms. Utilizing \emph{Random duality theory} (RDT) we develop a generic program that allows statistical characterization of various algorithmic performance metrics.…

Machine Learning · Statistics 2025-06-24 Mihailo Stojnic

We study maximum-likelihood-type estimation for diffusion processes when the coefficients are nonrandom and observation occurs in nonsynchronous manner. The problem of nonsynchronous observations is important when we consider the analysis…

Statistics Theory · Mathematics 2022-07-04 Teppei Ogihara

When a strict subset of covariates are given, we propose conditional quantile treatment effect to capture the heterogeneity of treatment effects via the quantile sheet that is the function of the given covariates and quantile. We focus on…

Statistics Theory · Mathematics 2020-09-23 Niwen Zhou , Xu Guo , Lixing Zhu

We introduce operational quantum tasks based on betting with risk-aversion -- or quantum betting tasks for short -- inspired by standard quantum state discrimination and classical horse betting with risk-aversion and side information. In…

Quantum Physics · Physics 2023-06-05 Andres F. Ducuara , Paul Skrzypczyk

A nonparametric method is proposed for estimating the quantile spectra and cross-spectra introduced in Li (2012; 2014) as bivariate functions of frequency and quantile level. The method is based on the quantile discrete Fourier transform…

Methodology · Statistics 2026-03-26 Ta-Hsin Li

A significant obstacle in the development of robust machine learning models is covariate shift, a form of distribution shift that occurs when the input distributions of the training and test sets differ while the conditional label…

Machine Learning · Statistics 2021-11-17 Nilesh Tripuraneni , Ben Adlam , Jeffrey Pennington

Many classification tasks involve imbalanced data, in which a class is largely underrepresented. Several techniques consists in creating a rebalanced dataset on which a classifier is trained. In this paper, we study theoretically such a…

Machine Learning · Statistics 2025-06-11 Moria Mayala , Erwan Scornet , Charles Tillier , Olivier Wintenberger

Causal random forests provide efficient estimates of heterogeneous treatment effects. However, forest algorithms are also well-known for their black-box nature, and therefore, do not characterize how input variables are involved in…

Machine Learning · Statistics 2023-08-08 Clément Bénard , Julie Josse

Random forest is a popular prediction approach for handling high dimensional covariates. However, it often becomes infeasible to interpret the obtained high dimensional and non-parametric model. Aiming for obtaining an interpretable…

Methodology · Statistics 2020-05-12 Jasper Velthoen , Juan-Juan Cai , Geurt Jongbloed

The quantum Fisher information (QFI), as a function of quantum states, measures the amount of information that a quantum state carries about an unknown parameter. The (entanglement-assisted) QFI of a quantum channel is defined to be the…

Quantum Physics · Physics 2021-04-06 Sisi Zhou , Liang Jiang

Traditional parametric econometric models often rely on rigid functional forms, while nonparametric techniques, despite their flexibility, frequently lack interpretability. This paper proposes a parsimonious alternative by modeling the…

Methodology · Statistics 2025-02-20 Ricardo Masini , Marcelo Medeiros

This paper studies inference in two-stage randomized experiments under covariate-adaptive randomization. In the initial stage of this experimental design, clusters (e.g., households, schools, or graph partitions) are stratified and randomly…

Econometrics · Economics 2026-01-16 Jizhou Liu

Quantifying the usefulness of individual features in random forests learning can greatly enhance its interpretability. Existing studies have shown that some popularly used feature importance measures for random forests suffer from the bias…

Machine Learning · Statistics 2023-11-14 Chien-Ming Chi , Yingying Fan , Jinchi Lv