English
Related papers

Related papers: Bias Correction in Factor-Augmented Regression Mod…

200 papers

We propose modeling raw functional data as a mixture of a smooth function and a highdimensional factor component. The conventional approach to retrieving the smooth function from the raw data is through various smoothing techniques.…

Methodology · Statistics 2021-02-05 Yuan Gao , Han Lin Shang , Yanrong Yang

This paper provides a statistical analysis of high-dimensional batch Reinforcement Learning (RL) using sparse linear function approximation. When there is a large number of candidate features, our result sheds light on the fact that…

Machine Learning · Computer Science 2020-11-10 Botao Hao , Yaqi Duan , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

The factor modeling for high-dimensional time series is powerful in discovering latent common components for dimension reduction and information extraction. Most available estimation methods can be divided into two categories: the…

Methodology · Statistics 2026-05-26 Xinghao Qiao , Zihan Wang , Qiwei Yao , Bo Zhang

Amortized inference allows latent-variable models trained via variational learning to scale to large datasets. The quality of approximate inference is determined by two factors: a) the capacity of the variational distribution to match the…

Machine Learning · Computer Science 2018-05-29 Chris Cremer , Xuechen Li , David Duvenaud

Large catalogs of shear-selected peaks have recently become a reality. In order to properly interpret the abundance and properties of these peaks, it is necessary to take into account the effects of the clustering of source galaxies, among…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-19 Fabian Schmidt , Eduardo Rozo

Micro-batch clipping, a gradient clipping method, has recently shown potential in enhancing auto-speech recognition (ASR) model performance. However, the underlying mechanism behind this improvement remains mysterious, particularly the…

Machine Learning · Computer Science 2024-08-30 Lun Wang

The estimation of the extremal dependence structure is spoiled by the impact of the bias, which increases with the number of observations used for the estimation. Already known in the univariate setting, the bias correction procedure is…

Statistics Theory · Mathematics 2015-04-03 Anne-Laure Fougères , Laurens de Haan , Cécile Mercadier

In a quantum-noise limited system, weak-value amplification using post-selection normally does not produce more sensitive measurements than standard methods for ideal detectors: the increased weak value is compensated by the reduced power…

Quantum Physics · Physics 2021-06-09 Courtney Krafczyk , Andrew N. Jordan , Michael E. Goggin , Paul G. Kwiat

In this work, we consider the problem of imbalanced data in a regression framework when the imbalanced phenomenon concerns continuous or discrete covariates. Such a situation can lead to biases in the estimates. In this case, we propose a…

Machine Learning · Statistics 2023-02-21 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

Quantile regression is a tool for learning conditional distributions. In this paper we study quantile regression in the setting where a protected attribute is unavailable when fitting the model. This can lead to "unfair'' quantile…

Statistics Theory · Mathematics 2019-07-23 Dana Yang , John Lafferty , David Pollard

In practice functional data are sampled on a discrete set of observation points and often susceptible to noise. We consider in this paper the setting where such data are used as explanatory variables in a regression problem. If the primary…

Methodology · Statistics 2021-12-14 Siegfried Hörmann , Fatima Jammoul

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

We consider the estimation of approximate factor models for time series data, where strong serial and cross-sectional correlations amongst the idiosyncratic component are present. This setting comes up naturally in many applications, but…

Methodology · Statistics 2019-12-10 Jiahe Lin , George Michailidis

Regression adjustment is broadly applied in randomized trials under the premise that it usually improves the precision of a treatment effect estimator. However, previous work has shown that this is not always true. To further understand…

Methodology · Statistics 2022-10-11 Katarzyna Reluga , Ting Ye , Qingyuan Zhao

Many economic models feature moment conditions that involve latent variables. When the latent variables are individual fixed effects in an auxiliary panel data regression, we construct orthogonal moments that eliminate first-order bias…

Econometrics · Economics 2026-02-10 Jiaqi Huang

Advantage Learning (AL) seeks to increase the action gap between the optimal action and its competitors, so as to improve the robustness to estimation errors. However, the method becomes problematic when the optimal action induced by the…

Machine Learning · Computer Science 2022-03-23 Zhe Zhang , Yaozhong Gan , Xiaoyang Tan

We develop asymptotic theory for principal component analysis (PCA) of a high-dimensional factor model in which the working dimension $R$ is fixed and only required to satisfy $R \ge r$, where $r$ is the true number of factors. Building on…

Statistics Theory · Mathematics 2026-05-19 Yuan Liao , Xin Tong , Wanjie Wang , Dacheng Xiu

Regression models, in which the observed features $X \in \R^p$ and the response $Y \in \R$ depend, jointly, on a lower dimensional, unobserved, latent vector $Z \in \R^K$, with $K< p$, are popular in a large array of applications, and…

Methodology · Statistics 2021-03-04 Xin Bing , Florentina Bunea , Marten Wegkamp

The widespread use of machine learning and data-driven algorithms for decision making has been steadily increasing over many years. \emph{Bias} in the data can adversely affect this decision-making. We present a new mitigation strategy to…

Machine Learning · Computer Science 2025-07-25 Bruno Scarone , Alfredo Viola , Renée J. Miller , Ricardo Baeza-Yates

Recent approaches based on metric learning have achieved great progress in few-shot learning. However, most of them are limited to image-level representation manners, which fail to properly deal with the intra-class variations and spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Chao Dong , Qi Ye , Wenchao Meng , Kaixiang Yang