English
Related papers

Related papers: Inference for Forecasting Accuracy: Pooled versus …

200 papers

Background: In the context of ongoing debate over data confidentiality versus shared use of research data, as raised following the new EU General Data Protection Regulation, we seek to find alternate techniques that can balance these two…

Applications · Statistics 2016-06-20 Paramita Saha-Chaudhuri , Clarice Weinberg

Large-scale datasets are increasingly being used to inform decision making. While this effort aims to ground policy in real-world evidence, challenges have arisen as selection bias and other forms of distribution shifts often plague…

Methodology · Statistics 2023-11-07 Santiago Cortes-Gomez , Mateo Dulce , Carlos Patino , Bryan Wilder

In clinical settings, we often face the challenge of building prediction models based on small observational data sets. For example, such a data set might be from a medical center in a multi-center study. Differences between centers might…

It is not unusual for a data analyst to encounter data sets distributed across several computers. This can happen for reasons such as privacy concerns, efficiency of likelihood evaluations, or just the sheer size of the whole data set. This…

Computation · Statistics 2018-05-22 Randy C. S. Lai , J. Hannig , Thomas C. M. Lee

This paper formulates a penalized empirical likelihood (PEL) method for inference on the population mean when the dimension of the observations may grow faster than the sample size. Asymptotic distributions of the PEL ratio statistic is…

Statistics Theory · Mathematics 2013-02-28 Soumendra N. Lahiri , Subhodeep Mukhopadhyay

The lack of interpretability and transparency are preventing economists from using advanced tools like neural networks in their empirical research. In this paper, we propose a class of interpretable neural network models that can achieve…

Econometrics · Economics 2020-12-01 Yucheng Yang , Zhong Zheng , Weinan E

In high-stakes domains like healthcare, users often expect that sharing personal information with machine learning systems will yield tangible benefits, such as more accurate diagnoses and clearer explanations of contributing factors.…

Machine Learning · Computer Science 2026-03-18 Louisa Cornelis , Guillermo Bernárdez , Haewon Jeong , Nina Miolane

In this paper, a novel method to perform model-based clustering of time series is proposed. The procedure relies on two iterative steps: (i) K global forecasting models are fitted via pooling by considering the series pertaining to each…

Machine Learning · Statistics 2023-05-02 Ángel López Oriona , Pablo Montero Manso , José Antonio Vilar Fernández

Fixed effect estimators of nonlinear panel data models suffer from the incidental parameter problem. This leads to two undesirable consequences in applied research: (1) point estimates are subject to large biases, and (2) confidence…

Econometrics · Economics 2022-04-18 Shuowen Chen

We consider the problem of uncertainty quantification for prediction in a time series: if we use past data to forecast the next time point, can we provide valid prediction intervals around our forecasts? To avoid placing distributional…

Machine Learning · Statistics 2026-01-13 Rina Foygel Barber , Ashwin Pananjady

We present novel methods for predicting the outcome of large elections. Our first algorithm uses a diffusion process to model the time uncertainty inherent in polls taken with substantial calendar time left to the election. Our second model…

Applications · Statistics 2017-04-25 Dhruv Madeka

We develop new econometric methods for estimation and inference in high-dimensional panel data models with interactive fixed effects. Our approach can be regarded as a non-trivial extension of the very popular common correlated effects…

Econometrics · Economics 2025-08-11 Maximilian Ruecker , Michael Vogt , Oliver Linton , Christopher Walsh

This paper introduces a quantile regression estimator for panel data models with individual heterogeneity and attrition. The method is motivated by the fact that attrition bias is often encountered in Big Data applications. For example,…

Econometrics · Economics 2018-08-13 Matthew Harding , Carlos Lamarche

One of the most common problems preventing the application of prediction models in the real world is lack of generalization: The accuracy of models, measured in the benchmark does repeat itself on future data, e.g. in the settings of real…

Computation and Language · Computer Science 2022-10-19 Abdel Aziz Taha , Leonhard Hennig , Petr Knoth

Machine learning applications often require calibrated predictions, e.g. a 90\% credible interval should contain the true outcome 90\% of the times. However, typical definitions of calibration only require this to hold on average, and offer…

Machine Learning · Statistics 2020-09-10 Shengjia Zhao , Tengyu Ma , Stefano Ermon

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. For example, the maximum likelihood estimator has a bias that can result in a significant inferential loss. This problem is…

Statistics Theory · Mathematics 2019-11-04 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

We propose a new method for estimating causal effects in longitudinal/panel data settings that we call generalized difference-in-differences. Our approach unifies two alternative approaches in these settings: ignorability estimators (e.g.,…

Methodology · Statistics 2023-12-12 Denis Agniel , Max Rubinstein , Jessie Coe , Maria DeYoreo

Machine learning models only provide probabilistic guarantees on the expected loss of random samples from the distribution represented by their training data. As a result, a model with high accuracy, may or may not be reliable for…

Databases · Computer Science 2024-04-12 Nima Shahbazi , Abolfazl Asudeh

Conducting causal inference with panel data is a core challenge in social science research. We adapt a deep neural architecture for time series forecasting (the N-BEATS algorithm) to more accurately impute the counterfactual evolution of a…

Econometrics · Economics 2024-04-18 Jacob Goldin , Julian Nyarko , Justin Young

While most of the convergence results in the literature on high dimensional covariance matrix are concerned about the accuracy of estimating the covariance matrix (and precision matrix), relatively less is known about the effect of…

Statistics Theory · Mathematics 2013-11-13 Jushan Bai , Yuan Liao