English
Related papers

Related papers: Estimation with Binned Data

200 papers

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

Data analysis based on information from several sources is common in economic and biomedical studies. This setting is often referred to as the data fusion problem, which differs from traditional missing data problems since no complete data…

Methodology · Statistics 2022-04-07 Wei Li , Shanshan Luo , Wangli Xu

We address the problem of aggregating an ensemble of predictors with known loss bounds in a semi-supervised binary classification setting, to minimize prediction loss incurred on the unlabeled data. We find the minimax optimal predictions…

Machine Learning · Computer Science 2016-11-08 Akshay Balsubramani , Yoav Freund

The analysis of the USA 2001 income distribution shows that it can be described by at least two main components, which obey the generalized Tsallis statistics with different values of the q parameter. Theoretical calculations using the gas…

General Finance · Quantitative Finance 2011-05-18 Juan C. Ferrero

The purpose of this article is to develop a general parametric estimation theory that allows the derivation of the limit distribution of estimators in non-regular models where the true parameter value may lie on the boundary of the…

Statistics Theory · Mathematics 2022-11-28 Junichiro Yoshida , Nakahiro Yoshida

Conditional belief networks introduce stochastic binary variables in neural networks. Contrary to a classical neural network, a belief network can predict more than the expected value of the output $Y$ given the input $X$. It can predict a…

Machine Learning · Computer Science 2016-05-03 Yann N. Dauphin , David Grangier

If we have an unbiased estimate of some parameter of interest, then its absolute value is positively biased for the absolute value of the parameter. This bias is large when the signal-to-noise ratio (SNR) is small, and it becomes even…

Methodology · Statistics 2020-12-01 Erik van Zwet , Andrew Gelman

A class of models that have been widely used are the exponential random graph (ERG) models, which form a comprehensive family of models that include independent and dyadic edge models, Markov random graphs, and many other graph…

Statistics Theory · Mathematics 2022-02-07 Denise Duarte , Rafael Honório Pereira Alves

Cities are characterized by the coexistence of general aggregate patterns, along with many local variations. This poses challenges for analyses of urban phenomena, which tend to be either too aggregated or too local, depending on the…

Physics and Society · Physics 2025-09-30 Luís M. A. Bettencourt , Ivanna Rodriguez , Jordan T. Kemp , José Lobo

Distribution system residential load modeling and analysis for different geographic areas within a utility or an independent system operator territory are critical for enabling small-scale, aggregated distributed energy resources to…

Systems and Control · Electrical Eng. & Systems 2022-08-16 Isaac Bromley-Dulfano , Xiangqi Zhu , Barry Mather

This paper shows that utilizing information on the extensive margin of financially constrained households can narrow down the set of admissible preferences in a large class of macroeconomic models. Estimates based on Spanish aggregate data…

Econometrics · Economics 2023-02-21 Andreas Tryphonides

In all areas of human knowledge, datasets are increasing in both size and complexity, creating the need for richer statistical models. This trend is also true for economic data, where high-dimensional and nonlinear/nonparametric inference…

Econometrics · Economics 2021-12-23 Dimitris Korobilis , Kenichi Shimizu

This paper evaluates six strategies for mitigating imbalanced data: oversampling, undersampling, ensemble methods, specialized algorithms, class weight adjustments, and a no-mitigation approach referred to as the baseline. These strategies…

Machine Learning · Computer Science 2023-11-13 Jacques Wainer

This paper proposes new linear regression models to deal with overdispersed binomial datasets. These new models, called tilted beta binomial regression models, are defined from the tilted beta binomial distribution, proposed assuming that…

Methodology · Statistics 2019-11-26 María Victoria Cifuentes-Amado , Edilberto Cepeda-Cuervo

We consider a continuous-time Markov chain model of SIR disease dynamics with two levels of mixing. For this so-called stochastic households model, we provide two methods for inferring the model parameters---governing within-household…

Populations and Evolution · Quantitative Biology 2018-02-07 James N. Walker , Joshua V. Ross , Andrew J. Black

Binned maximum likelihood fits are an attractive option when analysing large datasets, but require care when computing likelihoods of continuous PDFs in bins. For many years the widely used statistical modelling package RooFit evaluated…

Data Analysis, Statistics and Probability · Physics 2021-08-06 V. V. Gligorov , S. Hageboeck , T. Nanut , A. Sciandra , D. Y. Tou

The Expected Normalized Calibration Error (ENCE) is a popular calibration statistic used in Machine Learning to assess the quality of prediction uncertainties for regression problems. Estimation of the ENCE is based on the binning of…

Machine Learning · Computer Science 2023-05-23 Pascal Pernot

In this paper, we consider the classic measurement error regression scenario in which our independent, or design, variables are observed with several sources of additive noise. We will show that our motivating example's replicated…

Applications · Statistics 2012-07-10 David J. Biagioni , Ryan Elmore , Wesley Jones

The vast majority of statistical theory on binary classification characterizes performance in terms of accuracy. However, accuracy is known in many cases to poorly reflect the practical consequences of classification error, most famously in…

Statistics Theory · Mathematics 2022-09-27 Shashank Singh , Justin Khim

When conducting large scale inference, such as genome-wide association studies or image analysis, nominal $p$-values are often adjusted to improve control over the family-wise error rate (FWER). When the majority of tests are null,…

Methodology · Statistics 2017-07-20 Sarah Fletcher Mercaldo , Jeffrey D. Blume