English
Related papers

Related papers: Cluster-robust jackknife and bootstrap inference f…

200 papers

We study a multi-factor block model for variable clustering and connect it to regularized subspace clustering through a distributionally robust version of nodewise regression. To solve the latter problem, we derive a convex relaxation,…

Machine Learning · Computer Science 2026-05-26 Kaizheng Wang , Xiao Xu , Xun Yu Zhou

The Akaike information criterion (AIC) is a model selection criterion widely used in practical applications. The AIC is an estimator of the log-likelihood expected value, and measures the discrepancy between the true model and the estimated…

Computation · Statistics 2017-02-03 Fábio M. Bayer , Francisco Cribari-Neto

The empirical covariance matrix is not necessarily the best estimator for the population covariance matrix: we describe a simple method which gives better estimates in two examples. The method models the covariance matrix using truncated…

Atmospheric and Oceanic Physics · Physics 2007-05-23 Stephen Jewson

One of the most common machine learning setups is logistic regression. In many classification models, including neural networks, the final prediction is obtained by applying a logistic link function to a linear score. In binary logistic…

Machine Learning · Statistics 2026-03-24 Avrajit Ghosh , Bin Yu , Manfred Warmuth , Peter Bartlett

Multi-armed bandit models have proven to be useful in modeling many real world problems in the areas of control and sequential decision making with partial information. However, in many scenarios, such as those prevalent in healthcare and…

Optimization and Control · Mathematics 2024-08-27 Qinyang He , Yonatan Mintz

The errors-in-variables (EIV) regression model, being more realistic by accounting for measurement errors in both the dependent and the independent variables, is widely adopted in applied sciences. The traditional EIV model estimators,…

Methodology · Statistics 2015-08-13 Hao Han , Wei Zhu

Clustering procedures typically estimate which data points are clustered together, a quantity of primary importance in many analyses. Often used as a preliminary step for dimensionality reduction or to facilitate interpretation, finding…

Methodology · Statistics 2017-12-06 Ryan Giordano , Runjing Liu , Nelle Varoquaux , Michael I. Jordan , Tamara Broderick

This paper introduces a class of jackknife-based test statistics for linear regression models with endogeneity and heteroskedasticity in the presence of many potentially weak instrumental variables. The tests may be used when considering…

Econometrics · Economics 2026-04-20 Federico Crudu , Giovanni Mellace , Zsolt Sándor

Dyadic data are common in the social sciences, although inference for such settings involves accounting for a complex clustering structure. Many analyses in the social sciences fail to account for the fact that multiple dyads share a…

Methodology · Statistics 2015-07-24 Peter M. Aronow , Cyrus Samii , Valentina A. Assenova

The two main topics of this paper are the introduction of the "optimally tuned improper maximum likelihood estimator" (OTRIMLE) for robust clustering based on the multivariate Gaussian model for clusters, and a comprehensive simulation…

Methodology · Statistics 2017-01-31 Pietro Coretto , Christian Hennig

Clustering is a fundamental tool in unsupervised learning, used to group objects by distinguishing between similar and dissimilar features of a given data set. One of the most common clustering algorithms is k-means. Unfortunately, when…

Machine Learning · Statistics 2021-08-17 Olga Dorabiala , J. Nathan Kutz , Aleksandr Aravkin

In the fields of clinical trials, biomedical surveys, marketing, banking, with dichotomous response variable, the logistic regression is considered as an alternative convenient approach to linear regression. In this paper, we develop a…

Statistics Theory · Mathematics 2025-12-29 Debraj Das , Priyam Das

We study the problem of training an accurate linear regression model by procuring labels from multiple noisy crowd annotators, under a budget constraint. We propose a Bayesian model for linear regression in crowdsourcing and use variational…

Machine Learning · Computer Science 2016-02-01 Divya Padmanabhan , Satyanath Bhat , Dinesh Garg , Shirish Shevade , Y. Narahari

The latent class model is a powerful unsupervised clustering algorithm for categorical data. Many statistics exist to test the fit of the latent class model. However, traditional methods to evaluate those fit statistics are not always…

Methodology · Statistics 2018-01-30 Geert H. van Kollenburg , Joris Mulder , Jeroen K. Vermunt

Active statistical inference is a new method for inference with AI-assisted data collection. Given a budget on the number of labeled data points that can be collected and assuming access to an AI predictive model, the basic idea is to…

Machine Learning · Statistics 2025-11-13 Puheng Li , Tijana Zrnic , Emmanuel Candès

Bootstrap is commonly used as a tool for non-parametric statistical inference to estimate meaningful parameters in Variable Selection Models. However, for massive dataset that has exponential growth rate, the computation of Bootstrap…

Computation · Statistics 2016-12-26 Zhibing He , Yichen Qin , Ben-Chang Shia , Yang Li

Stepped wedge cluster randomized trials (SW-CRTs) have become increasingly popular and are used for a variety of interventions and outcomes, often chosen for their feasibility advantages. SW-CRTs must account for time trends in the outcome…

Methodology · Statistics 2024-07-16 Lee Kennedy-Shaffer , Victor De Gruttola , Marc Lipsitch

We introduce a novel validation framework to measure the true robustness of learning models for real-world applications by creating source-inclusive and source-exclusive partitions in a dataset via clustering. We develop a robustness metric…

Machine Learning · Computer Science 2017-04-04 Ozsel Kilinc , Ismail Uysal

Variable selection in cluster analysis is important yet challenging. It can be achieved by regularization methods, which realize a trade-off between the clustering accuracy and the number of selected variables by using a lasso-type penalty.…

Methodology · Statistics 2016-12-23 Marbac Matthieu , Sedki Mohammed

Statistical inference is a major scientific endeavor for many researchers. In terms of inferential methods implemented to mixed-effects models, significant progress has been made in the R software. However, these advances primarily concern…

Methodology · Statistics 2024-04-15 Fabio Mason , Manuel Koller , Eva Cantoni , Paolo Ghisletta