English
Related papers

Related papers: On cross-validation for small area estimators

200 papers

Sparse Autoencoders (SAEs) are widely used to interpret neural networks by identifying meaningful concepts from their representations. However, do SAEs truly uncover all concepts a model relies on, or are they inherently biased toward…

Machine Learning · Computer Science 2025-12-03 Sai Sumedh R. Hindupur , Ekdeep Singh Lubana , Thomas Fel , Demba Ba

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

Many countries measure poverty based only on income or consumption. However, there is a growing awareness of measuring poverty through multiple dimensions that captures a more reasonable status of poverty. Estimating poverty measure(s) for…

Methodology · Statistics 2025-10-13 Soumojit Das , Dilshanie Deepawansa , Partha Lahiri

Cross-validation under sample selection bias can, in principle, be done by importance-weighting the empirical risk. However, the importance-weighted risk estimator produces sub-optimal hyperparameter estimates in problem settings where…

Machine Learning · Computer Science 2019-08-28 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog

We consider comparisons of statistical learning algorithms using multiple data sets, via leave-one-in cross-study validation: each of the algorithms is trained on one data set; the resulting model is then validated on each remaining data…

Applications · Statistics 2015-06-02 Lorenzo Trippa , Levi Waldron , Curtis Huttenhower , Giovanni Parmigiani

Sparse Autoencoders (SAEs) have emerged as a predominant tool in mechanistic interpretability, aiming to identify interpretable monosemantic features. However, how does sparse encoding organize the representations of activation vector from…

Machine Learning · Computer Science 2025-05-29 Wenjie Sun , Bingzhe Wu , Zhile Yang , Chengke Wu

It remains difficult to evaluate machine learning classifiers in the absence of a large, labeled dataset. While labeled data can be prohibitively expensive or impossible to obtain, unlabeled data is plentiful. Here, we introduce…

Machine Learning · Computer Science 2025-10-15 Divya Shanmugam , Shuvom Sadhuka , Manish Raghavan , John Guttag , Bonnie Berger , Emma Pierson

The average household income is one of the most important indexes for decision making and the modelling of economic inequity and poverty. In this work we propose a practical procedure to estimate the average income using small area methods.…

Applications · Statistics 2019-07-12 Julieth Castañeda , Cristian Tellez , Jairo Fuquene

In this article, we derive concentration inequalities for the cross-validation estimate of the generalization error for subagged estimators, both for classification and regressor. General loss functions and class of predictors with both…

Machine Learning · Statistics 2010-11-24 Matthieu CORNEC

The American Statistical Association (ASA) statement on statistical significance and P-values \cite{wasserstein2016asa} cautioned statisticians against making scientific decisions solely on the basis of traditional P-values. The statement…

Methodology · Statistics 2024-02-22 Abhisek Chakraborty , Megan H. Murray , Ilya Lipkovich , Yu Du

In the 70s a novel branch of statistics emerged focusing its effort in selecting a function in the pattern recognition problem, which fulfils a definite relationship between the quality of the approximation and its complexity. These…

Machine Learning · Statistics 2022-02-10 J M Gorriz , SiPBA Group , CAM neuroscience

We study a regression problem where for some part of the data we observe both the label variable ($Y$) and the predictors (${\bf X}$), while for other part of the data only the predictors are given. Such a problem arises, for example, when…

Statistics Theory · Mathematics 2021-04-14 David Azriel , Lawrence D. Brown , Michael Sklar , Richard Berk , Andreas Buja , Linda Zhao

Interpretability is critical in high-stakes domains such as medical imaging, where understanding model decisions is essential for clinical adoption. In this work, we introduce Sparse Autoencoder (SAE)-based interpretability to breast…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Krishna Kanth Nakka

To better understand the spatial structure of large panels of economic and financial time series and provide a guideline for constructing semiparametric models, this paper first considers estimating a large spatial covariance matrix of the…

Machine Learning · Statistics 2015-03-19 Song Song

In this paper, we present a novel cross-consistency based semi-supervised approach for semantic segmentation. Consistency training has proven to be a powerful semi-supervised learning framework for leveraging unlabeled data under the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Yassine Ouali , Céline Hudelot , Myriam Tami

Small area estimation (SAE) plays a central role in survey statistics and epidemiology, providing reliable estimates for domains with limited sample sizes. The multivariate Fay-Herriot model has been extensively used for this purpose,…

Methodology · Statistics 2026-01-22 Shushi Nishina , Takahiro Onizuka , Shintaro Hashimoto

We consider the problem of bandwidth selection by cross-validation from a sequential point of view in a nonparametric regression model. Having in mind that in applications one often aims at estimation, prediction and change detection…

Statistics Theory · Mathematics 2018-03-20 Ansgar Steland

Fine stratification is a popular design as it permits the stratification to be carried out to the fullest possible extent. Some examples include the Current Population Survey and National Crime Victimization Survey both conducted by the…

Methodology · Statistics 2026-03-09 Sepideh Mosaferi

In the context of cluster analysis and graph partitioning, many external evaluation measures have been proposed in the literature to compare two partitions of the same set. This makes the task of selecting the most appropriate measure for a…

Machine Learning · Computer Science 2021-02-09 Nejat Arinik , Vincent Labatut , Rosa Figueiredo

We propose a novel methodology relating item response theory methods with small area estimation strategies in the presence of missing data. Specifically, we propose an unbiased estimator for the average ability parameter of three-parameter…