中文
相关论文

相关论文: A Calibrated Data-Driven Approach for Small Area E…

200 篇论文

It is often observed that the probabilistic predictions given by a machine learning model can disagree with averaged actual outcomes on specific subsets of data, which is also known as the issue of miscalibration. It is responsible for the…

机器学习 · 计算机科学 2020-01-28 Feiyang Pan , Xiang Ao , Pingzhong Tang , Min Lu , Dapeng Liu , Lei Xiao , Qing He

Calibration is a widely used method in survey sampling to adjust weights so that estimated totals of some chosen calibration variables match known population totals or totals obtained from other sources. When a large number of auxiliary…

统计方法学 · 统计学 2025-12-11 Caren Hasler , Arnaud Tripet , Yves Tillé

Bin Packing problems have been widely studied because of their broad applications in different domains. Known as a set of NP-hard problems, they have different vari- ations and many heuristics have been proposed for obtaining approximate…

机器学习 · 计算机科学 2017-02-16 Feng Mao , Edgar Blanco , Mingang Fu , Rohit Jain , Anurag Gupta , Sebastien Mancel , Rong Yuan , Stephen Guo , Sai Kumar , Yayang Tian

This article introduces subbagging (subsample aggregating) estimation approaches for big data analysis with memory constraints of computers. Specifically, for the whole dataset with size $N$, $m_N$ subsamples are randomly drawn, and each…

统计方法学 · 统计学 2021-03-05 Tao Zou , Xian Li , Xuan Liang , Hansheng Wang

A two-stage normal hierarchical model called the Fay--Herriot model and the empirical Bayes estimator are widely used to provide indirect and model-based estimates of means in small areas. However, the performance of the empirical Bayes…

统计方法学 · 统计学 2019-08-26 Shonosuke Sugasawa

Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators. However, they are often overconfident in their predictions, which leads to inaccurate and miscalibrated…

机器学习 · 计算机科学 2021-02-23 Jeffrey Willette , Juho Lee , Sung Ju Hwang

Estimating causal effects from large experimental and observational data has become increasingly prevalent in both industry and research. The bootstrap is an intuitive and powerful technique used to construct standard errors and confidence…

统计方法学 · 统计学 2023-02-07 Matthew Kosko , Lin Wang , Michele Santacatterina

Recent works have shown that deep neural networks can achieve super-human performance in a wide range of image classification tasks in the medical imaging domain. However, these works have primarily focused on classification accuracy,…

计算机视觉与模式识别 · 计算机科学 2020-09-10 Gongbo Liang , Yu Zhang , Xiaoqin Wang , Nathan Jacobs

AI tools can be useful to address model deficits in the design of communication systems. However, conventional learning-based AI algorithms yield poorly calibrated decisions, unabling to quantify their outputs uncertainty. While Bayesian…

信号处理 · 电气工程与系统科学 2024-05-02 Kfir M. Cohen , Sangwoo Park , Osvaldo Simeone , Shlomo Shamai

Many classification applications require accurate probability estimates in addition to good class separation but often classifiers are designed focusing only on the latter. Calibration is the process of improving probability estimates by…

机器学习 · 计算机科学 2020-01-31 Tuomo Alasalmi , Jaakko Suutala , Heli Koskimäki , Juha Röning

While the performance of machine learning systems has experienced significant improvement in recent years, relatively little attention has been paid to the fundamental question: to what extent can we improve our models? This paper provides…

机器学习 · 计算机科学 2026-05-13 Ryota Ushio , Takashi Ishida , Masashi Sugiyama

We introduce a new small area predictor when the Fay-Herriot normal error model is fitted to a logarithmically transformed response variable, and the covariate is measured with error. This framework has been previously studied by Mosaferi…

统计方法学 · 统计学 2023-08-23 Sepideh Mosaferi , Malay Ghosh , Shonosuke Sugasawa

We consider regression analysis in the context of data integration. To combine partial information from external sources, we employ the idea of model calibration which introduces a "working" reduced model based on the observed covariates.…

统计方法学 · 统计学 2022-10-13 Zhonglei Wang , Hang J. Kim , Jae Kwang Kim

Given a supervised machine learning problem where the training set has been subject to a known sampling bias, how can a model be trained to fit the original dataset? We achieve this through the Bayesian inference framework by altering the…

机器学习 · 统计学 2022-03-16 Max Sklar

Learning on big data brings success for artificial intelligence (AI), but the annotation and training costs are expensive. In future, learning on small data that approximates the generalization ability of big data is one of the ultimate…

机器学习 · 计算机科学 2023-06-07 Xiaofeng Cao , Weixin Bu , Shengjun Huang , Minling Zhang , Ivor W. Tsang , Yew Soon Ong , James T. Kwok

We propose an approximate hierarchical Bayes approach that uses the Natural Exponential Family with Quadratic Variance Function in combining information from multiple sources to improve traditional survey estimates of finite population…

统计方法学 · 统计学 2025-12-25 Soumojit Das , Partha Lahiri

Determining whether an algorithmic decision-making system discriminates against a specific demographic typically involves comparing a single point estimate of a fairness metric against a predefined threshold. This practice is statistically…

机器学习 · 计算机科学 2026-03-20 Antonio Ferrara , Francesco Cozzi , Alan Perotti , André Panisson , Francesco Bonchi

In this paper, we propose a novel framework, the Sampling-guided Heterogeneous Graph Neural Network (SHT-GNN), to effectively tackle the challenge of missing data imputation in longitudinal studies. Unlike traditional methods, which often…

机器学习 · 计算机科学 2024-11-08 Zhaoyang Zhang , Ziqi Chen , Qiao Liu , Jinhan Xie , Hongtu Zhu

Calibration sample selection and forecast combination are two simple yet powerful tools used in forecasting. They can be combined with a variety of models to significantly improve prediction accuracy, at the same time offering easy…

应用统计 · 统计学 2025-10-20 Tomasz Serafin , Weronika Nitka

The multivariate Fay-Herriot model is quite effective in combining information through correlations among small area survey estimates of related variables or historical survey estimates of the same variable or both. Though the literature on…

统计方法学 · 统计学 2020-06-29 Takumi Saegusa , Shonosuke Sugasawa , Partha Lahiri