English
Related papers

Related papers: A Calibrated Data-Driven Approach for Small Area E…

200 papers

The importance of exploring a potential integration among surveys has been acknowledged in order to enhance effectiveness and minimize expenses. In this work, we employ the alignment method to combine information from two different surveys…

Methodology · Statistics 2024-04-09 Vasilis Chasiotis , Dimitris Karlis

Missing data are inevitable in longitudinal studies. Traditional methods, such as the full information maximum likelihood (FIML), are commonly used to handle ignorable missing data. However, they may lead to biased model estimation due to…

Applications · Statistics 2024-01-01 Dandan Tang , Xin Tong

Machine learning (ML) has shown significant promise in studying complex geophysical dynamical systems, including turbulence and climate processes. Such systems often display sensitive dependence on initial conditions, reflected in positive…

Atmospheric and Oceanic Physics · Physics 2025-12-09 Zhewen Hou , Jiajin Sun , Subashree Venkatasubramanian , Peter Jin , Shuolin Li , Tian Zheng

In the era of large-scale model training, the extensive use of available datasets has resulted in significant computational inefficiencies. To tackle this issue, we explore methods for identifying informative subsets of training data that…

Machine Learning · Computer Science 2025-04-21 Jinghan Yang , Anupam Pani , Yunchao Zhang

The Huff model has been widely used in location-based business analysis for delineating a trading area containing potential customers to a store. Calibrating the Huff model and its extensions requires empirical location visit data. Many…

Social and Information Networks · Computer Science 2020-03-25 Yunlei Liang , Song Gao , Yuxin Cai , Natasha Zhang Foutz , Lei Wu

The vast majority of theoretical results in machine learning and statistics assume that the available training data is a reasonably reliable reflection of the phenomena to be learned or estimated. Similarly, the majority of machine learning…

Machine Learning · Computer Science 2017-06-13 Moses Charikar , Jacob Steinhardt , Gregory Valiant

We provide another look at the statistical calibration problem in computer models. This viewpoint is inspired by two overarching practical considerations of computer models: (i) many computer models are inadequate for perfectly modeling…

Methodology · Statistics 2018-09-26 Xiaowu Dai , Peter Chien

Calibration is commonly evaluated by comparing model confidence with its empirical correctness, implicitly treating reliability as a function of the confidence score alone. However, this view can hide substantial structure: models may be…

Machine Learning · Computer Science 2026-05-14 Katarzyna Kobalczyk , Mihaela van der Schaar

In this paper, we apply shrinkage strategies to estimate regression coefficients efficiently for the high-dimensional multiple regression model, where the number of samples is smaller than the number of predictors. We assume in the sparse…

Methodology · Statistics 2017-04-19 B. Yuzbasi , M. Arashi , S. E. Ahmed

Trustworthy classifiers are essential to the adoption of machine learning predictions in many real-world settings. The predicted probability of possible outcomes can inform high-stakes decision making, particularly when assessing the…

Machine Learning · Computer Science 2023-02-22 Kiri L. Wagstaff , Thomas G. Dietterich

In Big Data environment, one pressing challenge facing engineers is to perform reliability analysis for a large fleet of heterogeneous repairable systems with covariates. In addition to static covariates, which include time-invariant system…

Applications · Statistics 2019-04-03 Xiao Liu , Rong Pan

In surveys, the interest lies in estimating finite population parameters such as population totals and means. In most surveys, some auxiliary information is available at the estimation stage. This information may be incorporated in the…

Methodology · Statistics 2022-08-23 Mehdi Dagdoug , Camelia Goga , David Haziza

Approximation of scattered data is often a task in many engineering problems. The Radial Basis Function (RBF) approximation is appropriate for big scattered datasets in $n-$dimensional space. It is a non-separable approximation, as it is…

Computational Engineering, Finance, and Science · Computer Science 2018-06-22 Zuzana Majdisova , Vaclav Skala

Estimating frequencies of certain items among a population is a basic step in data analytics, which enables more advanced data analytics (e.g., heavy hitter identification, frequent pattern mining), client software optimization, and…

Cryptography and Security · Computer Science 2018-12-12 Jinyuan Jia , Neil Zhenqiang Gong

Consider semiparametric estimation where a doubly robust estimating function for a low-dimensional parameter is available, depending on two working models. With high-dimensional data, we develop regularized calibrated estimation as a…

Methodology · Statistics 2020-09-28 Satyajit Ghosh , Zhiqiang Tan

We present a novel and easy-to-use method for calibrating error-rate based confidence intervals to evidence-based support intervals. Support intervals are obtained from inverting Bayes factors based on a parameter estimate and its standard…

Methodology · Statistics 2023-06-28 Samuel Pawel , Alexander Ly , Eric-Jan Wagenmakers

A wide range of systems exhibit high dimensional incomplete data. Accurate estimation of the missing data is often desired, and is crucial for many downstream analyses. Many state-of-the-art recovery methods involve supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Adrian V. Dalca , John Guttag , Mert R. Sabuncu

Interval-censored data are common in fields such as epidemiology and demography. When the failure event of interest is relatively rare and the collection of covariates is costly, researchers often adopt the case-cohort design to reduce…

Methodology · Statistics 2025-09-29 Yeyu Xiao , Yonghong Long

In 2023, the U.S. Food and Drug Administration issued guidance for adjustment of covariates in randomized clinical trials, emphasizing its role in enhancing precision and power through prognostic baseline variables. Despite its potential,…

Methodology · Statistics 2026-05-28 Kelly Van Lancker , Iván Díaz , Stijn Vansteelandt

In some multivariate problems with missing data, pairs of variables exist that are never observed together. For example, some modern biological tools can produce data of this form. As a result of this structure, the covariance matrix is…

Methodology · Statistics 2013-08-13 Max Grazier G'Sell , Shai S. Shen-Orr , Robert Tibshirani