基于回归视角的抽样数据可信度维度无关性测试
摘要
评估样本调查是否可靠地代表总体是一个确保下游研究有效性的关键问题。一般而言,这一问题归结为估计两个高维分布之间的距离,这通常需要随维度指数增长的样本数。然而, Depending on the model used for data analysis, the conclusions drawn from the data may remain consistent across different underlying distributions. In this context, we propose a task-based approach to assess the credibility of sampled surveys. Specifically, we introduce a model-specific distance metric to quantify this notion of credibility. We also design an algorithm to verify the credibility of survey data in the context of regression models. Notably, the sample complexity of our algorithm is independent of the data dimension. This efficiency stems from the fact that the algorithm focuses on verifying the credibility of the survey data rather than reconstructing the underlying regression model. Furthermore, we show that if one attempts to verify credibility by reconstructing the regression model, the sample complexity scales linearly with the dimensionality of the data. We prove the theoretical correctness of our algorithm and numerically demonstrate our algorithm's performance.
引用
@article{arxiv.2508.20616,
title = {Dimension Agnostic Testing of Survey Data Credibility through the Lens of Regression},
author = {Debabrota Basu and Sourav Chakraborty and Debarshi Chanda and Buddha Dev Das and Arijit Ghosh and Arnab Ray},
journal= {arXiv preprint arXiv:2508.20616},
year = {2025}
}
备注
30 pages, 8 figures, 6 Tables