English

Selective Test-Time Compute Scaling for Click-Through Rate Prediction via Uncertainty-Triggered Feature Path Exploration

Machine Learning 2026-05-26 v1 Artificial Intelligence Information Retrieval

Abstract

Scaling test-time compute has proven highly effective for language models, yet this opportunity remains largely unexplored for industrial Click-Through Rate (CTR) prediction. CTR models suffer from a fundamental asymmetry: feature combinations well-represented in training yield confident predictions, while sparsely observed ones produce unreliable outputs. Existing training-phase solutions such as adaptive gating learn a fixed selection function subject to the same sparsity, offering no per-instance recourse at deployment.We propose UTTSI (Uncertainty-Triggered Test-Time Selective Inference), a training-free model-agnostic framework that scales inference depth proportionally to per-instance uncertainty. A dual-signal estimator combining model logit confidence with a data-level frequency prior distinguishes epistemic uncertainty from aleatoric ambiguity. Every instance undergoes adaptive feature filtering to remove unreliable embeddings; uncertain instances additionally receive stochastic feature-path explorations whose predictions are aggregated via consistency-weighted ensembling. Confident instances bypass exploration entirely, keeping average overhead at approximately 2.8×2.8\times base model cost with worst-case latency unchanged.Experiments on four datasets with three backbone architectures demonstrate consistent, statistically significant gains over all training-phase baselines. A seven-day online A/B test further confirms a 5.3% relative CTR gain (p<0.01p < 0.01), establishing selective test-time compute allocation as a practical complement to training-phase advances for CTR prediction.

Keywords

Cite

@article{arxiv.2605.24989,
  title  = {Selective Test-Time Compute Scaling for Click-Through Rate Prediction via Uncertainty-Triggered Feature Path Exploration},
  author = {Moyu Zhang and Yun Chen and Yujun Jin and Jinxin Hu and Yu Zhang and Xiaoyi Zeng},
  journal= {arXiv preprint arXiv:2605.24989},
  year   = {2026}
}

Comments

12 pages, 4 Figures, 3 Tables

R2 v1 2026-07-22T07:30:51.378Z