English

Utility-Aware Data Pricing: Token-Level Quality and Empirical Training Gain for LLMs

Machine Learning 2026-04-28 v1 Artificial Intelligence

Abstract

Traditional data valuation methods based on ``row-count ×\times quality coefficient'' paradigms fail to capture the nuanced, nonlinear contributions that data makes to Large Language Model (LLM) capabilities. This paper presents a dynamic data valuation framework that transitions from static accounting to utility-based pricing. Our approach operates on three layers: (1) token-level information density metrics using Shannon entropy and Data Quality Scores; (2) empirical training gain measurement through influence functions, proxy model strategies, and Data Shapley values; and (3) cryptographic verifiability through hash-based commitments, Merkle trees, and a tamper-evident training ledger. We provide comprehensive experimental validation on three real domains (instruction following, mathematical reasoning, and code summarization), demonstrating that proxy-based empirical gain achieves near-perfect ranking alignment with realized utility, substantially outperforming row-count and token-count baselines. This framework enables a fair Data-as-a-Service economy where high-reasoning data is priced according to its actual contribution to model intelligence, while providing the transparency and auditability necessary for trustworthy data markets.

Keywords

Cite

@article{arxiv.2604.22893,
  title  = {Utility-Aware Data Pricing: Token-Level Quality and Empirical Training Gain for LLMs},
  author = {Minghui Xu and Qi Luo and Kun Li},
  journal= {arXiv preprint arXiv:2604.22893},
  year   = {2026}
}

Comments

23 pages, 1 figure, 6 tables

R2 v1 2026-07-01T12:34:21.716Z