English

Information-Theoretic Multi-Model Fusion for Target-Oriented Adaptive Sampling in Materials Design

Machine Learning 2026-02-04 v1 Materials Science Information Theory math.IT

Abstract

Target-oriented discovery under limited evaluation budgets requires making reliable progress in high-dimensional, heterogeneous design spaces where each new measurement is costly, whether experimental or high-fidelity simulation. We present an information-theoretic framework for target-oriented adaptive sampling that reframes optimization as trajectory discovery: instead of approximating the full response surface, the method maintains and refines a low-entropy information state that concentrates search on target-relevant directions. The approach couples data, model beliefs, and physics/structure priors through dimension-aware information budgeting, adaptive bootstrapped distillation over a heterogeneous surrogate reservoir, and structure-aware candidate manifold analysis with Kalman-inspired multi-model fusion to balance consensus-driven exploitation and disagreement-driven exploration. Evaluated under a single unified protocol without dataset-specific tuning, the framework improves sample efficiency and reliability across 14 single- and multi-objective materials design tasks spanning candidate pools from 600600 to 4×1064 \times 10^6 and feature dimensions from 1010 to 10310^3, typically reaching top-performing regions within 100 evaluations. Complementary 20-dimensional synthetic benchmarks (Ackley, Rastrigin, Schwefel) further demonstrate robustness to rugged and multimodal landscapes.

Keywords

Cite

@article{arxiv.2602.03319,
  title  = {Information-Theoretic Multi-Model Fusion for Target-Oriented Adaptive Sampling in Materials Design},
  author = {Yixuan Zhang and Zhiyuan Li and Weijia He and Mian Dai and Chen Shen and Teng Long and Hongbin Zhang},
  journal= {arXiv preprint arXiv:2602.03319},
  year   = {2026}
}

Comments

37 pages, 5 figures, 2 tables

R2 v1 2026-07-01T09:33:50.260Z