English

MOOSE-Star: Unlocking Tractable Training for Scientific Discovery by Breaking the Complexity Barrier

Machine Learning 2026-05-12 v4 Computational Engineering, Finance, and Science Computation and Language

Abstract

While large language models (LLMs) show promise in scientific discovery, existing research focuses on inference or feedback-driven training, leaving the direct modeling of the generative reasoning process, P(hypothesisbackground)P(\text{hypothesis}|\text{background}) (P(hb)P(h|b)), unexplored. We demonstrate that directly training P(hb)P(h|b) is mathematically intractable due to the combinatorial complexity (O(Nk)O(N^k)) inherent in retrieving and composing inspirations from a vast knowledge base. To break this barrier, we introduce MOOSE-Star, a unified framework that enables tractable and scalable training of P(hb)P(h|b), while supporting more scalable inference. In the best case, MOOSE-Star reduces complexity from exponential to logarithmic (O(logN)O(\log N)) by (1) training on decomposed subtasks derived from the probabilistic equation of discovery, (2) employing motivation-guided hierarchical search to enable logarithmic retrieval and prune irrelevant subspaces, and (3) utilizing bounded composition for robustness against retrieval noise. To facilitate this, we release TOMATO-Star, a dataset of 108,717 decomposed papers (38,400 GPU hours) for training. Empirically, MOOSE-Star scales continuously with training data and inference budget, whereas direct brute-force sampling hits a complexity wall.

Keywords

Cite

@article{arxiv.2603.03756,
  title  = {MOOSE-Star: Unlocking Tractable Training for Scientific Discovery by Breaking the Complexity Barrier},
  author = {Zonglin Yang and Lidong Bing},
  journal= {arXiv preprint arXiv:2603.03756},
  year   = {2026}
}

Comments

Accepted by ICML 2026

R2 v1 2026-07-01T11:02:31.125Z