English

InterFeat: A Pipeline for Finding Interesting Scientific Features

Quantitative Methods 2025-09-09 v2 Artificial Intelligence Computation and Language Information Retrieval

Abstract

Finding interesting phenomena is the core of scientific discovery, but it is a manual, ill-defined concept. We present an integrative pipeline for automating the discovery of interesting simple hypotheses (feature-target relations with effect direction and a potential underlying mechanism) in structured biomedical data. The pipeline combines machine learning, knowledge graphs, literature search and Large Language Models. We formalize "interestingness" as a combination of novelty, utility and plausibility. On 8 major diseases from the UK Biobank, our pipeline consistently recovers risk factors years before their appearance in the literature. 40--53% of our top candidates were validated as interesting, compared to 0--7% for a SHAP-based baseline. Overall, 28% of 109 candidates were interesting to medical experts. The pipeline addresses the challenge of operationalizing "interestingness" scalably and for any target. We release data and code: https://github.com/LinialLab/InterFeat

Keywords

Cite

@article{arxiv.2505.13534,
  title  = {InterFeat: A Pipeline for Finding Interesting Scientific Features},
  author = {Dan Ofer and Michal Linial and Dafna Shahaf},
  journal= {arXiv preprint arXiv:2505.13534},
  year   = {2025}
}
R2 v1 2026-07-01T02:22:57.991Z