Biomedical knowledge graphs (KGs) are widely used across research and translational settings, yet their design decisions and implementation are often opaque. Unlike ontologies that more frequently adhere to established creation principles, biomedical KGs lack consistent practices for construction, documentation, and dissemination. To address this gap, we introduce a set of evaluation criteria grounded in widely accepted data standards and principles from related fields. We apply these criteria to 16 biomedical KGs, revealing that even those that appear to align with best practices often obscure essential information required for external reuse. Moreover, biomedical KGs, despite pursuing similar goals and ingesting the same sources in some cases, display substantial variation in models, source integration, and terminology for node types. Reaping the potential benefits of knowledge graphs for biomedical research while reducing wasted effort requires community-wide adoption of shared criteria and maturation of standards such as BioLink and KGX. Such improvements in transparency and standardization are essential for creating long-term reusability, improving comparability across resources, and enhancing the overall utility of KGs within biomedicine.
@article{arxiv.2508.21774,
title = {Improving Biomedical Knowledge Graph Quality: A Community Approach},
author = {Katherina G Cortes and Shilpa Sundar and Sarah Gehrke and Keenan Manpearl and Junxia Lin and Daniel Robert Korn and Harry Caufield and Kevin Schaper and Justin Reese and Kushal Koirala and Lawrence E Hunter and E. Kathleen Carter and Marcello DeLuca and Arjun Krishnan and Chris Mungall and Melissa Haendel},
journal= {arXiv preprint arXiv:2508.21774},
year = {2025}
}