English

ByteScience: Bridging Unstructured Scientific Literature and Structured Data with Auto Fine-tuned Large Language Model in Token Granularity

Computation and Language 2024-12-10 v2 Artificial Intelligence

Abstract

Natural Language Processing (NLP) is widely used to supply summarization ability from long context to structured information. However, extracting structured knowledge from scientific text by NLP models remains a challenge because of its domain-specific nature to complex data preprocessing and the granularity of multi-layered device-level information. To address this, we introduce ByteScience, a non-profit cloud-based auto fine-tuned Large Language Model (LLM) platform, which is designed to extract structured scientific data and synthesize new scientific knowledge from vast scientific corpora. The platform capitalizes on DARWIN, an open-source, fine-tuned LLM dedicated to natural science. The platform was built on Amazon Web Services (AWS) and provides an automated, user-friendly workflow for custom model development and data extraction. The platform achieves remarkable accuracy with only a small amount of well-annotated articles. This innovative tool streamlines the transition from the science literature to structured knowledge and data and benefits the advancements in natural informatics.

Keywords

Cite

@article{arxiv.2411.12000,
  title  = {ByteScience: Bridging Unstructured Scientific Literature and Structured Data with Auto Fine-tuned Large Language Model in Token Granularity},
  author = {Tong Xie and Hanzhi Zhang and Shaozhou Wang and Yuwei Wan and Imran Razzak and Chunyu Kit and Wenjie Zhang and Bram Hoex},
  journal= {arXiv preprint arXiv:2411.12000},
  year   = {2024}
}
R2 v1 2026-06-28T20:04:12.136Z