中文

基于Transformer的美国法典章节定义提取

计算与语言 2025-04-24 v1 人工智能

摘要

从法律文本中自动提取定义对于增强对复杂法律语料库(如美国法典U.S.C.)的理解和清晰度至关重要。我们 presented an advanced NLP system leveraging transformer-based architectures to automatically extract defined terms, their definitions, and their scope from the U.S.C. 我们 address the challenges of automatically identifying legal definitions, extracting defined terms, and determining their scope within this complex corpus of over 200,000 pages of federal statutory law. Building upon previous feature-based machine learning methods, our updated model employs domain-specific transformers (Legal-BERT) fine-tuned specifically for statutory texts, significantly improving extraction accuracy. Our work implements a multi-stage pipeline that combines document structure analysis with state-of-the-art language models to process legal text from the XML version of the U.S. Code. Each paragraph is first classified using a fine-tuned legal domain BERT model to determine if it contains a definition. Our system then aggregates related paragraphs into coherent definitional units and applies a combination of attention mechanisms and rule-based patterns to extract defined terms and their jurisdictional scope. The definition extraction system is evaluated on multiple titles of the U.S. Code containing thousands of definitions, demonstrating significant improvements over previous approaches. Our best model achieves 96.8% precision and 98.9% recall (98.2% F1-score), substantially outperforming traditional machine learning classifiers. This work contributes to improving accessibility and understanding of legal information while establishing a foundation for downstream legal reasoning tasks.

关键词

引用

@article{arxiv.2504.16353,
  title  = {Transformer-Based Extraction of Statutory Definitions from the U.S. Code},
  author = {Arpana Hosabettu and Harsh Shah},
  journal= {arXiv preprint arXiv:2504.16353},
  year   = {2025}
}

备注

7 pages, to be published in IEEE AIIoT 2025