English

Encoding architecture algebra

Machine Learning 2024-10-16 v1 Artificial Intelligence Programming Languages Software Engineering

Abstract

Despite the wide variety of input types in machine learning, this diversity is often not fully reflected in their representations or model architectures, leading to inefficiencies throughout a model's lifecycle. This paper introduces an algebraic approach to constructing input-encoding architectures that properly account for the data's structure, providing a step toward achieving more typeful machine learning.

Keywords

Cite

@article{arxiv.2410.11776,
  title  = {Encoding architecture algebra},
  author = {Stephane Bersier and Xinyi Chen-Lin},
  journal= {arXiv preprint arXiv:2410.11776},
  year   = {2024}
}

Comments

25 pages, 6 figures. Keywords: typeful, algebraic data types, tensors, structured data