English

A Survey of Machine Learning for Big Code and Naturalness

Software Engineering 2018-05-08 v2 Machine Learning Programming Languages

Abstract

Research at the intersection of machine learning, programming languages, and software engineering has recently taken important steps in proposing learnable probabilistic models of source code that exploit code's abundance of patterns. In this article, we survey this work. We contrast programming languages against natural languages and discuss how these similarities and differences drive the design of probabilistic models. We present a taxonomy based on the underlying design principles of each model and use it to navigate the literature. Then, we review how researchers have adapted these models to application areas and discuss cross-cutting and application-specific challenges and opportunities.

Keywords

Cite

@article{arxiv.1709.06182,
  title  = {A Survey of Machine Learning for Big Code and Naturalness},
  author = {Miltiadis Allamanis and Earl T. Barr and Premkumar Devanbu and Charles Sutton},
  journal= {arXiv preprint arXiv:1709.06182},
  year   = {2018}
}

Comments

Website accompanying this survey paper can be found at https://ml4code.github.io

R2 v1 2026-06-22T21:47:33.811Z