English

Innovation and Word Usage Patterns in Machine Learning

Machine Learning 2023-11-08 v1 Computation and Language

Abstract

In this study, we delve into the dynamic landscape of machine learning research evolution. Initially, through the utilization of Latent Dirichlet Allocation, we discern pivotal themes and fundamental concepts that have emerged within the realm of machine learning. Subsequently, we undertake a comprehensive analysis to track the evolutionary trajectories of these identified themes. To quantify the novelty and divergence of research contributions, we employ the Kullback-Leibler Divergence metric. This statistical measure serves as a proxy for ``surprise'', indicating the extent of differentiation between the content of academic papers and the subsequent developments in research. By amalgamating these insights, we gain the ability to ascertain the pivotal roles played by prominent researchers and the significance of specific academic venues (periodicals and conferences) within the machine learning domain.

Keywords

Cite

@article{arxiv.2311.03633,
  title  = {Innovation and Word Usage Patterns in Machine Learning},
  author = {Vítor Bandeira Borges and Daniel Oliveira Cajueiro},
  journal= {arXiv preprint arXiv:2311.03633},
  year   = {2023}
}
R2 v1 2026-06-28T13:13:28.442Z