Innovation and Word Usage Patterns in Machine Learning
Vítor Bandeira Borges Daniel Oliveira Cajueiro
In this study, we delve into the dynamic landscape of machine learning
research evolution. Initially, through the utilization of Latent Dirichlet
Allocation, we discern pivotal themes and fundamental concepts that have
emerged within the realm of machine learning. Subsequently, we undertake a
comprehensive analysis to track the evolutionary trajectories of these
identified themes. To quantify the novelty and divergence of research
contributions, we employ the Kullback-Leibler Divergence metric. This
statistical measure serves as a proxy for ``surprise'', indicating the extent
of differentiation between the content of academic papers and the subsequent
developments in research. By amalgamating these insights, we gain the ability
to ascertain the pivotal roles played by prominent researchers and the
significance of specific academic venues (periodicals and conferences) within
the machine learning domain.