 Neural networks have been used for implementing language models since the early 2000s.LSTM helped to improve machine translation and language modeling.Other key techniques in this field are negative sampling and word embedding.