Abstract: Neural machine translation (NMT) is a method for developing a translation model using neural networks. Various modifications to NMT have been created to enhance its translation performance.