Sentence learning on deep convolutional networks for image Caption Generation
We propose a method to train image representation to improve the performance of image Caption Generation. We use transfer learning CNN on sentences, and extract image representation with deep Fisher kernel. With this representation, we generate sentence with gLSTM and show the improvements in performance. In the experiment, we validate each steps of our method by comparing with previous state-of-the-art models.