Section 2.3: Run with new data
Kaggle song lyrics - Disney.txt
I substituted Adele lyrics for Disney lyrics, and trained the network using Dr.Suess and Disney lyrics at softmax temperature 0.56 and learning rate 0.01. Training with Disney lyrics instead of Adele lyrics seems to be a little bit harder, because even though I trained the network for 20 epochs, the words and sentences generated are still very garbled. However, the words that the network seems to want to generate definitely seem more childish and references many words from nature, animals, and boy/girls.
Network trained with Disney and Dr.Suess lyrics after 20 epochs