I've been using GPT-2 (with the 117M model) to generate hip-hop lyrics.
First I gathered thousands of lyrics from this website : http://ohhla.com/
Then I trained GPT-2 on it until the loss curve went flat (it took few days).
Then it could generate text like this : hiphop_lyrics.txt.
Here is the translated french version.
Here is the trained model.
At various points I also used the conditional prompt to generate hiphop versions of famous songs :
![](pics/rap01.PNG)
---
![](pics/rap02.PNG)
---
![](pics/rap03.PNG)
---
![](pics/rap04.PNG)
---
![](pics/rap05.PNG)
---
![](pics/rap06.PNG)
---
![](pics/rap07.PNG)
---
![](pics/rap08.PNG)
---
![](pics/rap09.PNG)
---
![](pics/rap10.PNG)
---
![](pics/rap11.PNG)
---
![](pics/rap12.PNG)
---
![](pics/rap13.PNG)
---
![](pics/rap14.PNG)
---
![](pics/rap15.PNG)
---
![](pics/rap16.PNG)
---
![](pics/rap17.PNG)
---
![](pics/rap18.PNG)
---
![](pics/rap19.PNG)
---
![](pics/rap20.PNG)
---
![](pics/rap21.PNG)
---
![](pics/rap22.PNG)
---
![](pics/rap23.PNG)
---
![](pics/rap24.PNG)
---
![](pics/rap25.PNG)
---
![](pics/rap27.PNG)
---
![](pics/rap28.PNG)
---
![](pics/rap30.PNG)
---
![](pics/rap31.PNG)
---
![](pics/rap32.PNG)
---
![](pics/rap33.PNG)
---
![](pics/rap34.PNG)
---
![](pics/rap35.PNG)
---
![](pics/rap36.PNG)
---
![](pics/rap37.PNG)
---
![](pics/rap38.PNG)
---
![](pics/rap39.PNG)
---
![](pics/rap40.PNG)
---
![](pics/rap41.PNG)
---
![](pics/rap42.PNG)
---
![](pics/rap43.PNG)
---
![](pics/rap44.PNG)
---
![](pics/rap45.PNG)
---