I was browsing HN one day and came across this thread that mentioned a new GPT-2 library: aitextgen. This is exactly what I was waiting for! (actually, that day had arrived earlier and the author of aitextgen had written previous versions).