Yes so that was because GPT-2 generated this carol
AI Weirdness
literary-potato:aiweirdness:Christmas carols generated by a tiny vintage neural net trained from scratch on my laptopThe story of the chimney seeSanta baby, and blood and joyous so world and joy and good will to seeSanta baby bore sweet Jesus ChristFa la la la la la la, la la la la la la la...