Very ironically called ''You Can Never Go Back'' because much of the melody is taken from His Royal Highness from I And Albert.
I always thought of But You Go On as Miss Hannigan's backstory. I know she's putting on an act when she sings it in the show, but maybe the subtext is that this is her real life.
