I waited until I was 69 to start collecting social security and I'm glad I did for the reasons you mentioned. I continued to work at my job but was forced to take a significant pay cut when I turned 69 so I needed to supplement my income with social security. Fortunately my health has remained good even until today.
I managed to make 2 trips to New York in January and February earlier this year and saw a total of 19 shows. I was scheduled to return at the end of March to see Hangmen, Sunset, Doubtfire, Love Life, Girl from the North Country, Take Me Out, and at least a few others until the virus intervened. I'm sure I would have also done a fall trip with my partner.