It struck me that way too. I think sometimes there are words that develop pejorative connotations from the way they are used by racists and that may be the case here. I've felt that way about how "gay" is sometimes used (e.g., "he's a gay" doesn't sit well whereas "he's gay" doesn't have the same connotation. I am also sure it was unintentional in this case.
