By using “that’s gay” as a negative, there is an association that gay=bad regardless of context. I don’t feel that way but I understand other people’s perception of the phrase.