It's the negative association you're creating with it that they most likely have a problem with. It reinforces homophobia, even when used unintentionally. Just use "lame" or something similar instead.