I don’t think anyone would take offense to that. However, some guys may think it’s an indicator that you’re gay. Which can lead to them talking more candidly to you about LGBT issues, or even hitting on you. It starts to be an issue when you present as gay and don’t correct people. See https://en.wikipedia.org/wiki/Queerbaiting