yes, when it comes to anti-immigration some fears could be said to be legitimate, but some aren't, immigrants don't get free cars, trans women are oppressed (you don't even have to accept transsexuality to acknowledge that). it is difficult to find any legitimate fears amongst the terfs whose arguments seems to be that men are trans to get into women only spaces to rape women, or that its a secret male plot to take over womens bodies. There is no evidence for the former and it sounds absurd, particularly as a consequence of taking hormones makes raping anyone almost impossible, and the second is loonery. So yes there are fears, just as there were with gay people, bigotry is fear, but those fears are not really legitimate and so should be robustly challenged, not apologised for.