It's a complex matter. Most people are genuinely sensitive to the offence they might cause when told about it. Unless they're geared up for hate - which I believe is a minority of people.
My dear departed nana, she used to whisper "darkie" - she knew it wasn't quite the right word to say, but she hadn't really worked out what else to say, and she'd grown up saying that.
She had a cat, called Blackie.
A black family moved in next door.
She instantly changed the cat's name to Suzie. She was mortified at the thought of standing on the back door step shouting "Blackie!" to get the cat in
Now, that's a cute, funny story. But it shows how language is complex. She knew "darkie" wasn't quite right, just as she knew saying "Blackie" would cause offence. She changed one immediately, but never quite managed to change the other. The difference was that she wouldn't say "darkie" to other people, outside, in public, etc. She knew it was wrong, but it still held a place in her language, and it never quite shifted. But she could also never bring herself to knowingly cause offence to people.
That's what I find so hateful about JV's stance. He simply doesn't care if anything causes offence to people because he'll be the one to decide what he does and says thank you very much, and fuck anyone else.
It's nothing but hate and spite.