What can I tell you, other than to avoid the kind of people who take something about you, and turn it into an attack. Also don’t bring up the topic yourself unless you want to defend it, and —however hard it is— try to “not attribute to malice, that which is simple ignorance”.

There are also some rhetoric tricks you can use to return an attack, but you risk being perceived as a troublemaker.