Maybe its not my place to be openly judgemental on this but, even if its unsaid, if that's what you choose to represent yourself with you cannot possibly be unaware that it is in the popular magination a symbol of inhumanity, genocide, and oppresiveness. You cant just expect people to overlook that minor detail and cry foul when judged. Especially if you list as one of your dislikes: 'victims'. Whatever that is supposed to say about a person, I just dont know exactly.
Words had meanings in the past, and they have meanings now. The changes are almost always organic, they aren't officially re-assigned by dictionary publishers. If your politician/friend/familly member told you they were 'gay', wouldn't you feel cynically misled if they afterwards insisted they just meant they were happy?
I'm all in favour of people using whatever words/symbols they want but they have to accept any other stigma/baggage that goes with it if its a concious choice to represent themselves in this way.