I never got defensive when people called my kilt a skirt because they are right for most parts. Kilts look skirts. I can't fault people for that. AFter all, kilt is not a every day word for most people.

Just approach the question with a sense of humour. you will live longer.