Actually I tend to ignore the remarks I feel are sarcastic. Those that sound sincere I explain that it is a kilt that I wear. My wife on the other hand takes a different approach. She usually answers for me (I think this is a common tactic used by other women tho I am not sure). She is quick to say and I will paraphrase "He is wearing a kilt. Men wear kilts, boys wear pants and women wear skirts." That usually shuts them up.

Still, it is nice to have the discussion about the differences of opinion.