Words are given special meanings all the time. "Gay", "Black", "Sanitation Engineer", "A Woman's Right To Choose". People need a word or group of words to have a special meaning and by agreement and continuous usage, those words become habits and come to take on the meaning they've been given.

If, in America, skirt = female garment, then a kilt is not a skirt. If skirt had a gender-neutral meaning in American English, then it would probably not be an issue.

Some guys still use the term, "chasing skirts" to mean that they are pursuing women (for sex). So, to some guys, "skirt" is almost synonymous with "woman".

I have no problem correcting people when they seem confused about whether or not I'm wearing a woman's garment.

I'll say, "It's a kilt," because most people know that a kilt is not a woman's skirt.

Also, while a sarong or a lava-lava is a skirt by any dictionary definition, they are not skirts by American clothing standards since skirts are women's clothing and only women wear skirts.

Want proof? Go into any department store and ask for the men's skirt department. There's no such thing.

I wear kilts and sarongs and I own a lava-lava and they're not skirts.