Jamie,
First - a very warm from Boston, Massachusetts.
Second - You are not the one with the problem. Either a co-worker is out of line professionally, or is on the wrong end of supervision for cause. Whichever is the case, he/she has decided to use/abuse you as their personal scapegoat. I hope you can keep a professional air when the discussion comes up. I do not know the labor laws in the State of New York. If this were here in Massachusetts, the supervisor would be reported to human resources, with a suggestion for some culture/diversity training. I am an openly gay male, who is in a same sex marriage here in Massachusetts. I wear the kilt as a source of pride in my Scottish Ancestry, as well as for the comfort that goes along with it. Tuesday I was kilted all day in public as the supervisor of a precinct polling station here in Boston. I have had in the past a few rude remarks about the kilt. Most have been handled by some short words of education. I have been kilted over forty years, and have only had one person that needed education by being the caber that got tossed. I am also fortunate to live in a very culturally, and ethnically diverse city. I have been photographed on the subway while kilted, talking with another passenger in full Native American regalia.
At first, there were some issues. Over time they have faded away as more people here are showing pride in their heritage in their daily clothing.

Best wishes, Steve