I was asked that question in almost exactly the same way: "Nice skirt. Where'd you get it?" I was in a bar at the time, surrounded by gay men, so "in my closet" would have been a fine answer. But I just told him where the kilt had been made (Burnetts & Struth, in that particular case). He said that he might have to order one, then asked about the tartan (Maple Leaf), and whether they had a variety of clan tartans as well.

Taking his comment as an insult might have prevented a fine conversation...