I've done that a couple of times. I wouldn't say it was an anxiety thing... just that I put on the kilt, looked in the mirror, and said to myself, "nah, the kilt is going to be way out of place where I'm going, and I'm just not in the mood for that kind of attention." This may make me a lesser kiltie in some peoples' eyes, but I'm fine with that.

When I was younger, though, I struggled very hard with anxiety about going in public, regardless of how I was dressed. I would quite literally get sick to my stomach (usually accompanied by vomiting) over simple things like going to school. Or playing sports. Or talking to someone I didn't know. So I know how it can be, and I feel your pain! Sadly, though, I don't have any quick solutions to it. It's just something I've worked on my whole life, and I still have to mentally brace myself to do things that others don't think twice about.

Wearing the kilt and building confidence over time should help, though. Just don't force yourself into it too hard. That can backfire.