I wear my black 21st Century kilt from Geoffrey (Tailor) in Edinburgh around my local town in England and get no adverse commnts. I think that wearing it in a "traditional" manner may help - with long socks, sporran etc.

I think that once you have ventured out a couple of times your confidence will grow. And you will probably realise that there was nothing to worry about afer all !

Go for it !!