Wear the kilt, man! Built doesn't matter, I'm build like a broomhandle (6'2 145lbs); got the chicken legs and all, and I don't hesitate to wear my kilt. I agree that if you get yourself some accessories that you'll change your own mind. Some hose, a sporran, and I think a black Jacobite shirt would be great.

edit: Darned spelling mistakes.