I worked for several years at the United States Senate. I always wore a kilt on National Tartan Day and never had any issues. My usual work attire was coat and tie so I wore semi-formal daywear. Just match the level of dress that you normally wear and you'll be fine.