You could possibly use the clips that hold buttons in place so when you would like a different color you can quickly change them.
Maybe match the color of the kilt?

Are you going to wear a white shirt? Colored shirts tend to show through a white jacket making it look cheap.