Sadly, the Olympics announcer said the rule is black pants - but as evidenced by the Norwegian men's team the rule isn't well enforced.

You can go to Google Images and search for "kilts curling" and find a number of photos of kilted curlers - honoring the game's Scottish origins...despite one errant announcer giving Olympic coverage who attributed curling's origins to Canada.....