Take it from a Scotsman, wearing a Balmoral outside of the Army or the Pipe Band is fairly unusual.
There are no hard and fast rules as to what outfits you can and cannot wear a Balmoral with, so I see absolutely no reason why you can't wear it with a particular sporran.

Next time someone tells you what you can or cannot do tell them your buddy from Scotland says they are talking absolute rubbish.