I agree. No belt if you're wearing a waistcoat.
However, you can wear a belt and sporran together. If you're wearing them at the right level neither of them will scratch the other.