I used to have a full Argyll cut jacket and waistcoat that I wore with trews-- it looked really sharp and both were eventually recycled to a clan member in Edinburgh. I'd say go for it.