I'd say go for it. Mixing tartans has been a highland fashion since the 18th century(maybe before). They are not so dissimilar that people would notice unless you pointed it out.