I’ve enjoyed a lot of mileage from my black barathea silver buttoned Argyll jacket. If you own no other kilt jackets, it is a great place to start and can be worn just about anywhere at multiple levels of formality.

If you are set on a tweed jacket, then I would go for it, but I believe that you would get significantly more mileage out of a jacket and vest like this in colored barathea. If you selected a non-descript button type (I see matte black pretty regularly nowadays), then this type of doublet could be worn with everything from a solid wool tie to a jabot.

As others have pointed out in this thread, the material of the jacket ultimately dictates the formality of the jacket moreso than the cut and style. That is, a tweed Sheriffmuir is quite casual, while a velvet Argyll is quite formal. Barathea is “middle of the road” and can go either way.