With civilian attire I suspect that it's a matter of what goes on first when dressing, with those who may have worn a sword in the military following army regulations. My take is that since one is likely to have to put on and take off the sword several times during the course of the day wearing the baldric over both the plaid and dirk belt makes the most sense.