Normally that is a don't, however as with most don'ts, your confidence trumps it every time. Looks good on you. I've had two horses in the past and a cowboy hat, though I've never even thought about mixing the two.