It's your call, of course. As one who tends toward the kilt pin, I would discreetly lose the badge. But, again, that's my "take" on it.