I second Jock Scot since the PC is really not an 'outdoor' jacket, it is not really seen with headwear. Other formal jackets such as certain doublets would lend themselves to headwear however a PC is really a dinner jacket or tuxedo equivalent.

I would suggest you will look fine without it. Unless you have another jacket option?