Like anything else, there is a wide variety in the fedora. Is it tweed or pelt or felt? How broad is the brim and what shape? Where are you wearing it? With what other accessories? What colour?

Despite the fact that I like and own several very different fedoras (fedorae?) it wouldn't ordinarily be my first choice of a combination, but depending on what goes with it, it might become appropriate if not the usual.