I think it's a fantastic idea.

The building I work in doesn't take kindly to showing up with a fixed blade on one's person, and while the bottle opener has been what I've worn in the past for similar "effect", I've gotten some strange looks for that one too. You'd think they didn't want people imbibing at work or something....

A shoe horn would be useful without risk or raising eyebrows in a negative way.