If others are wearing a jacket, then go with the jacket. If other people are just wearing a shirt and tie, go for that.