I think you fine, a white shirt might have been a tad more formal, but overall there's nothing to be ashamed of. Keeping up with your partner's dinner jacket however is going to take some doing!