Another subtle pattern is herringbone; I have a Brooks Brothers light blue herringbone shirt that goes very well with my kilt, and the pattern is so small it is hardly noticeable, save when you look really hard.

And you can never go wrong with L.L. Bean, INMHO.

T.