Go for it! I have kilts in the Gordon and Hunting McLeod tartans and I have no ties to either clan. Wear what you like, but do try to find out a little about the history of the clan so you can answer questions if and when they come up.