If you can take sizes off your waist safely by all means DO IT. Don't keep the FAT there just to keep the kilts. The health benifits out weigh the kilt benifits.
I have sold one of mine already for the same reason and am about to sell another to a kilt friend. So I say GO FOR IT!