it was from a magical number of how many 'ells' of cloth were allowed by the King (Henry VIII, if memory serves).

In the end, the more fabric, the deeper the pleats can be, the heavier the fabric will be on you.

I wear a 5 and 8 on occasion. No real difference except for weight.