The white dress-ivory dress thing has never had anything to do with chastity, and everything to do with age. White dresses were (and still are) considered "proper" for under 30's and ivory is considered the proper choice for women over 30.