It's just like the placket on a man's shirt, the right side goes under the left.

Apparently this is a Victorian era idea. Women of means would rarely dress themselves so buttons were set up for right handed servants. Apparently this transferred to womens wrap around skirts as well.