It seems I recall from another thread that the sporran was historically worn on the hip until the Victorian era when it was moved to cover the "bulge" for modesty.

My wife is the same about it. If you really think about it though, there is a much larger bulge in pants than in a kilt, it's just more obvious in a kilt.