The kilt's probably pulled in below the sporran because you were sitting down. When you stand up, the kilt tends to bunch a little above/behind the sporran, so it rises just below it. Just give the sporran a little flip as you stand up, or the kilt a quick tug when you're standing, and you won't get that pull.

Andrew.