There should have been two "keepers" with the belt. They are intended to flank the buckle on each side and cover the rivets on one side and help hold fast the turned back side as well as provide visual balance to the belt.

You can lay it out on a smooth, flat surface and apply HEAVY pressure to the turn. Sometimes it just takes breaking in.