One issue is how the system used looks on the top side of the belt. Buckles are attached in a small area, usually with rivets or thread.
Velcro is sewn the full length of the Velcro to the leather as most adhesives "give up" over time and flexing. If the belt is dual layer bonded after the buckle or Velcro is applied to the inner layer then both are invisible.
If Velcro is used, the hook side needs be on the small inner adjusting belt where it can never get at the fabric and rip at it.