Yes the back side of a belt can do some damage. I make my belts with the soft side of velcro and it seems to help. I first started doing this because the leather I had was thin and I wanted to have a thicker belt. Also some leather is stretchy and so I use it to stabilize the leather.