Ditto on what TheSp8 said.

I carved a kilt pin specifically for one of my kilts over a decade ago. Epoxied clutch pins (2) were used to secure the kilt pin and are still going strong. And no damage to the woolen kilt fabric.

As long as the pins aren't too short, I would think you'd be just fine.

Slainte yall,
steve