I have used rare earth magnets without any issues. The trick is to use the right ones. Don't use the magnets from a disk drive. The ones I use are round 3/8" diameter. I have found you need two magnets otherwise the kilt pin will rotate. I have had issues with two magnets being attracted to each other. Turning one over will allow them to repel but then they end up flipping on top of each other. To solve that I now glue them to a strip of plastic. That keeps them in order. As far as being attracted to a nearby metal object I have to be already against it for the 3/8" magnet to lock on.

Mike