Hi Alec, I like the idea of gently rotating the rivet in fine sandpaper (emery paper?). My rivets are quite small and would preclude that technique, which is why a very gently will enlarge the hole instead.One doesn’t need to remove much material from the opening. It’s just a very little that would need to be removed generally, since I do carefully match the drill bit to the rivet diameter.