I don’t like to mess with solvents very much. And I don’t work with many stones either but I have found that Nail Polish Remover, typically acetone, which is a very strong solvent in my mind will remove most glues. So will WD-40. I don’t know how or if different solvents react with different stones. As a side note I have removed dried road tar from a sweater with mayonnaise, Hellman’s I think. I have never tried it with glue.
Don Meixner