The magnetic field will also dampen the strings quicker , that means less sustain .
I'm not sure, but I don't think it's going to leave a permanent effect on your pickups magnets ... As I recall, magnets can be demagnetized by extreme heat , hitting them very hard and other stuff I don't remember.