Grinding sounds like a high-risk approach.

The usual method involves a small, fine file. Take off both E strings, to get them out of the way. Take your time - haste makes for sloppy work, and mistakes leave permanent marks.