My frets were worse than that and I took it to a guitar technician.
He rubbed the frets down with something quite course - it was years ago and I can't quite remember what he used - it played fine afterwards