I'm no expert but you could have your action set too low. I have the same problem with the E at least low down on the neck. The higher up I go, the less of a problem it is.

I am sure the resident tech Gods will weigh in and provide us with an answer.